INTRODUCTION
This research studies the Discrete Cosine Transform Based Gradient Vector Flow in Normal Direction (DCT based NGVF) Active Contours in comparison with the Discrete Cosine Transform Based Gradient Vector Flow (DCT based GVF) Active Contours. DCT based NGVF Active Contours have been proposed by Britto and Ravindran (2007c). The DCT based NGVF Active Contours has its foundation derived from NGVF Active Contours (Jifeng et al., 2007) and extensive research carried out in the area of image segmentation using GVF Active Contours (Britto and Ravindran, 2005a, b; 2006a-e; 2007a, b).
Active Contours are used extensively in computer vision and image processing applications, particularly to locate object boundaries. The main advantage of Active Contours is the ability to generate closed parametric curves from images. Problems associated with initialization and poor convergence to concave boundaries, however, have limited their utility.
To overcome these difficulties in initialization and poor convergence to object boundaries, an external force model was suggested that used a convex combination of the usual external force and a new force derived from an estimate of the local curvature of the object boundary. This force simultaneously pulled the snake toward the boundary and into the concave region (Prince and Xu, 1996). This was later improved by Xu and Prince to form the Gradient Vector Flow (GVF) field.
The resulting formulation produces external force fields that had both irrotational and solenoidal components (Xu and Prince, 1998), which had a large capture range overcoming the difficulty associated with initialization of Active Contours and it was also able to provide good convergence to concave boundaries. Tang and Acton (2004) have given an improved form of the GVF field, called the Discrete Cosine Transform (DCT) based GVF.
Extensive experimentation and analysis on the chromosome spread image segmentation performance of DCT based GVF Active Contours has been performed and it is established that the DCT based GVF Active Contours are an efficient segmentation technique for chromosome images (Britto and Ravindran, 2005a, b; 2006a-e; 2007a, b).
An improvement for the GVF Active Contours called NGVF (GVF in the Normal direction)
has been proposed (Jifeng et al., 2007). The NGVF has faster convergence
speed towards the concavity and bigger time step. It also has the capability
to enter into long, thin indention and provide a good contour. The DCT based
NGVF Active Contours had been proposed (Britto and Ravindran, 2007c) based on
the strengths of GVF Active Contours and NGVF Active Contours.
ACTIVE CONTOUR MODELS
Active Contours also called as snakes or deformable curves, first proposed by Kass et al. (1987) are energy minimizing contours that apply information about the boundaries as part of an optimization procedure. They are generally initialized by automatic or manual process around the object of interest. The contour then deforms itself iteratively from its initial position in conformity with the nearest dominant edge feature, by minimizing the energy composed of the internal and external forces, converging to the boundary of the object of interest.
The internal forces computed from within the Active Contour enforce smoothness
of the curve and external forces that are derived from the image help to drive
the curve toward the desired features of interest during the course of the iterative
process. The energy minimization process can be viewed as a dynamic problem
where the Active Contour Model is governed by the laws of elasticity and lagrangian
dynamics (Rueckert, 1997) and the model evolves until equilibrium of all forces
is reached, which is equivalent to a minimum of the energy function. The energy
function is thus minimized, making the model active.
FORMULATION OF ACTIVE CONTOUR MODELS
An Active Contour Model can be represented by a curve c, as a function of its
arc length τ:
with τ = [0
1]. To define a closed curve, c(0) is set to equal c(1).
A discrete model can be expressed as an ordered set of n vertices as vi
= (xi,yi)T with v=(v1,
,vn).
The large number of vertices required to achieve any predetermined accuracy
could lead to high computational complexity and numerical instability (Rueckert,
1997).
Mathematically, an Active Contour Model can be defined in discrete form as
a curve x(s) = [x(s), y(s)], sε[0,1] that moves through the spatial domain
of an image to minimize the energy functional:
Where, α and β are weighting parameters that control the Active Contours
tension and rigidity, respectively (Xu and Prince, 1997). The first order derivative
discourages stretching while the second order derivative discourages bending.
The weighting parameters of tension and rigidity govern the effect of the derivatives
on the snake. The external energy function Eext is derived from the
image so that it takes on smaller values at the features of interest such as
boundaries and guides the Active Contour towards the boundaries. The external
energy is defined by
Where, Gσ(x,y) is a two-dimensional Gaussian function with
standard deviation σ, I(x,y) represents the image and κ is the external
force weight. This external energy is specified for a line drawing (black on
white) and positive κ is used. A motivation for applying some Gaussian
filtering to the underlying image is to reduce noise.
An Active Contour that minimizes E must satisfy the Euler Equation
Where,
comprise
the components of a force balance equation such that
The internal force Fint discourages stretching and bending while
the external potential force Fext drives the active contour towards
the desired image boundary. Eq. 4 is solved by making the
Active Contour dynamic by treating x as a function of time t as well as s. Then
the partial derivative of x with respect to t is then set equal to the left
hand side of Eq. 4 as follows:
A solution to Eq. 6 can be obtained by discretizing the equation
and solving the discrete system iteratively (Kass et al., 1987). When
the solution x(s,t) stabilizes, the term xt(s,t) vanishes and a solution
of Eq. 4 is achieved. Traditional Active Contour Models suffer
from a few drawbacks. Boundary concavities leave the contour split across the
boundary. Capture range is also limited. Hence a new external force was developed
(Prince and Xu, 1996).
Three guiding principles led to the development of the new external force.
• |
The first aim was the ability to add the new force to the
existing force. Since the existing force was the gradient of a scalar function
(the energy Eext), it was an irrotational (curl-free field).
According to the Helmholtz theorem, the other fundamental field component
was a solenoidal (divergence-free) field. Therefore, the new field was chosen
to be solenoidal. |
• |
The second aim was that the new field should not disturb the equilibrium
contours of the external energy in the absence of internal forces. Therefore,
the new field should be zero whenever the field -∇Eext
is zero. |
• |
The third aim wanted the field to point toward the apex of concave boundary
regions, a feature defined by the object boundary curvature. Therefore,
the new field was made to use a measure of boundary curvature in its definition
(Prince and Xu, 1996). This was later improved by Xu and Prince to form
the GVF field. Xu and Prince (1997) presented a new external force, called
GVF, which was computed as a diffusion of the Gradient Vectors of a gray-level
or binary edge map derived from the image. The resultant field had a large
capture range and forces the Active Contours into concave regions (Xu and
Prince, 1998, 2000). |
The overall approach was to define a new non-irrotational external force field,
called as the GVF field. The earlier idea of constructing a separate solenoidal
field from an image and adding it to a standard irrotational field was improved
and a more natural approach was designed in which the external force field is
designed to have the desired properties of both large capture range and presence
of forces that point into boundary concavities. The resulting formulation produces
external force fields that had both irrotational and solenoidal components (Xu
and Prince, 1998).
GRADIENT VECTOR FLOW (GVF) ACTIVE CONTOURS
Gradient Vector Flow (GVF) Active Contours use Gradient Vector Flow fields obtained by solving a vector diffusion equation that diffuses the Gradient Vectors of a gray-level edge map computed from the image. The GVF Active Contour Model cannot be written as the negative gradient of a potential function. Hence it is directly specified from a dynamic force equation, instead of the standard energy minimization network. The external forces arising out of GVF fields are non-conservative forces as they cannot be written as gradients of scalar potential functions. The usage of non-conservative forces as external forces show improved performance of GVF field Active Contours compared to traditional energy minimizing Active Contours (Xu and Prince, 1998, 2000). The GVF field points towards the object boundary when very near to the boundary, but varies smoothly over homogeneous image regions extending to the image border. Hence the GVF field can capture an Active Contour from long range from either side of the object boundary and can force it into the object boundary. The GVF Active Contour Model thus has a large capture range and is insensitive to the initialization of the contour. Hence the contour initialization is flexible.
The Gradient Vectors are normal to the boundary surface but by combining Laplacian and Gradient the result is not the normal vectors to the boundary surface. As a result of this, the GVF field yields vectors that point into boundary concavities so that the Active Contour is driven through the concavities. Information regarding whether the initial contour should expand or contract need not be given to the GVF Active Contour Model. The GVF is very useful when there are boundary gaps, because it preserves the perceptual edge property of Active Contours (Kass et al., 1987; Xu and Prince, 1998). The GVF field is defined as the equilibrium solution to the following vector diffusion equation (Xu and Prince 2000),
Where:
ut |
= |
Partial derivative of u(x,t) with respect to t |
∇2 |
= |
Laplacian operator (applied to each spatial component of u separately) |
f |
= |
An edge map that has a higher value at the desired object boundary. |
The functions in g and h control the amount of diffusion in GVF. In Eq.
7,
produces
a smoothly varying vector field and hence called as the smoothing term, while
encourages
the vector field u to be close to ∇f computed from the image data and
hence called as the data term. The weighting functions and apply to the smoothing
and data terms, respectively and they are chosen as and
.
g(·)is constant here and smoothing occurs everywhere, while h(·)grows
larger near strong edges and dominates at boundaries. Hence, the GVF field is
defined as the vector field v(x,y)=[u(x,y),v(x,y)] that minimizes the energy
functional.
The effect of this variational formulation is that the result is made smooth
when there is no data. When the gradient of the edge map is large, it keeps
the external field nearly equal to the gradient, but keeps field to be slowly
varying in homogeneous regions where the gradient of the edge map is small,
i.e., the gradient of an edge map Δf has vectors point toward the edges,
which are normal to the edges at the edges and have magnitudes only in the immediate
vicinity of the edges and in homogeneous regions Δf is nearly zero. μ
is a regularization parameter that governs the tradeoff between the first and
the second term in the integrand in Eq. 8. The solution of
Eq. 8 can be done using the Calculus of Variations and further
by treating u and v as functions of time, solving them as generalized diffusion
equations (Xu and Prince, 1998).
DISCRETE COSINE TRANSFORM (DCT) BASED GVF ACTIVE CONTOURS
The transform of an image yields more insight into the properties of the image. The DCT has excellent energy compaction. Hence, the DCT promises better description of the image properties.
The DCT is embedded into the GVF Active Contours. When the image property description is significantly low, this helps the contour model to give significantly better performance by utilizing the energy compaction property of the DCT.
The 2D DCT is defined as:
The local contrast of the Image at the given pixel location (k,l) is given
by:
Where:
and
Here, wt denotes the weights used to select the DCT coefficients.
The local contrast P(k,l) is then used to generate a DCT contrast enhanced image
(Tang and Acton, 2004), which is then subject to selective segmentation by the
energy compact Gradient Vector Flow Active Contour Model using Eq.
8.
NGVF ACTIVE CONTOURS
NGVF is an improved external force field for Active Contour Model (Jifeng et al., 2007). Based on analyzing the diffusion process of the GVF and three interpolation functions, it has been found that the generation of GVF contains diffusions in two orthogonal directions along the edge of image, one is the tangent direction and the other is the normal direction. Moreover, the diffusion in the normal direction plays the key role on the diffusion of GVF, while the diffusion in the tangent direction has little effect. So the GVF in the normal direction (NGVF) is taken as a new force field to study. Experiment results with several test images revealed that, compared with GVF, NGVF can enter into long, thin indention and had faster convergence speed towards the concavity and bigger time step (Jifeng et al., 2007).
NGVF is differentiated from GVF by diffusion term and can be also considered as a special case of GVF force field. Moreover, compared with GVF, NGVF can enter into long and thin concavity. It is important that bigger time step makes NGVF more effective than GVF in some cases. In addition, the interpolation function is associated with diffusion process of force field, helping to provide some insights to construct better force fields. The formulation of the NGVF is given in Jifeng et al. (2007).
DCT BASED NGVF ACTIVE CONTOURS
The DCT based GVF Active Contours have been proved to yield efficient segmentation results using standard characterized parameter values for the formulation of the Active Contours. Also, the DCT based GVF Active Contours have been found to be robust, yielding accurate and efficient segmentation results under varying conditions (Britto and Ravindran, 2005a, b; 2006a-e; 2007a, b). The NGVF (Jifeng et al., 2007) has faster convergence speed towards the concavity and bigger time step. It also has the capability to enter into long, thin indention and provide a good contour.
The DCT based NGVF Active Contours (Britto and Ravindran, 2007c) has the combined
strengths of the DCT based GVF Active Contour formulation (Britto and Ravindran,
2005a, b; 2006a-e; 2007a, b) and the NGVF formulation (Jifeng et al.,
2007). The formulation for the new hybrid technique DCT based NGVF Active Contours
(Britto and Ravindran, 2007c) is as follows: The local contrast term in Eq.
10 is used to generate a DCT contrast enhanced image, which is then be subject
to segmentation using the NGVF Active Contours, giving rise to the formulation
of the hybrid technique DCT based NGVF Active Contours.
EXPERIMENTAL RESULTS AND DISCUSSION
Britto and Ravindran (2007c) have used DCT based GVF standardized characterized parameter values directly in the DCT based NGVF Active Contour formulation without any modifications. Under strict evaluation conditions, the DCT based NGVF Active Contours yielded good segmentation results (Britto and Ravindran, 2007c).
In this study, the merit of the DCT based NGVF Active Contours is evaluated by experimentally comparing with the DCT based GVF Active Contours. DCT based GVF Active Contours have already been established to be an efficient segmentation technique for chromosome images (Britto and Ravindran, 2005a, b; 2006a-e; 2007a, b). Using DCT based GVF Active Contours as benchmark for evaluation, DCT based NGVF Active Contours have been evaluated comparatively for chromosome image segmentation.
Experiments were performed under the strict evaluation conditions outlined
in Britto and Ravindran (2007c) on both DCT based NGVF Active Contours and DCT
based GVF Active Contours. On Plate 1, forty sample images were used for this
experimentation. Samples 1-40 show the original sample images. Samples 41-80
show the DCT based GVF Active Contour segmented images. Samples 81-120 show
DCT based NGVF Active Contour segmented images. The Graphical results show that
both the techniques, namely the DCT based NGVF Active Contours and the DCT based
GVF Active Contours yielded very good segmentation results. Visual inspection
of DCT based GVF Active Contour segmented chromosome images and DCT based NGVF
Active Contour images show that segmentation has been successful. All 40 samples
segmented using both the techniques have been displayed here to indicate that
both the techniques show similar segmentation performance visually. Therefore
quantitative comparative evaluation was done to judge the better of the two
techniques viz., DCT based GVF Active Contours and DCT based NGVF Active
Contours.
Quantitative Evaluation of the DCT based NGVF Active Contour compared with the DCT based GVF Active Contour segmentation has been done and shown in Table 1. The mean of the respective errors along the corresponding axes of the contours obtained on segmentation using DCT based NGVF Active Contours and DCT based GVF Active Contours show a variation of approximately 0.1 pixels. Compared with the 1 pixel contour step size and the 1 pixel width of the contour, a variation of 0.1 pixels may be insignificant. Hence the variation of approximately 0.1 pixels is negligible.
But the percentage variation of the ratio of the major axis error of the contour to the minor axis error of the contour show a significant reduction of -6.46% in DCT based NGVF Active Contours compared to DCT based GVF Active Contours. This implies that the DCT based NGVF Active Contours are more symmetric compared to the DCT based GVF Active Contours and the error is more uniform along the major and minor axes, implying that eccentric errors in the DCT based GVF Active Contours are reduced in the DCT based NGVF Active Contours.
Percentage variation of the ratio of the contour major axis radius to the minor axis radius of the DCT based NGVF Active Contours compared with the DCT based GVF Active Contours shows a reduction of -0.84%. This supports the earlier inference that the DCT based NGVF Active Contours are more symmetric compared with the DCT based GVF Active Contours. It had been established that the DCT based GVF Active Contours are an efficient segmentation technique for chromosome images (Britto and Ravindran, 2005a, b, 2006a-e, 2007a, b). The symmetric behavior of the DCT based NGVF Active Contour promises scope for better and improved segmentation compared with the DCT based GVF Active Contour.
Reduction in segmentation errors indicate better approximation of the original
boundary by the Active Contour segmented boundary. Reduction in ratios of errors
(Table 1) indicate symmetricity of the Active Contour, which
infers that the Active Contour boundary is independent of the typical shape
(axial elongation) of the chromosome. These inferences point in the direction
of the DCT based NGVF Active Contours as a more efficient segmentation technique.
|
Plate 1: |
Samples 1 to 40 show the original sample image without the
DCT based GVF and DCI based NGVF. Active Contour segmented images. The original
sample images in gray color |
|
Plate 1: |
Samples 41 to 80 show the corresponding DCT based GVF Active
Contour segmented images with the mapped boundary indicated in red color.
Visual inspection of DCT based GVF Active Contour segmented chromosome images
and DCT based NGVF active contour images show that segmentation has been
successful. All 40 samples segmented using both the techniques have been
displayed here to indicate that both the techniques show similar segmentation
performance visually |
|
Plate 1: |
Samples 81 to 120 show the corresponding DCT based NGVF Active
Contour segmented images with the mapped boundary indicated in red color.
Visual inspection of DCT based GVF active contour segmented chromosome images
and DCT based NGVF active contour images show that segmentation has been
successful. All 40 samples segmented using both the techniques have been
displayed here to indicate that both the techniques show similar segmentation
performance visually |
Table 1: |
Quantitative Comparative Evaluation of the DCT based NGVF
Active Contours against DCT based GVF Active Contours based on the contour
segmentation errors and their ratios |
 |
Table 1 shows the quantitative evaluation
of the merit of the DCT based NGVF Active Contours against DCT based GVF
Active Contours based on the contour segmentation errors and their ratios.
Reduction in segmentation errors indicate better approximation of the original
boundary by the Active Contour segmented boundary. Reduction in ratios of
errors (shown in Table above) indicate symmetricity of the Active Contour,
which infers that the Active Contour boundary is independent of the typical
shape (axial elongation) of the chromosome |
CONCLUSION
This research work establishes that the DCT based NGVF Active Contours show almost similar error measures compared to the DCT based GVF Active Contours. This implies that the DCT based NGVF Active Contours should be as good and efficient as the DCT based GVF Active Contours. One special behavior of the DCT based NGVF Active Contour has also been observed and reported in this study. The DCT based NGVF Active Contours are more symmetric compared to the DCT based GVF Active Contours. This symmetric behavior of the DCT based NGVF Active Contours promises improved and better segmentation performance. Compared with DCT based GVF Active Contours, these inferences point in the direction of the DCT based NGVF Active Contours as a more efficient segmentation technique.
ACKNOWLEDGMENTS
The authors express their thanks to Dr. Michael Difilippantonio (Staff Scientist
at the Section of Cancer Genomics, Genetics Branch/CCR/NCI/NIH, Bethesda MD);
Prof. Ekaterina Detcheva (Artificial Intelligence Department, Institute of Mathematics
and Informatics, Sofia, Bulgaria); Prof. Ken Castleman and Prof. Qiang Wu (Advanced
Digital Imaging Research, Texas); Wisconsin State Laboratory of Hygiene (http://worms.zoology.wisc.edu/zooweb/Phelps/karyotype.html) and the Genomic Centre for
Cancer Research and Diagnosis (GCCRD) (http://www.umanitoba.ca/institutes/manitoba_institute_cell_biology/GCCRD/GCCRD_Homepage.html) for providing
chromosome spread images. The authors thank Prof. Ning Jifeng, Xidian University,
Shaanxi, China.