Medical Image Segmentation Based on a Hybrid Region-Based Active Contour Model

Liu, Tingting; Xu, Haiyong; Jin, Wei; Liu, Zhen; Zhao, Yiming; Tian, Wenzhe

doi:https://doi.org/10.1155/2014/890725

Computational and Mathematical Methods in Medicine

On this page

Abstract Introduction Background Implementation and Experimental Results Conclusion Acknowledgments References Copyright Related Articles

Special Issue

Mathematical Methods in Biomedical Imaging 2014

View this Special Issue

Research Article | Open Access

Volume 2014 | Article ID 890725 | https://doi.org/10.1155/2014/890725

Medical Image Segmentation Based on a Hybrid Region-Based Active Contour Model

Tingting Liu,¹Haiyong Xu,²Wei Jin,¹Zhen Liu,¹Yiming Zhao,²and Wenzhe Tian¹

Academic Editor: Peng Feng

Received20 Feb 2014

Revised02 May 2014

Accepted25 May 2014

Published16 Jun 2014

Abstract

A novel hybrid region-based active contour model is presented to segment medical images with intensity inhomogeneity. The energy functional for the proposed model consists of three weighted terms: global term, local term, and regularization term. The total energy is incorporated into a level set formulation with a level set regularization term, from which a curve evolution equation is derived for energy minimization. Experiments on some synthetic and real images demonstrate that our model is more efficient compared with the localizing region-based active contours (LRBAC) method, proposed by Lankton, and more robust compared with the Chan-Vese (C-V) active contour model.

1. Introduction

Medical images are generally ambiguous. If objects of interest and their boundaries can be located correctly, meaningful visual information would be provided to the physicians, making the following analysis much easier. Within the numerous image segmentation algorithms, active contour model is widely used with its clear curve for the object.

According to the curve representation, there are two main kinds of active contour models: parametric models and geometric models. Parametric active contour models use parameterized curves to represent the contours. Snake model, proposed by Kass et al. in [1], is a representative and popular one among parametric active contour models. The model requires a constant curve to detect the boundary of the image. In early age, the parametric active contour model is an efficient framework for biometric image segmentation. However, it cannot represent the topology changes such as the merging and splitting of the evolving curve [1].

The geometric active contour model, combining level set method and curve evolution theory, allows cusps, corners, and automatic topological changes. It can solve problems of curve evolution in the parametric active contour model and extend the application region of the active contour model.

Considering the parametric/geometric active contour model propagating toward a local optimum and thus exhibiting sensitivity to initial conditions, Bresson et al. proposed a new global optimization method in [2]. This fast active contour is based on the level set method, replacing the framework with convex relaxation approaches. Therefore, the model does not rely on the initial information with speed.

According to the energy, there are two main categories of active contour models: edge-based models [1–6] and region-based models [7–24]. Edge-based active contour models rely on the image gradient to stop the evolving contours on the desired object boundaries [6]. For images with weak boundaries, the energy functional of the edge-based active contour models will hardly approach zero on the boundaries of the objects and the evolving curve may pass through the true boundaries. Therefore, the edge-based active contour models always fail to segment medical images properly, as blur or weak edge usually occur in the medical images, especially in MRI brain images, which typically contain large area of blur boundaries between gray matter and white matter [12]. Compared with the edge-based active contour models, the region-based active contour models do not utilize the image gradient; they utilize image statistics inside and outside the contours to control the evolution with better performance for images of weak edges or without edges. Many region-based active contour algorithms are based on the assumption that an image can be approximated by global intensity. For example, Chan and Vese proposed a famous Chan-Vese (CV) model in [7] and Yezzi et al. proposed a fully global approach in [16], deriving a set of coupled curve evolution equations from a single global cost functional to promote multiple contours to segment multiple-region image.

CV model, also known as PC (piecewise constant) model, proposed in [7], is a simplified Mumford-Shah function. The model utilizes the global mean intensities of the interior and exterior regions of images. Thus, it has good segmentation result for the objects with weak or discrete boundaries but often has erroneous segmentation for images with intensity inhomogeneity. However, due to technical limitations or artifacts introduced by the object being imaged, intensity inhomogeneity often occurs in many medical images [12, 13, 25].

Many implementation schemes have been proposed to break the restrictions of CV model. For example, in [8, 9], two similar region-based models are proposed independently. These models are based on a general piecewise smooth (PS) formulation which is originally proposed by Mumford and Shah in [26] and have been known as piecewise smooth (PS) models. The PS models can handle segmentation problems which are caused by intensity inhomogeneity. Lankton and Tannenbaum proposed localizing region-based active contours (LRBAC) in [15], allowing any region-based segmentation energy to be reformulated in a local way. The technique they proposed can be used with any global region-based active contour energy, segmenting objects with heterogeneous statistics. However, they are computationally too expensive. One way to reduce the computational cost being proposed in [9] is to use a contour near the object boundaries as the initial contour.

In [11, 17, 18, 23, 27–30], local region-based active contour models are proposed to overcome the difficulty caused by intensity inhomogeneity. The local binary fitting (LBF) model in [10] and the region-scalable fitting (RSF) model in [11] being proposed by Li et al. are the most popular models. LBF model utilizes image information in local regions. RSF model draws upon intensity information in local regions at a controllable scale. These two models have similar capability to handle intensity inhomogeneity. However, they are also sensitive to initialization.

To make the segmentation efficient, Piovano et al. [25] used convolutions to quickly compute localized statistics and yield results similar to piecewise smooth segmentation. A model proposed in [13] is to deal with spatial perturbations of the image intensity directly. In [14], Lankton et al. proposed a similar flow based on computing geodesic curve in the space of localized means rather than approximating a piecewise smooth model. The technique can identify object boundaries accurately and reduce dependence on initial curve placement.

More recently, Xu et al. proposed a hybrid active contour in [31]. The model incorporates the GAC model, which is an edge-based active contour model, and the CV model, which is a region-based active contour model. The new model was called as geodesic intensity fitting (GIF) model. It was then extended to two models: global geodesic intensity fitting (GGIF) model and local geodesic intensity fitting (LGIF) model. The GGIF model is for images with intensity homogeneity. And the LGIF model is for images with intensity inhomogeneity.

Motivated by the work in [31], we plan to propose a model which is based on the region information of the images. While it is fast but not accurate in using global information and it is accurate but not fast in using local information, the new function will use both of global and local information to attain the correct result quickly. Inspired by [7, 15], a hybrid region-based active contour model is presented for image segmentation in this paper. The global information is provided by CV model. The local information is described by applying the framework proposed in [15] to the energy in [16], localizing the energy. The weights between the local and global fitting terms are applied to avoid computationally expensive and erroneous segmentation.

2. Background

2.1. Chan-Vese Model

The Chan-Vese (CV) model [7] is a special case of the Mumford-Shah problem [26]. Given the curve , with being an open subset, for the image on the image domain , the energy functional they proposed is where and represent the regions outside and inside the contour , respectively. The constants and are the intensity averages of and , respectively. is the length of the contour , the third term in the right hand side of (1), which is introduced to regularize the contour . The parameters , , and are positive constants, usually fixing .

To solve the minimization problem, the level set method proposed in [32] is used in which the unknown curve is replaced by the unknown level set function , considering that if the point is inside , if the point is outside , and if the point is on . Thus, the energy functional can be reformulated in terms of the level set function as follows: where and are, respectively, the regularized approximation of Heaviside function and delta function as follows:

Using the Euler-Lagrange equations to solve the minimization problem of (2), the level set function can be updated by the following gradient descent method: where and can be expressed, respectively, as follows:

Compared with other active contour models, CV model is far less sensitive to the initialization. The initial curve can be placed anywhere in the image, and it can detect both contours with or without gradient. However, as the model uses global information of the image, the optimal constants and will not be accurate if the image intensities in and are not homogeneous. Thus, the CV model generally fails to segment images with intensity inhomogeneity.

2.2. Coupled Curve Evolution Equations

Yezzi et al. proposed a fully global approach to image segmentation via coupled curve evolution equations in [16]. Followed by [15], we call it mean separation (MS) energy as it uses mean intensities. The technique can “pull apart” the values of two or more image statistics and is useful for segmenting images of a known number of region types. The approach can promote multiple contours simultaneously toward the region boundaries. In this paper, we only refer to the simple case of bimodal imagery in which there are two types of regions, foreground and background.

Given a binary image on the image domain , foreground region of intensity , and background region of intensity , . Initial closed curve encloses some portions of and some portions of . The mean intensities and inside and outside the curve, respectively, are bounded above and below by and ; when , an upper bound of is uniquely attained. That means that foreground and background regions should have maximal separate mean intensities. The energy is The gradient of and is where and denote the area of interior and exterior of , respectively. denotes the outward unit normal of , which will become with respect to the exterior of . The gradient flow of is

To counter the effect of noise, a penalty on the arc length of the curve is added to functional (6): The penalty regularizes the gradient flow as Equation (9) is always expressed in a more general way:

In contrast to other region-based snake algorithms, the technique requires no prior knowledge of evolution, exhibiting more robustness to initial contour placement and noise. However, the method is not suitable for the heterogeneous objects as they use the global statistics.

3. The Proposed Method

In this section, we propose a hybrid region-based active contour model which can segment images with intensity inhomogeneity accurately and efficiently. As mentioned in Section 2, global region-based active contour models can segment images with weak boundaries but are not suitable for images with intensity inhomogeneity. For this kind of images, we can use local region-based active contour models to do the segmentation. However, using local information will cause high computation cost. The energy functional can share the local and global advantages without adding extra computation when compared to pure global schemes. The energy functional is defined as where and are positive parameters that control the contribution of the global and local energy. As lots of images contain noises, the contour may tend to weave around or encircle extremely small regions due to noise. To counter such effect and keep the curve smooth, we add a regularization term as is commonly done. The term is defined related to the arc length of the contour during evolution. The final energy is given as follows:

3.1. Global Energy

Let be the image domain; let be a given gray level image; the global energy we use is where and are the mean intensity of foreground and background of the image, respectively. According to the level set method, is represented by the zero level set function , such that Using the Heaviside function , (14) can be rewritten as In practice, the Heaviside function is approximated by a smooth function defined by The derivative of is : where is a positive constant.

3.2. Local Energy

As mentioned in Section 2, the local energy can handle segmentation of images with intensity inhomogeneity. Inspired by [15], we use a ball function to mask local regions. The local energy functional is where is a ball function, centered at , and can be expressed as where is the ball radius. The function will be 1 when the point is within a ball and 0 otherwise.

and are the mean values of the intensity inside and outside the contour in the local ball region (centered at ). The expressions of and are as follows:

To get the optimum result, and should be very different at every along the contour. That means local foreground and background should be different rather than constant.

3.3. Total Energy Formulation

For lots of images containing noises, the contour may tend to weave around or encircle extremely small regions due to noise. To offset such effect and keep the curve smooth, we add a regularization term as is commonly done. The term is defined related to the arc length of the contour during evolution: where is the derivative of : The energy functional in (13) can be rewritten as By applying the standard gradient descent method, the constants and , optimal means and , and level set function which minimize the energy functional (24) are obtained by where is the area of local interior and is the area of local exterior:

4. Implementation and Experimental Results

The level set evolution equation (25) is implemented using a simple finite differencing. The temporal partial derivative is discretized as the forward difference. The approximation of (25) can be simply written as where is the approximation of the right hand side in (25).

In our implementation, the level set function can be simply initialized as where is a constant, is the subset of the image domain , and is the boundary of . We test the proposed method with some synthetic and natural images from different modalities. Experiments are implemented on a computer with Intel Core 2 duo, 2.53 GHZ CPU, 2.0 GB RAM, Windows 7 ultimate, and MATLAB 7.12. Unless otherwise specified, we use the following default settings of the parameters: time step and . The parameters and vary from 0 to 2 according to the degree of inhomogeneity, .

4.1. Synthetic Imagery

Figure 1 shows experimental results of both LRBAC [15], which used only local information of the image, and the proposed method for three images. Among that, noisy gourd and three objects are with noises. The original images with the same initial contour are listed in Figure 1(a). While the segmentation results of LRBAC method and the proposed method are shown Figures 1(b) and 1(c), respectively. We observed that both LRBAC method and the proposed method could well segment the image of gourd () and the image of noisy gourd (). For the image of three objects , LRBAC method gets trapped into a local minimum without taking global image information into account while our model extracts the object boundary successfully. As both LRBAC method and the proposed method use the regularization term, contours are kept smoothly under the noisy condition. Otherwise, noises would be recognized as objects.

(a)

(b)

(c)

For the image of gourd and the image of noisy gourd, although both LRBAC method and our method can segment them well, our method takes far less time to get the satisfied result, being more efficient than the LRBAC method. Iterations and CPU time are listed in Table 1.

Figure 2 shows experimental results of both CV method and the proposed method on the image of three objects . The image was created with intensity inhomogeneity and contaminated by Gaussian noise. Table 2 shows Iterations and CPU time of these two methods. We can notice that although CV model spends less time in curve evolution, it leaks at the boundary of object and cannot segment the object accurately.

(a)

(b)

(c)

4.2. Real Imagery

Intensity inhomogeneity often occurs in real images. Figure 3 shows a real image of a T-shaped object () and two X-ray images of vessel ( and ) with intensity inhomogeneity. T-shaped object with intensity inhomogeneity is due to nonuniform illumination. For X-ray images of vessel, some parts of the boundaries are quite weak and some parts of the background intensities are even higher than the vessel, which makes it a nontrivial task to segment the image with global method. We compare the segmentation ability of our method with the LRBAC method. As shown in Figure 3 and Table 3, for image of Vessel 1, our method gains faster result than the LRBAC method and, for image of Vessel 2, our method gains better results than the LRBAC method.

(a)

(b)

(c)

Figure 4 shows experimental results of both CV model and our method on four typical medical images with intensity inhomogeneity: two X-ray images of vessels ( and ) and one brain MR image (). From Figure 4, we can see the brain MR image has some intensities of white matter in the upper part, which are even lower than those of the gray matter in the lower part. The experiment results show that even CV model can drive curve faster than our method, which fails to extract the object boundaries (Table 4).

(a)

(b)

(c)

5. Conclusion

In this paper, we propose a hybrid region-based active contour model for image segmentation. The proposed method can improve the ability of the CV model to deal with intensity inhomogeneity. Meanwhile, it makes segmentation more efficient compared to the LRBAC method. Experimental results on both synthetic and real images demonstrate that the proposed method can handle both better intensity inhomogeneity and robustness to noise compared with CV model and the LRBAC method.

It should be noted that the energy functional for our model is nonconvex and therefore has local minima, which makes our model sensitive to the initialization of the contour. Future work can be made to apply proper algorithms to develop globally optimal active contours.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgments

The authors would like to thank the anonymous reviewers and editors for their valuable comments to improve this paper. Besides, this work is supported by the National Natural Science Foundation of China (61271399), the Research Fund for the Doctoral Program of Higher Education of China (20133305110004), the Natural Science Foundation of Zhejiang Province (LY13F020037), the Ningbo International Cooperation Project (2013D10011), and the Natural Science Foundation of Ningbo (201401A6101022).

References

M. Kass, A. Witkin, and D. Terzopoulos, “Snakes: active contour models,” International Journal of Computer Vision, vol. 1, no. 4, pp. 321–331, 1988.
View at: Publisher Site | Google Scholar
X. Bresson, S. Esedoglu, P. Vandergheynst, J.-P. Thiran, and S. Osher, “Fast global minimization of the active contour/snake model,” Journal of Mathematical Imaging and Vision, vol. 28, no. 2, pp. 151–167, 2007.
View at: Publisher Site | Google Scholar
J. Hahn and C.-O. Lee, “Geometric attraction-driven flow for image segmentation and boundary detection,” Journal of Visual Communication and Image Representation, vol. 21, no. 1, pp. 56–66, 2010.
View at: Publisher Site | Google Scholar
C. Xu and J. L. Prince, “Snakes, shapes, and gradient vector flow,” IEEE Transactions on Image Processing, vol. 7, no. 3, pp. 359–369, 1998.
View at: Publisher Site | Google Scholar
V. Caselles, R. Kimmel, and G. Sapiro, “Geodesic active contours,” International Journal of Computer Vision, vol. 22, no. 1, pp. 61–79, 1997.
View at: Google Scholar
G. Zhu, S. Zhang, Q. Zeng, and C. Wang, “Boundary-based image segmentation using binary level set method,” Optical Engineering, vol. 46, no. 5, Article ID 050501, 2007.
View at: Publisher Site | Google Scholar
T. F. Chan and L. A. Vese, “Active contours without edges,” IEEE Transactions on Image Processing, vol. 10, no. 2, pp. 266–277, 2001.
View at: Publisher Site | Google Scholar
L. A. Vese and T. F. Chan, “A multiphase level set framework for image segmentation using the Mumford and Shah model,” International Journal of Computer Vision, vol. 50, no. 3, pp. 271–293, 2002.
View at: Publisher Site | Google Scholar
A. Tsai, A. Yezzi Jr., and A. S. Willsky, “Curve evolution implementation of the Mumford-Shah functional for image segmentation, denoising, interpolation, and magnification,” IEEE Transactions on Image Processing, vol. 10, no. 8, pp. 1169–1186, 2001.
View at: Publisher Site | Google Scholar
C. Li, C.-Y. Kao, J. C. Gore, and Z. Ding, “Implicit active contours driven by local binary fitting energy,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '07), pp. 1–7, June 2007.
View at: Publisher Site | Google Scholar
C. Li, C.-Y. Kao, J. C. Gore, and Z. Ding, “Minimization of region-scalable fitting energy for image segmentation,” IEEE Transactions on Image Processing, vol. 17, no. 10, pp. 1940–1949, 2008.
View at: Publisher Site | Google Scholar
L. Wang, C. Li, Q. Sun, D. Xia, and C.-Y. Kao, “Active contours driven by local and global intensity fitting energy with application to brain MR image segmentation,” Computerized Medical Imaging and Graphics, vol. 33, no. 7, pp. 520–531, 2009.
View at: Publisher Site | Google Scholar
J. An, M. Rousson, and C. Xu, “Γ-Convergence approximation to piecewise smooth medical image segmentation,” in Medical Image Computing and Computer-Assisted Intervention-MICCAI, vol. 4792, pp. 495–502, 2007.
View at: Google Scholar
S. Lankton, D. Nain, A. Yezzi, and A. Tannenbaum, “Hybrid geodesic region-based curve evolutions for image segmentation,” in Medical Imaging 2007: Physics of Medical Imaging, Proceedings of SPIE, February 2007.
View at: Publisher Site | Google Scholar
S. Lankton and A. Tannenbaum, “Localizing region-based active contours,” IEEE Transactions on Image Processing, vol. 17, no. 11, pp. 2029–2039, 2008.
View at: Publisher Site | Google Scholar
A. Yezzi Jr., A. Tsai, and A. Willsky, “A fully global approach to image segmentation via coupled curve evolution equations,” Journal of Visual Communication and Image Representation, vol. 13, no. 1-2, pp. 195–216, 2002.
View at: Publisher Site | Google Scholar
K. Zhang, H. Song, and L. Zhang, “Active contours driven by local image fitting energy,” Pattern Recognition, vol. 43, no. 4, pp. 1199–1206, 2010.
View at: Publisher Site | Google Scholar
X.-F. Wang, D.-S. Huang, and H. Xu, “An efficient local Chan-Vese model for image segmentation,” Pattern Recognition, vol. 43, no. 3, pp. 603–618, 2010.
View at: Publisher Site | Google Scholar
B. Liu, H. D. Cheng, J. Huang, J. Tian, X. Tang, and J. Liu, “Probability density difference-based active contour for ultrasound image segmentation,” Pattern Recognition, vol. 43, no. 6, pp. 2028–2042, 2010.
View at: Publisher Site | Google Scholar
L. Liu, W. Tao, J. Liu, and J. Tian, “A variational model and graph cuts optimization for interactive foreground extraction,” Signal Processing, vol. 91, no. 5, pp. 1210–1215, 2011.
View at: Publisher Site | Google Scholar
Q. Ge, L. Xiao, J. Zhang, and Z. H. Wei, “A robust patch-statistical active contour model for image segmentation,” Pattern Recognition Letters, vol. 33, no. 12, pp. 1549–1557, 2012.
View at: Publisher Site | Google Scholar
S. Liu and Y. Peng, “A local region-based ChanVese model for image segmentation,” Pattern Recognition, vol. 45, no. 7, pp. 2769–2779, 2012.
View at: Publisher Site | Google Scholar
C. He, Y. Wang, and Q. Chen, “Active contours driven by weighted region-scalable fitting energy based on local entropy,” Signal Processing, vol. 92, no. 2, pp. 587–600, 2012.
View at: Publisher Site | Google Scholar
W. Liu, Y. Shang, and X. Yang, “Active contour model driven by local histogram fitting energy,” Pattern Recognition Letters, vol. 34, no. 6, pp. 655–662, 2013.
View at: Publisher Site | Google Scholar
J. Piovano, M. Rousson, and T. Papadopoulo, “Efficient segmentation of piecewise smooth images,” in Scale Space and Variational Methods in Computer Vision, vol. 44885, pp. 709–720, 2007.
View at: Google Scholar
D. Mumford and J. Shah, “Optimal approximations by piecewise smooth functions and associated variational problems,” Communications on Pure and Applied Mathematics, vol. 42, no. 5, pp. 577–685, 1989.
View at: Google Scholar
Q. Zheng, E. Dong, Z. Cao, W. Sun, and Z. Li, “Modified localized graph cuts based active contour model for local segmentation with surrounding nearby clutter and intensity inhomogeneity,” Signal Processing, vol. 93, no. 4, pp. 961–966, 2013.
View at: Publisher Site | Google Scholar
L. Wang, L. He, A. Mishra, and C. Li, “Active contours driven by local Gaussian distribution fitting energy,” Signal Processing, vol. 89, no. 12, pp. 2435–2447, 2009.
View at: Publisher Site | Google Scholar
K. Zhang, L. Zhang, and S. Zhang, “A variational multiphase level set approach to simultaneous segmentation and bias correction,” in Proceedings of the 17th IEEE International Conference on Image Processing (ICIP '10), pp. 4105–4108, September 2010.
View at: Publisher Site | Google Scholar
Q. Zheng, E. Dong, Z. Cao, W. Sun, and Z. Li, “Active contour model driven by linear speed function for local segmentation with robust initialization and applications in MR brain images,” Signal Processing, vol. 97, pp. 117–133, 2014.
View at: Google Scholar
H. Xu, T. Liu, and G. Wang, “Hybrid geodesic region-based active contours for image segmentation,” Computers and Electrical Engineering, vol. 40, no. 3, pp. 858–869, 2014.
View at: Publisher Site | Google Scholar
S. Osher and J. A. Sethian, “Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations,” Journal of Computational Physics, vol. 79, no. 1, pp. 12–49, 1988.
View at: Google Scholar

Copyright

Copyright © 2014 Tingting Liu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

4033

Downloads

2255

Citations