Abstract
Active contour models are very popular in image segmentation. Different features such as mean gray and variance are selected for different purpose. But for image with intensity inhomogeneities, there are no features for segmentation using the active contour model. The images with intensity inhomogeneities often occurred in real world especially in medical images. To deal with the difficulties raised in image segmentation with intensity inhomogeneities, a new active contour model with higher-order diffusion method is proposed. With the addition of gradient and Laplace information, the active contour model can converge to the edge of the image even with the intensity inhomogeneities. Because of the introduction of Laplace information, the difference scheme becomes more difficult. To enhance the efficiency of the segmentation, the fast Split Bregman algorithm is designed for the segmentation implementation. The performance of our method is demonstrated through numerical experiments of some medical image segmentations with intensity inhomogeneities.
1. Introduction
Medical images are popular in real world because they give intuitive expression. With the development of image processing, computer-aided diagnosis are more important with the ever increasing images. Image segmentation is often the first step in computer-aided diagnosis. But medical images are often with intensity inhomogeneities; so it is a hard work to segment in such images as angiogram and MR bladder images.
The active contour model has been increasingly applied to image segmentation in the past decade, because it provides very good frameworks of variational image segmentations. Chan-Vese (CV) model [1] is the most popular active contour model for image segmentation based on the feature of mean gray value of different regions. Chen et al. [2] use variance feature to carry out the segmentation. The variance information can solve the question of different areas with same mean gray value and different variance. The MAP (maximum a posterior) is an efficient region descriptor for the segmentation task. Zhu [3], Paragios and Deriche [4], and Rousson and Deriche [5] approximated the MAP of the given image by a mixture of Gaussians. The features deduced by MAP method are very popular in images with different probability distributions. Sarti et al. [6] deduced using variance information by MAP of Rayleigh distribution.
The above methods are the key development in active contour models. But they are a failure in image segmentation with intensity inhomogeneities, because there are no features that can be deduced for segmentation using the active contour model. The images with intensity inhomogeneities often occurred in real world especially in medical images. Li et al. [7] are the first researchers to deal with this question using region scalable fitting energy. Then, they [8] also extend the method to MRI. Qian et al. [9] use a domain kernel function and an edge indicator function for medical image segmentation. He incorporates the information of different areas and edges for the segmentation.
Pan et al. [10] proposed a segmentation method based on global variables difference. The method is proposed for medical images with complex topological structure, strong contrast, and low noise characteristics. It makes full use of the image area information, builds an energy model, and uses variation gradient information to establish a global energy model to get the minimization value. Yao and Cheng [11] use adjustable method for medical image segmentation. They combine active contour model with diffusion filter for multiobject segmentation of the noisy image. A target adaptive scheme is designed for adjusting the model to solving a particular image processing task.
All the methods mentioned above are region-based models aiming to identify each region of interest by using a certain region descriptor to guide the motion of the active contour. For images with intensity inhomogeneity, region descriptor is hard to find. There is much important information such as image gradient and Laplace that are ignored in active contour model. For medical images, intensity inhomogeneity is usually due to technical limitations or artifacts introduced by the object being imaged. The edges are blurred and the gradients are weak. So incorporate edge information alone is not enough, we also incorporate higher order diffusion term into the active contour model aiding segmentation.
In this paper, we propose a new active contour model with gradient and higher-order information of the image. The model can also be deemed as active contour model coupling with high-order diffusion, diffusion, because the introduction of Laplace information and the difference scheme becomes more difficult. To enhance the efficiency of the segmentation, the fast Split Bregman algorithm is designed for the segmentation implementation.
The organization of this paper goes as follows. In Section 2, we will introduce the active contour and high-order diffusion related methods briefly. Then the new active model with high-order diffusion method is proposed in Section 3. Then some numerical examples are shown in Section 4. Section 5 is the concluding remarks.
2. Higher Diffusion and Active Contour Model
Generalized Perona-Malik equation for image restoration [12] was the first paper that introduced and implemented high-order anisotropic diffusion partial differential equations (PDEs) for image analysis. There are also many other high-order PDEs that have been already applied to image processing [13, 14]. They achieved great success in various image processing applications. The models are proposed for staircase effect reduction. Incorporating Laplace term, higher-order diffusion can use more information near the edges. In this paper, we select the total variation with higher-order diffusion because of the simplicity.
The total variation model with higher-order diffusion is depicted as: where is the image domain,is the denoised image, and is the noisy image.
The active contour model using mean gray value is depicted as: where is the level set function and and are the mean gray value of different areas. This contour model is a global convex model proposed by Bresson et al. [15]. The proposed model is a global minimization problem due to convex set . Bresson transformed the original active contour model to a convex minimization problem by relaxing to and showed that the characteristic function is the global minimizer. This model is based on mean gray value and it has drawbacks with different usages.
For medical images we incorporate the edges and Laplace information into active contour model for dealing with intensity inhomogeneities. The new model has the abilities of both (1) and (2). The new model is depicted in the next section.
3. Active Contour Model Coupling with Higher-Order Diffusion
It is hard to segment medical images because the edges are always weak and the images are also noisy. We couple the higher-order diffusion model with active contour model for medical images segmentation. The new model that couples higher-order diffusion with active contour model is
where is the image domain, ,,,,, are the positive parameters, is the original image, and are the mean values in different image parts, and is a standard level set function.
We use the form of (3) mainly because the image features in different areas are not always the same. This is a natural extension of Chen and Vese [1] and Vese and Chen [16] model for piecewise constant or smooth model. We can get the solution using alternating iteration. Because there are gradient and Laplace information, straightforward solving of (3) by introducing forth-order term of difference scheme is a hard work. The Split Bregman method [17, 18] is introduced for the easy implementation of the model.
We introduce the auxiliary variables , and Bregman iteration parameters, when the following energy function gets its minimization, .
Equation (3) can be divided into the following three sub-problems of minimization:
Fixand, the energy function of (3) became the following form:
where ,,,, andare the positive parameters.
The energy function of is The Eular-Lagrange equation is The discretion of is The energy function of is Using Eular-Lagrange equation, we can get By wavelet soft threshold The energy function of is Using Eular-Lagrange equation, we can get By wavelet soft threshold, For solving , the procedure is the same as solving .
For convenience, we write The energy function can be rewritten as: For solving , we also use the Split Bregman method by introducing .
Then the energy function of (14) is transformed as: where , is the positive parameter.
Fixing for solving : Using gradient descent method, After discretion, To ensure that , so in every step we use the following function: Fix for solving , we can get
In the end of calculation, we set where is the preset threshold. Thus the foreground and the background can be separated. Due to , our new model is also globally convex. That is to say, the position of need not be initialized.
4. Numerical Experiments
To verify the effect of our proposed method, we test our method on a variety of real images with intensity inhomogeneity. We compare our method with CV model [1] and mean shift algorithm [19] because they are highly cited and compared in image segmentation. The CV model which is used in our experiment for comparison is also global convex [15]. For comparison with the mean shift algorithm, we used the software EDISON which is based on a fast implementation of the mean shift algorithm using a speed-up scheme described in [19–21].
Figure 1 shows the results for a real image of a T-shaped object with different lighting intensity. Figures 2 and 3 are two experiments on X-ray images of vessels. The images are noisy with intensity inhomogeneity. Figure 4 is a test of MR image of blades with the comparison of CV model and mean shift method. All of them are selected because they are typical images with intensity inhomogeneity. The CV model and mean shift method cannot get the proper results while our model can get the right results. The shadow of the object is the key element causing wrong segmentation of tradition methods. However, our model can separate the shadow and the object.
(a)
(b)
(c)
(d)
(a)
(b)
(c)
(d)
(a)
(b)
(c)
(d)
(a)
(b)
(c)
(d)
The vessel images in Figures 2 and 3 fail to be segmented using traditional methods because of the intensity inhomogeneity. But using our model, the boundary of the object of interest (the bladder) is extracted very well. In these two images, parts of the vessel boundaries are quite weak; our method can still segment them well. Satisfactory segmentation results have been obtained for these challenging images. Our method successfully extracts the object boundaries for these two images.
Figure 4 is the segmentation results of an MR image of bladder. The result of mean shift algorithm for the first image is similar to that of our method, showing certain ability of the mean shift algorithm in handling intensity inhomogeneity. However, for the two-vessel image, a small portion of the vessel is missing. For segmenting the MR bladder image, the result is not so perfect for surrounding organs. We notice that the segmentation result of mean shift algorithm is somewhat sensitive to the choice of two major parameters: spatial bandwidth and range bandwidth. We have tweaked these two parameters and other minor parameters for the best segmentation results for these four images.
5. Conclusion
In this paper, we present a new active contour model for medical image segmentation. The proposed model incorporates gradient and Laplace information. It can segment images with intensity inhomogeneity and has desirable performance for images with weak object boundaries. Experimental results have demonstrated the advantages of our method over several well-known methods for image segmentation.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
Acknowledgments
This work was supported by National Natural Science Foundation of China (no. 61305045, no. 61303079, and no. 61170106), National “Twelfth Five-Year” development plan of science and technology (no. 2013BAI01B03), Qingdao science and technology development project (no. 13-1-4-190-jch), and Natural Science Foundation of Shandong Province (no. ZR2010FQ030).