A Hybrid Technique for Medical Image Segmentation

Abstract

Medical image segmentation is an essential and challenging aspect in computer-aided diagnosis and also in pattern recognition research. This paper proposes a hybrid method for magnetic resonance (MR) image segmentation. We first remove impulsive noise inherent in MR images by utilizing a vector median filter. Subsequently, Otsu thresholding is used as an initial coarse segmentation method that finds the homogeneous regions of the input image. Finally, an enhanced suppressed fuzzy c-means is used to partition brain MR images into multiple segments, which employs an optimal suppression factor for the perfect clustering in the given data set. To evaluate the robustness of the proposed approach in noisy environment, we add different types of noise and different amount of noise to T1-weighted brain MR images. Experimental results show that the proposed algorithm outperforms other FCM based algorithms in terms of segmentation accuracy for both noise-free and noise-inserted MR images.

1. Introduction

Image segmentation plays a pivotal role in computer-aided diagnosis and therapy. The objective of image segmentation is to partition an image into nonoverlapping, constituent regions that are homogeneous with respect to some attributes such as intensity and texture [1]. The representative image segmentation methods are generally based on the following techniques: thresholding, clustering, and edge detection and region extraction [2]. In this study, a combination of both thresholding and fuzzy clustering techniques will be considered because thresholding finds out the uniform regions for fuzzy clustering that makes the clustering performance better.

For thresholding methods, it is necessary to convert an image to a binary image depending on threshold values that extract the objects from the background [3]. The most convenient and widely used technique is histogram thresholding that is based on the shape properties of the histogram. The image histogram has distinct peaks, with each peak corresponding to one distinct region, and the valleys as the threshold values for separating these regions [4, 5]. Thresholding-based segmentation algorithms are then generally efficient in terms of computational complexity when compared to other segmentation methods, and Otsu’s clustering-based thresholding [6] is being one of the most representative methods for image segmentation.

In addition, fuzzy clustering has been widely studied and successfully applied in image clustering and segmentation [7]. Fuzzy c-means (FCM) clustering [8, 9], which is one of the basic methods of fuzzy clustering, is a soft segmentation method that has been used extensively to improve the compactness of the regions with its cluster validity and simple implementation. FCM depends on the Euclidean distance between pixels based on the assumption that each feature is of equal importance. However, in most real-world applications, features are not considered equally important. Thus, this assumption may seriously affect clustering performance. To improve the performance of FCM, many techniques have been proposed, such as rival checked FCM and suppressed FCM (SFCM), which integrates the hard c-means (HCM) and FCM in order to improve the convergence speed and clustering performance [10, 11]. Based on the advantages of thresholding and fuzzy clustering algorithms for image segmentation, some authors have proposed hybrid techniques combining various FCM-based methods with thresholding. Histogram thresholding using fuzzy theory was proposed by Tobias and Seara [12] in which thresholding was done according to the similarity between grey levels, and this similarity was accessed through a fuzzy measure. However, the application of this algorithm is limited based on the assumption that objects and background must occupy nonoverlapping regions. Chaabane Ben et al. proposed a hybrid method that combines automatic thresholding with FCM [13]. However, this technique yielded good results such that significant peaks and valleys are identified properly. Another hybrid approach was introduced by Tan and Isa, and it provided a good solution to overcome the FCM’s sensitiveness to the initialization condition of cluster centroids and selection of the number of clusters by using the histogram thresholding [14]. This algorithm, however, has one drawback such that some flat portions of the histogram curves had been recognized as dominating peaks. To improve the performance of medical image segmentation, we propose a hybrid technique using Otsu thresholding and enhanced SFCM (EnSFCM). Furthermore, we reduce impulsive noise that is widely presented in magnetic resonance (MR) images by employing vector median filtering.

The rest of this paper is organized as follows. Section 2 introduces the proposed image segmentation approach and Section 3 presents experimental results of the proposed approach and well-known image segmentation algorithms. Finally, Section 4 concludes this paper.

2. Proposed Image Segmentation Framework

The proposed image segmentation approach consists of vector median filtering, Otsu thresholding, and EnSFCM, as shown in Figure 1.

Figure 1 

Process of the proposed image segmentation approach.

In the first step, vector median filtering is utilized to reduce impulsive noise in medical images. Otsu thresholding is then employed for rough segmentation of brain MR images, and finally EnSFCM is applied to have well-segmented images. More details about the proposed approach are described in the following sections.

2.1. Vector Median Filter

It is easily to see impulsive noise in medical images which is independent and uncorrelated to the image pixels and is also randomly distributed over the image. In the case of magnetic resonance (MR) images, uncertainty is widely presented because of impulsive noise in the partial volume effects originating from the low resolution of sensors [11, 15]. With these reasons, impulsive noise inherent in brain MR images can result in low segmentation performance. Thus this paper utilizes a vector median filter (VMF) to remove impulsive noise in images. VMF is a vector processing operator that has been introduced as an extension of scalar median filter and preserves the image without getting blurred and no shifting of boundary [16]. It approaches the problem of noise reduction by searching the most robust vector in the processing window. The process to find the most robust vector is as follows.

Denote by 𝐼 an image to be processed, and let 𝑊 be the processing window centered on the pixel under processing of size 𝑁×𝑁, 𝑁=3,5,7,…, and so forth. Let us consider that each input vector 𝑥_𝑖 is associated with the distance measure, 𝐿_𝑖=^𝑁_𝑗=1‖‖𝑥_𝑖−𝑥_𝑗‖‖_𝛾for𝑖=1,2,…,𝑁,(1) where 𝛾 represents the selected norm. The distance between two samples can be defined by ‖‖𝑥_𝑖−𝑥_𝑗‖‖_𝛾=^𝑚_𝑘=1||𝑥_𝑖𝑘−𝑥_𝑗𝑘||^𝛾^1/𝛾,(2) where 𝑚 is the distance of the vectors and 𝑥_𝑖𝑘 is the 𝑘th element of 𝑥_𝑖. Thus distance 𝐿_𝑖 serves as an ordering criterion of 𝐿_𝑜≤𝐿₁≤⋯≤𝐿_𝑁−1 which implies the same ordering of the input vectors. The VMF output of the set {𝑥₀,𝑥₁,…,𝑥_𝑁} is defined as the sample 𝑥_VMF∈{𝑥₀,𝑥₁,…,𝑥_𝑁} that satisfies the following condition: ^𝑁_𝑖=1‖‖𝑥_VMF−𝑥_𝑖‖‖_𝛾≤^𝑁_𝑖=1‖‖𝑥_𝑗−𝑥_𝑖‖‖_𝛾,for𝑗=1,2,…,𝑁.(3)

2.2. Otsu Thresholding

The Otsu’s algorithm is one of the most referenced thresholding methods to partition images by automatically selecting threshold values from the histogram of the image. To find threshold values, the Otsu’s algorithm utilizes the variance property of the image because variance is the measure of uniformity; the greater value of variance represents the greater difference between the background and the object [4, 6]. Initially, two regions are separated by the intensity threshold, and then the optimal threshold is determined by minimizing the within-class variance or maximizing the between-class variance.

Assume that {𝑃_𝑖}^{𝐿−1𝑖=0} are the probabilities of the gray-level image histogram of an image, where 𝐿 is the range of intensity levels. We can calculate the probabilities of background (𝑃_𝐵) and the probabilities of object (𝑃_𝑂) of the image with a threshold 𝑡 as follows: 𝑃_𝐵(𝑡)=^𝑡_𝑖=0𝑃_𝑂𝑃_𝑖,(𝑡)=1−𝑃_𝐵=^𝐿−1_𝑖=_𝑡+1𝑃_𝑖.(4)

The mean associated with the background and the object can be further calculated using the following equations: 𝜇_𝐵(𝑡)=^𝑡_𝑖=0𝑖⋅𝑃_𝑖𝜇𝑃_𝐵(𝑡)_𝑂,(𝑡)=^𝐿−1_𝑖=_𝑡+1𝑖⋅𝑃_𝑖𝑃_𝑂(𝑡).(5)

By using values of mean, we can compute variance as follows: 𝜎_𝐵(𝑡)=^𝑡_𝑖=0𝑖−𝜇_𝐵²⋅𝑃^𝑖𝜎𝑃_𝐵(𝑡)_𝑂,(𝑡)=^𝐿−1_𝑖=_𝑡+1𝑖−𝜇_𝑂²⋅𝑃^𝑖𝑃_𝑂(𝑡).(6)

The between-class variance (𝜎_{between-class}(𝑡)) which is the weighted variance of the cluster means around the overall mean is defined as follows: 𝜎_{between-class}(𝑡)=𝑃_𝐵𝜇_𝐵(𝑡)−𝜇²+𝑃_𝑂𝜇_𝑂(𝑡)−𝜇²,(7) where 𝜇=∑^{𝐿−1𝑖=0}𝑖⋅𝑃_𝑖 is the global mean of the image. Furthermore, the within-class variance (𝜎_within-class(𝑡)) can be expressed as follows: 𝜎_within-class(𝑡)=𝑃_𝐵(𝑡)×𝜎_𝐵(𝑡)+𝑃_𝑂(𝑡)×𝜎_𝑂(𝑡).(8)

Finally, the optimal threshold value, 𝑡_opt, can be determined by maximizing the between-class variance or equivalently minimizing the with-class variance as follows: 𝑡_opt==aarrggmmian_{1≤𝑖≤𝐿−1}x_{1≤𝑖≤𝐿−1}𝜎_{between-class}(𝑡),𝜎_within-class(𝑡).(9)

2.3. Enhanced Suppressed Fuzzy C-Means

Fuzzy c-means (FCM) is a data clustering algorithm in which data can belong to several groups based on the membership value, and it is one of the most prominent clustering techniques for image segmentation, feature extraction, and pattern recognition [9, 17]. However, the conventional FCM sometimes leads to accuracy degradation in segmentation. To solve this problem, suppressed FCM (SFCM) was proposed to improve the clustering performance as well as convergence speed, which introduces the suppression factor for establishing a relationship between hard c-means (HCM) and FCM clustering algorithms [10]. However, there is no general consensus that the suppression factor for SFCM is optimal in any sense or suitable for any given purpose. Thus, we propose an enhanced suppressed FCM (EnSFCM) to automatically select the suppression factor for SFCM. The selection procedure of the suppression factor, 𝛼, is based on the separation strength between clusters that is a time variant suppression rate. More details about EhSFCM are as follows.

Let 𝑋={𝑥₁,𝑥₂,𝑥₃,…,𝑥_𝑛} where 𝑛 is the number of image pixels. The conventional FCM algorithm sorts the data set 𝑋 into 𝑐 clusters. The standard FCM objective function is defined as follows: 𝐽_𝑚(𝑈,𝑉)=^𝑐_𝑛𝑖=1_𝑘=1𝜇^𝑚𝑖𝑘𝑑²𝑥_𝑘,𝑣_𝑖,(10) where 𝑑²(𝑥_𝑘,𝑣_𝑖) is the Euclidian distance between the data point 𝑥_𝑘 and the centroid 𝑣_𝑖 of the 𝑖th cluster and 𝜇_𝑖𝑘 is the degree of membership of the data 𝑥_𝑘 to the 𝑘th cluster. The parameter 𝑚 which is called the fuzzy factor controls the fuzziness of the resulting partition, (𝑚≥1), and 𝑐 is the total number of clusters. FCM clustering is an iteration-based clustering technique that produces an optimal number of 𝑐 classes by minimizing the objective function 𝐽_𝑚(𝑈,𝑉) with updated values of 𝜇_𝑖𝑘 and 𝑣_𝑖 according to the following equations: 𝜇_𝑖𝑘=⎡⎢⎢⎣^𝑐_𝑗=1𝑑²𝑥_𝑘,𝑣_𝑖𝑑²𝑥_𝑘,𝑣_𝑗^1/(𝑚−1)⎤⎥⎥⎦⁻¹𝑣_𝑖,=∑^𝑛𝑘=1𝜇^𝑚𝑖𝑘⋅𝑥_𝑘∑^𝑛𝑘=1𝜇^𝑚𝑖𝑘.(11)

SFCM modifies the membership function in FCM by utilizing the suppression factor as follows:𝜇_𝑝𝑘=1𝜇−_𝑝𝑘𝛼_𝑖≠𝑝𝜇_𝑖𝑘=1−𝛼+𝛼𝜇_𝑝𝑘,=𝛼𝜇_𝑝𝑘,𝑖≠𝑝,(12) where 𝜇_𝑝𝑘 refers to data point, 𝑥_𝑘 belongs to the largest cluster 𝑝, and 𝛼 is the suppression factor which ranges in the interval [0,1]. SFCM then updates the value of 𝑣_𝑖 with the new membership function. The pixel clustering iterations are terminated when the termination measurement max_{1≤𝑖≤𝑐}‖𝑣^𝑡𝑖−𝑣^𝑖𝑡−1‖<𝜀 is satisfied, where 𝑣^𝑡𝑖 are the current centroids for 1≤𝑖≤𝑐, 𝑣^𝑖𝑡−1 are the previous centroids for 1≤𝑖≤𝑐, and 𝜀 is a predefined termination threshold. To match the perfect clustering of the given data set, it is necessary to select an optimal suppression factor for SFCM. We define a new exponential function to select the optimal suppression factor, and it is automatically updated at each iteration: 𝛼=exp−min_𝑖≠𝑗‖‖𝑣_𝑖−𝑣_𝑗‖‖²𝑚,(13) where 𝑣_𝑖 is the centroid of the 𝑖th cluster, 𝑣_𝑗 is the centroid of the 𝑗th cluster, and 𝑚 is the degree of fuzzification. As mentioned before, selection of the suppression factor, 𝛼, is very essential for SFCM since higher values of 𝛼 indicate that FCM is superior to HCM whereas lower values represent vice versa. It is evident that good clustering performance exhibits compact clusters by giving more distance between centroids. Likewise, both the fuzzification parameter and the suppression rate 𝛼 influence the learning rate of the algorithms. Thus we intuitively selected min_𝑖≠𝑗‖𝑣_𝑖−𝑣_𝑗‖²/𝑚, illustrating the separation strength between the clusters and the fuzzy factor that signifies the fuzziness of the membership values for the clustered data points.

3. Experimental Results

This section evaluates the performance of the proposed approach. To evaluate the performance of the proposed approach, we set some empirical parameters. Bezdek et al. experimentally determined the optimal intervals for the degree of fuzzification (𝑚) and the termination threshold (𝜀), which ranged from 1.1 to 5 and 0.01 to 0.0001, respectively [17]. In this paper, we selected 𝑚=2 and the termination threshold to be 0.0001.

3.1. Segmentation Results for Gray Matter and White Matter

We evaluate the correctness of the segmentation using real brain scans with ground truth by expert segmentations obtained from the Internet Brain Segmentation Repository (IBSR) [18]. Figures 2(a)-2(b) and Figures 3(a)-3(b) show examples of two slices and the manual labeling provided by the IBSR, whereas the rest of the images illustrates the results of clustering by using FCM [9], MSFCM [11], FCMT [13], SFCM [19], and the proposed approach.

Figure 2 

Comparison of the segmentation results on a simulated brain MR image. (a) original T1-weighted image, (b) manual class labeling of gray matter (GM) and white matter (WM) slice regions; results obtained with (c) FCM, (d) MSFCM, (e) FCMT, (f) SFCM, and (g) the proposed approach.

Figure 3 

Comparison of the segmentation results on a simulated brain MR image. (a) original T1-weighted image, (b) manual class labeling of gray matter (GM) and white matter (WM) slice regions; results obtained with (c) FCM, (d) MSFCM, (e) FCMT, (f) SFCM, and (g) the proposed approach.

As indicated in the figures by a red mark, other FCM-based segmentation approaches miss considerable pixels in the red-marked region. On the other hand, the proposed approach successfully avoids this classification error. In addition to qualitative results, we quantitatively evaluate and calculate the segmentation accuracy of the proposed approach, which is described below.

3.2. Segmentation Accuracy

The performances of the proposed and other FCM-based approaches are compared with respect to the optimal segmentation accuracy [20], which is defined as the sum of the correctly classified pixels divided by the sum of the total number of pixels: SegmentationAccuracy=^𝑐_𝑖=1𝐴_𝑖∩𝐶_𝑖∑^𝑐𝑗=1𝐶_𝑗,(14) where 𝑐 is the number of clusters, 𝐴_𝑖 represents the set of pixels belonging to the 𝑖th cluster by the segmentation algorithm, and 𝐶_𝑖 represents the set of pixels belonging to the 𝑖th cluster in the reference segmented image. To evaluate the robustness of the proposed segmentation approach in noisy environment, we add different types of noise and different amount of noise to a T1-weighted brain MR image, shown in Figure 2(a). All test images are corrupted by 8% and 10% Gaussian noise, speckle noise, and 10% and 12% salt and pepper noise as shown in Figure 4. Figure 4 also shows segmentation results of the proposed and other FCM-based approaches.

(a)

(b)

(c)

(d)

Figure 4 

Segmentation results in noisy environment. (a) 8% Gaussian noise, (b) 10% Gaussian noise, (c) speckle noise, (d) 10% salt and pepper noise, and (e) 12% salt and pepper.

Figure 5 presents the quantitative results of these segmentation approaches for noise-free and noise-inserted brain MR images. The proposed algorithm increases 3.92% (GM) and 3.87% (WM) of the segmentation accuracy for a noise-free brain MR image compared to the baseline performance, where we used the average value of the segmentation accuracy as a baseline. For noise-inserted images, the proposed algorithm achieves 6.79%–14.73% (GM) and 6.42%–17.03% (WM) improvements in the segmentation accuracy, which is significant in the field of image segmentation for diagnosis purpose.

(a)

(b)

Figure 5 

Segmentation accuracy results for gray matter (GM) and white matter (WM) in noisy environment by using FCM, MSFCM, FCMT, SFCM, and the proposed segmentation approach.

4. Conclusions

This paper presented a hybrid medical image segmentation technique. In the preprocessing step, we utilized vector median filtering to reduce the influence of noise. We then produced rough-segmented images using the Otsu thresholding method. To obtain well-segmented images, we finally used the enhanced suppressed FCM algorithm of the proposed approach. To match the perfect clustering of the given data set, we defined a new exponential function to automatically select the suppression factor for the suppressed FCM. To evaluate the robustness of the proposed segmentation approach in noisy environment, we added different types of noise and different amount of noise to the T1-weighted brain MR image and calculated the segmentation accuracy. Experimental results showed that the proposed method outperforms other FCM-based algorithms in terms of segmentation accuracy for both noise-free and noise-inserted images.

Acknowledgments

This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korean government (MEST) (no. 2012-000496, 2012-0001727).