Recent Machine Learning Progress in Image Analysis and UnderstandingView this Special Issue
Research Article | Open Access
R. J. Hemalatha, V. Vijaybaskar, T. R. Thamizhvani, "Performance Evaluation of Contour Based Segmentation Methods for Ultrasound Images", Advances in Multimedia, vol. 2018, Article ID 4976372, 8 pages, 2018. https://doi.org/10.1155/2018/4976372
Performance Evaluation of Contour Based Segmentation Methods for Ultrasound Images
Active contour methods are widely used for medical image segmentation. Using level set algorithms the applications of active contour methods have become flexible and convenient. This paper describes the evaluation of the performance of the active contour models using performance metrics and statistical analysis. We have implemented five different methods for segmenting the synovial region in arthritis affected ultrasound image. A comparative analysis between the methods of segmentation was performed and the best segmentation method was identified using similarity criteria, standard error, and F-test. For further analysis, classification of the segmentation techniques using support vector machine (SVM) classifier is performed to determine the absolute method for synovial region detection. With these results, localized region based active contour named Lankton method is defined to be the best segmentation method.
Musculoskeletal disorder (MSD), an epidemic disease, is now a significant health problem in emerging and most developing countries in the world. MSD remains the most prevalent disease in society due to its impact on mobility, ability to work, and life style. Arthritis is one of the prevalent MSD among all the age groups of people . The most affected portion is the joint region. At relatively early stage of the disease the synovial membrane around the joints used to inflame and leads to degeneration of the joints. The main system to visualize the joint state is through ultra sound diagnosis (USD). The USD is less expensive and available with all the clinicians [2, 3]. The USD images represent different tissue regions with variations of gray shades. These images are further processed to segment the synovial region and to analyze the disease condition and further progression of the disease.
One of the essential tasks in image analysis is image segmentation. Segmentation is to extract objects from the images by dividing the image into set of regions with different properties. Segmentation plays an important role in automatic object recognition or pattern identification process to identify pathologies and medical diagnosis [4, 5]. The most challenging task is to extract the contour and boundaries of the desired region for dynamic analysis of anatomical structures. One of the most robust segmentation methods for medical images is active contour method (ACM).The method implies curve evolution to detect the region of interest in a given image [6–8]. The segmentation process is based on edge and region based approach. The geometric active contour model proposed by Caselles and Malladi et al. is an edge based approach which is based on evolution of curves and geometric flows . Chan and Vese have proposed edge less active contour model which is one of the most well-known region based method. Bernard et al. have proposed a parameterized active contour method. More recently Li et al. and Lankton proposed a method which utilizes local region information for segmentation [9–14].
In this paper we have applied different segmentation methods to arthritis affected finger joint ultrasound images to segment the synovial region. The efficiency of these methods is analyzed using performance analysis metrics and statistical analysis method. For performance analysis metrics we have used Dice coefficient and Hausdorff coefficient and, for statistical analysis method standard error, F-test were used. At the end classification is used to define the absolute active contour method for segmentation of synovial region by training and analyzing the performance metrics and statistical values. The rest of the paper is organized as follows Section 2. The Methods and Materials, Section 3 the results and discussion, and Section 4 the conclusion.
2. Methods and Materials
In medical imaging, the segmentation of regions with specific parameters is carried out with the help of active contour models. Because these models develop a contour around the target object and segregate it from the image, the segmented image possesses only the required information of the target object . The level set segmentation methods like Caselles, Chan–Vese, Bernard, Li, and Lankton are applied on arthritis affected finger joint images obtained from the MEDUSA database http://medusa.aei.polsl.pl.[16–18]. Further using performance analysis metrics like dice coefficient and Hausdroff distance and statistical analysis metrics like standard error and F-test describes the significant difference between the techniques used for segmentation. Classification using SVM defines the best suited method for synovial region segmentation.
MEDUSA is a standardized and authorized database which consists of finger joint images of different grades (grade 0, grade 1, grade 2, and grade 3) of synovitis. Various studies related to arthritis and synovitis are performed using this database.
Caselles is geodesic based active contour methods which largely depend on the level set functions that describe the specific regions in the image for segmentation. Contours are described based on the geometric flow of curve and detection of objects in the image . This type of contour model modifies the curve in the plane by moving the points of the curve perpendicular. The motion of the points is at a speed proportional to the curvature of the region in the image. By adding an area of minimizing region (balloon force), propagation of contour occurs internally by minimization of the interior energy given by I is image intensity, G is Gaussian Filter of unity variance, and C is derived parametric curve to regions with high gradient where set level function is executed as a signed distance function (P= )
Contour models use the energy forces for geometric flow curve description. Geometric contours can be obtained based on regions and edges in the curvature of the image .
Chan–Vese is a region based method which segments an image into two homogeneous regions. The method utilizes energy minimization technique defined by weighted values corresponding to the average value of sum of intensity difference from outside and inside the segmented region [9, 10]. Contours are based on either the variance inside and outside contour or the squared difference between average intensities inside and outside the contours along with the total contour length. This contour model helps to determine different image properties, not only edges, and it also includes regions based on texture and other geometrical features. Energy defines the entire region of interest from the image.
The total energy of the model is given in μ, ν, λ1, λ2: real parameters C1, C2: constants determined for segmentation −1≤ φ(a)≤1: level set function in which φ(a)=0 specifies the interface f: original image H: heavy side function in 1 dimension centered at 0 and δ=H′.
Bernard method utilizes B-spline coefficients as energy minimization function. These utilize parameterized active contour method . Spline coefficients define the contour models for the pixels of interest. The energy based functions inside and outside is described with these coefficients. Contour models describe the entire structures with inflation force that can overpower forces from weak edges, amplifying the issue with localization of initial guess. To speed up the process a linear combination of B-spline basis functions is used and given in
Φ(a) is linear combination of B-spline basis functions.
2.4. Chumming Li
In order to separate the region into two homogenous regions this method utilizes using local neighbourhood statistics for each pixel given in (6). It uses local region information for segmentation . The energy function of the region based active contour model is range of region based domain kernel function. By minimizing the energy function, the region of elements of the target could be determined in images with contours. I(a): pixel intensity at x H: heavy side function : Gaussian Kernel.
Lankton is a region based active contour method which segments non homogeneous objects. This method utilizes localizing region based energy which segments the region based on local information. It is not suitable for unsupervised image segmentation as it requires appropriate curve initialization . These models form contour boundaries with energy forces required for the particular region of interest. The energy inside and outside depends on the local region pixels of the image that describes the required region. The energy equation is illustrated in δ is Dirac function B is Ball of radius r centered at point x
2.6. Performance Evaluation Metrics
The segmentation methods are qualitatively and quantitatively assessed and compared with each other based on three kinds of criteria. Based on this the best suited algorithm is chosen for particular applications.
Visual criteria: The segmented region using the active contour methods is compared with the annotated images by expert radiologist as reference image. The segmented region obtained from level set function methods is compared with reference image.
Computation time: The time taken for each algorithm to segment the region represents the speed of the algorithm. The speed of the respective algorithm is compared.
Similarity criteria: This criterion measures the similarity between the reference and segmented image. The quality of the segmented image is measured by calculating the Dice coefficient, Hausdorff distance, and PSNR
Dice coefficient compares the segmented region with the reference region from the annotated image and provides the dice coefficient values ranging between 0 and 1. If it is 1 the segmented region is more similar and it is different when it is 0 .Hausdroff distance is a metric to measure dissimilarity between two point sets. Distance transform is used to compute the HD in an image. This is used to control the progress of level set based algorithms and to evaluate the quality of the clusters .
2.7. Statistical Analysis
The features like mean, variance, and standard errors are calculated for the segmentation methods. Among the five segmentation methods the best suited method was identified using statistical analysis.
Mean: The mean value is termed as average value which is computed by taking sum of all perceived outcomes divided by overall number of gray levels. The following shows mathematical expression for mean represented as:where n is sample size and x is observed value.
Variance is study of deviation of actual value versus predicted value. The deviation from actual and predicted indicates the performance of the methods used.
Standard error is defined as the measure of prediction’s accuracy. Estimated standard error is related to sum of squared deviations of prediction (that is sum of squares error), described is the standard error of the estimate, Y is an actual range, Y′ is a predicted range, and N is the number of pairs of scores. is the sum of squared differences between the actual scores and the predicted scores.
Classification is a process to describe the effective type or class based on the features derived from the region of interest. Support vector machines (SVM) are machine learning models. SVM is the representation of observations as points that maps to form separate divisions and a clear boundary factor defined as decision boundary. Multiclass support vector machine classifies the types based on the kernel models. Multiclass support vector machine is used to illustrate the appropriate type of active contour technique for the segmentation of the synovial region.
In this method, different types of active contour segmentation techniques are used for the detection of synovial region. The segmentation methods were evaluated using performance metrics and statistical analysis. Ultrasound images from the database are used for the identification of synovial region. Fifty images of different grades are considered for segmentation of the synovial region from the database. Different active contour segmentation techniques are used to segment the synovial regions. Visual changes in the segmentation process are illustrated through the images in Figure 1.
In this figure, the annotated image is defined with green colour and the synovial region defined by the five different types of segmentation is displayed in red colour. The segmented synovial region, when compared to the annotated images, visually defines the fact that Caselles and Lankton possess similarity. To analyze the absolute segmentation technique, further performance metrics description, statistical analysis, and classification are carried out. The performance analysis metrics like dice coefficient, Hausdorff distance, and computation time values of an image is tabulated in Table 1.
Comparison between each performance metric of the five different active contour techniques is graphically represented in Figure 2. These representations illustrate that the Caselles geodesic active contour and Lankton localized region based active contour methods have slightly similar values. From the dice coefficient values it is shown that Caselles and Lankton are more towards 1 that is the highest range. Hausdroff distance also shows the similarity between the two methods. Computation time in seconds defines the fact that the localized region based active contour Lankton is efficient. To further classify which is the best suitable segmentation technique we perform statistical analysis.
In statistical analysis, the features like standard error, average mean, and average variance values are derived from the similarity index parameters (Dice coefficient and Hausdroff distance) for the exact determination of the segmentation technique. In this Table 2 shows the statistical analysis of the similarity index parameters in performance metrics defining the average mean, standard error, and average variance values.
Mean average value defines significant variations among all the types of active contour techniques used for the process of segmentation of the synovial region. But the values possess slight similarity between the two active contour methods. The slight deviation in the synovial segmentation between the two methods is illustrated in Figure 3 which represents the mean values of the similarity index parameters of the five active contour methods.
The standard error measurement describes the accuracy of the predicted value. The difference in standard error between Caselles and Lankton active contours is 0.0021, which is really insignificant. So there is a little more similarity among the geodesic and localized region based active contours.
Average variance is derived to find out the significant difference between the methods. The difference can be defined appropriately using F-test which is performed over the variance value. The F-test results shows that the Caselles geodesic active contour and Lankton localized region based active contour method are likely significant which shows that the region segmented using these methods is not similar. The result of the F-test of the geodesic active contour Caselles and localized region based active contour Lankton is shown in Table 3.
As a result of statistical analysis, Caselles and Lankton have slightly significant difference and prove to possess dissimilarity in the process of segmentation of synovial region. For further determination of the exact segmentation technique, the performance metrics and statistical features obtained from the region undergo classification process. In this process, support vector machine (SVM) classifier is used for training and identification of the significant segmentation technique for synovial region detection. Localized region based active contour Lankton is described as more significant with the help of the results of classification. These results are defined with confusion matrix and scatter plot of the trained features of the synovial region from the ultrasound images. In Figure 4, the confusion matrix is defined with accuracy rates of each category of segmentation. With these results, Lankton is determined as the significant nature of the method in detection of synovial region. Features extracted from the synovial region possess significant variations and localized region based active contour is described with the accuracy of the confusion matrix based on the true positive and false negative rates.
From these results, Localized region based active contour is more efficient method of active contours for synovial region segmentation by training and classifying the features like performance metrics and statistical values. These features define the appropriate classification of the region which is performed with this Lankton active contour.
In recent days arthritis has become a significant health problem. Early diagnosis and treatment help the patients to lead normal life. A method was presented to evaluate the active contour segmentation algorithms to segment the synovial region from arthritis affected finger ultrasound image. Performance analysis metrics like Dice coefficient and Hausdroff distance and statistical analysis metrics like standard error and F-test shows the significant difference between the two segmentation method (Caselles and Lankton) for synovial region. Further classification is performed for the derived features such as performance metrics and statistical values. Higher accuracy is described for Lankton as the result of classification process. Hence the output of the research work shows that Lankton method is the best method for synovial region segmentation from ultrasound images.
The ultrasound images used to support the findings of this study were supplied by Krystian.Radlak under license agreement from MEDUSA Project and so cannot be made freely available. Requests for access to these data should be made to Krystian.Radlak, email@example.com.
The complete research work concentrates on evaluation of contour based segmentation techniques.
Conflicts of Interest
There are no conflicts of interest among the authors with regard to the proposed methodology and performance evaluation for contour based segmentation techniques for ultrasound images using statistical analysis.
- R. Sharma, Ed., Epidemiology of Musculoskeletal Conditions in India, International Journal on Computer Science and Engineering (IJCSE), New Delhi, India, 2012.
- A. Bk, J. Segen, K. Wereszczyski, P. Mielnik, M. Fojcik, and M. Kulbacki, “Detection of linear features including bone and skin areas in ultrasound images of joints,” PeerJ, vol. 2018, no. 3, 2018.
- G. Schett, “Synovitis--an inflammation of joints destroying the bone.,” Swiss Medical Weekly, vol. 142, p. w13692, 2012.
- M. Krishnaveni, “Quantitative evaluation of Segmentation algorithms based on level set method for ISL datasets,” International Journal on Computer Science and Engineering (IJCSE), vol. 3, pp. 2361–2369, 2011.
- D. Barbosa, T. Dietenbeck, J. Schaerer, J. D'Hooge, D. Friboulet, and O. Bernard, “B-spline explicit active surfaces: an efficient framework for real-time 3-D region-based segmentation,” IEEE Transactions on Image Processing, vol. 21, no. 1, pp. 241–251, 2012.
- D. Reska, C. Boldak, and M. Kretowski, “A Texture-Based Energy for Active Contour Image Segmentation,” in Image Processing Communications Challenges, Advances in Intelligent Systems and Computing, R. Choras, Ed., vol. 313, Springer, Cham, 2015.
- M. Airouche, L. Bentabet, and M. Zelmat, “Image Segmentation Using Active Contour Model and Level Set Method Applied to Detect Oil Spills,” in Proceedings of the In Proceedings of the World Congress on Engineering, vol. I, pp. 846–850, London, U.K, 2009.
- R. Goldenberg, R. Kimmel, E. Rivlin, and M. Rudzsky, “Fast geodesic active contours,” IEEE Transactions on Image Processing, vol. 10, no. 10, pp. 1467–1475, 2001.
- T. Chan and L. Vese, “An active contour model without edges,” in Scale-Space Theories in Computer Vision, vol. 1682 of Lecture Notes in Computer Science, pp. 141–151, Springer, Berlin, Germany, 1999.
- P. Getreuer, “Chan-Vese Segmentation,” Image Processing On Line, vol. 2, pp. 214–224, 2012.
- V. Caselles, F. Catté, T. Coll, and F. Dibos, “A geometric model for active contours in image processing,” Numerische Mathematik, vol. 66, no. 1, pp. 1–31, 1993.
- O. Bernard, D. Friboulet, P. Thevenaz, and M. Unser, “Variational B-spline level-set: a linear filtering approach for fast deformable model evolution,” IEEE Transactions on Image Processing, vol. 18, no. 6, pp. 1179–1191, 2009.
- C. Li, C. Y. Kao, J. C. Gore, and Z. Ding, “Minimization of region-scalable fitting energy for image segmentation,” IEEE Transactions on Image Processing, vol. 17, no. 10, pp. 1940–1949, 2008.
- S. Lankton and A. Tannenbaum, “Localizing region-based active contours,” IEEE Transactions on Image Processing, vol. 17, no. 11, pp. 2029–2039, 2008.
- A. Khadidos, V. Sanchez, and C.-T. Li, “Active contours based on weighted gradient vector flow and balloon forces for medical image segmentation,” pp. 902–906.
- MEDUSA, “Automated assessment of joint synovitis activity from medical ultrasound and power Doppler examinations using image processing and machine learning methods,” http://eeagrants.org/project-portal/project/PL12-0015.
- K. Radlak, N. Radlak, and B. Smolka, “Automatic detection of bones based on the confidence map for Rheumatoid Arthritis analysis,” in Proceedings of the 5th Eccomas Thematic Conference on Computational Vision and Medical Image Processing, VipIMAGE 2015, pp. 215–220, Spain, October 2015.
- P. Mielnik, M. Fojcik, J. Segen, and M. Kulbacki, “A Novel Method of Synovitis Stratification in Ultrasound Using Machine Learning Algorithms: Results From Clinical Validation of the MEDUSA Project,” Ultrasound in Medicine & Biology, vol. 44, no. 2, pp. 489–494, 2018.
- T. Dietenbeck, M. Alessandrini, D. Friboulet, and O. Bernard, “Creaseg: A free software for the evaluation of image segmentation algorithms based on level-set,” in Proceedings of the 2010 17th IEEE International Conference on Image Processing, ICIP 2010, pp. 665–668, Hong Kong, September 2010.
- A. A. Taha and A. Hanbury, “An efficient algorithm for calculating the exact hausdorff distance,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 37, no. 11, pp. 2153–2163, 2015.
Copyright © 2018 R. J. Hemalatha et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.