About this Journal Submit a Manuscript Table of Contents
Journal of Biomedicine and Biotechnology
Volume 2008 (2008), Article ID 346129, 8 pages
Research Article

Validation of Alternating Kernel Mixture Method: Application to Tissue Segmentation of Cortical and Subcortical Structures

Center for Imaging Science, Johns Hopkins University, Baltimore, MD 21218, USA

Received 4 September 2007; Revised 28 February 2008; Accepted 25 June 2008

Academic Editor: Daniel Howard

Copyright © 2008 Nayoung A. Lee et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.


This paper describes the application of the alternating Kernel mixture (AKM) segmentation algorithm to high resolution MRI subvolumes acquired from a 1.5T scanner (hippocampus, and prefrontal cortex, ) and a 3T scanner (hippocampus, and occipital lobe, ). Segmentation of the subvolumes into cerebrospinal fluid, gray matter, and white matter tissue is validated by comparison with manual segmentation. When compared with other segmentation methods that use traditional Bayesian segmentation, AKM yields smaller errors (, exact Wilcoxon signed rank test) demonstrating the robustness and wide applicability of AKM across different structures. By generating multiple mixtures for each tissue compartment, AKM mimics the increased variation of manual segmentation in partial volumes due to the highly folded tissues. AKM's superior performance makes it useful for tissue segmentation of subcortical and cortical structures in large-scale neuroimaging studies.

1. Introduction

Current magnetic resonance image (MRI) studies investigate abnormalities of cortical and subcortical structures in neurodevelopmental and neurodegenerative disorders. These studies require a delineation of a region of interest (ROI) by manual segmentation by an expert rater. For example, studies on Alzheimer’s disease and mild cognitive impairment examine the hippocampus [1] while those in schizophrenia have studied the occipital lobe and prefrontal cortex [2, 3]. Once the ROI is defined, segmentation into tissue types such as gray matter (GM), white matter (WM), or cerebrospinal fluid (CSF) can assess subtle volume changes caused by disease [4, 5]. While manual segmentation would provide gold standard, it is labor intensive limiting the number of subjects in any study [6]. Also, the rater needs to be trained to ensure small inter- or intrarater variation. Therefore, it is necessary to develop a method that allows for efficient processing of large number of subjects with high inter- or intrarater reliability, thereby increasing statistical power. Such a method will facilitate greater understanding of shape change in networks of cortical structures implicated in neuropsychiatric diseases [7, 8].

A variety of methods have been proposed for the segmentation of subcortical tissue such as the hippocampus [911] and cortical tissues such as prefrontal cortex, cingulate cortex, and planum temporale [1216]. However, even though tissue classification methods have been improving in their performance, relatively low accuracy (comparing with expert-rater standards) has prevented accurate structural segmentation, for example, distinguishing the hippocampus from surrounding structures in the medial temporal lobe.

Partial volume voxels containing multiple tissue types present challenges to traditional Bayesian tissue classification methods [1724] that model each tissue type as a fixed-bandwidth, single Gaussian in mixture-of-Gaussian models. Priebe et al. [25] proposed an alternating Kernel mixture (AKM) method which allowed for the flexibility of a Gaussian mixture model, with bandwidth, and the number of Gaussians selected adaptively from the data for each tissue type. The purpose of our study was to compare the performance of AKM and traditional Bayesian methods. The two methods were compared by determining which method was closer to the manual segmentation (ground truth) of cortical and subcortical structures in MRI subvolumes acquired from 1.5T and 3T scanners.

The manuscript is organized as follows. Section 2 describes the AKM mixture modeling methodology in detail and other Bayesian-based segmentation methods. Section 3 describes the dataset being investigated and image analysis employed. Section 4 reports the results.

2. Method

2.1. Alternating Kernel Mixture Method

Priebe and Marchette [26] and James et al. [27] introduced a semiparametric solution to the problem of estimating the common probability density function for multiple identically distributed random variables. Their solution is an iterative one that combines parametric and nonparametric estimates with a resulting model that incorporates both the complexity and the smoothness of the data.

We applied this method to the problem of MR segmentation. Gaussian mixture modeling is a popular segmentation technique. The marginal probability density function for the observations is where is the set of tissue types (CSF, GM, and WM), are the class-conditional marginals, and are class-conditional mixing coefficients. These coefficients are nonnegative and sum to unity. Thus, the image is the sum of the three tissue types. Each class-conditional marginal is a mixture of normals given by where are the strictly positive, class-specific mixing coefficients, which sum to one, and are the Gaussian probabilities with a mean of and a variance of . Combining these equations we see that the marginals are given by

The method estimates the class-conditional mixture complexities the mixing coefficients , and the mixture components . The Expectation-Maximization (EM) algorithm is used to estimate the means and variances of the components [18, 19]. The mixture complexities are estimated from the data.

The method alternates between parametric finite mixture estimates and nonparametric Kernel estimates. Each estimate is based on the previous one of the opposite type. The first step of the algorithm is to find a parametric estimate and a nonparametric estimate of the data. Then, at each iteration, a parametric estimate that minimizes the distance between the two previous estimates is computed. Using the parameter estimates thus derived, a nonparametric estimate is found. This continues until the distance between two consecutive parametric estimates is smaller than a desired constant.

The filtered Kernel estimate (i.e., the nonparametric estimate), with bandwidth , is where is the subject’s MR voxel observation, is the variance of the th component of the mixture, and is the standard normal with zero mean and unit variance. The nonparametric estimates are each based on the parametric estimate from the previous iteration and are given by where is the class of -component Gaussian mixtures, and is the integrated squared error.

To actually classify voxels, the Bayes plug-in classifier is used: where is the voxel to be labeled. The label is assigned to a class based on which one maximizes posterior probability of class membership. This can also be seen as a likelihood ratio test procedure given by Tissues are then classified according to Table 1.

Table 1: Voxel classification based on likelihood ratio test.

This method results in the voxels being classified into three categories. Priebe et al. [25] showed how a training set could be used to determine the number of components for each tissue. However, the focus of this paper is on how this could be done on a case-by-case basis using visual inspection. It was found that two or three components of CSF, GM, and WM produced the best result; in a couple of cases the complexity was better modeled with four components.

2.2. Bayesian Segmentation

For comparison, voxels are classified into three tissue types by Bayesian segmentation: where is the image intensity, is the anatomical label, is the mean, and is the variance of the Gaussian density. The algorithm is where is the prior distribution that represents the relative amount of each of the tissue types and . As with AKM, the EM algorithm is used to estimate the means and variances of the three tissues [18, 19].

2.3. Neyman-Pearson Recalibration

Bayesian segmentation can be extended to two additional classes for and partial volumes which are optimally determined by [28] at each voxel. Here, the four thresholds are determined by the five Gaussians. Thresholds are selected to minimize the misclassification error (Section 3.5) such that and where and . The means then are used to recalibrate the segmentations yielding new thresholds. This is referred to as Neyman-Pearson recalibration.

3. Validation

3.1. Data Acquisition

Four different sets of ROIs were extracted from subjects scanned via the magnetization prepared rapid gradient echo sequence on different scanners. Two came from a 3T scanner (10 hippocampi [29] and 5 pairs of left and right occipital lobes [30]); two came from a 1.5T scanner (10 hippocampi [31] and 9 prefrontal cortices [31]). Processed datasets were reformatted to 8 bit and interpolated to isotropic voxels except for the prefrontal set with a resolution of , and are available at http://www.cis.jhu.edu/data.sets/index.html.

3.2. MRI Subvolumes

To obtain a smaller ROI around a hippocampus, we manually outlined hippocampus and dilated it by cubes with three iterations to generate a mask via BLOX (http://sourceforge.net/projects/blox). Figure 1 shows an example of the mask generated for a left hippocampus. The prefrontal cortex [31] and occipital lobe [30] subvolumes were defined by an expert neuroanatomist.

Figure 1: Hippocampus ROI mask delineated in red.
3.3. Manual Tissue Segmentation

The 39 subvolumes were hand segmented into CSF, GM, and WM tissue compartments by three different raters in independent studies (e.g., [30, 31]) and blind to the autosegmentation. Segmentation was done by visual inspection on contiguous sagittal slices on Analyze software [32] and saved as Analyze image data with labels for CSF, GM, and WM.

3.4. Automated Tissue Segmentation

AKM and Bayesian segmentation were applied to the 39 subvolumes. For comparison, FreeSurfer [33] and BrainVoyager [34] were used to segment the hippocampi and occipital lobes, respectively. Neyman-Pearson segmentation was applied to prefrontal cortex. The EM algorithm [18] ensured that computations were done in real time.

The 10 hippocampus subvolumes from the 1.5T scanner were processed by FreeSurfer [33] to segment and label the volume by its anatomical structure. Each voxel was classified by a given anatomical label (i.e., hippocampus, ventricles). Then we group the structures into WM, GM, and CSF to create WM, GM, and CSF masks. Lateral ventricle and left inferior lateral ventricle were categorized as CSF. Cerebellum-exterior, hippocampus and amygdala were grouped as GM and cerebral white matter, thalamus proper, putamen, ventral diencephalon, and WM hypointensities were grouped as WM.

3.5. Quantification of Segmentation Accuracy

Segmentations were compared via the distance between two distributions as a measure of misclassification error. A cost is assigned to each labeled voxel. If it was labeled correctly, that cost is 0, and if labeled incorrectly, that cost is generally 1. This cost, called the distance, is where is the posteriori probability of hypothesis at voxel for the automated, is the same for the manual segmentation, and is the number of tissue types [18, 19, 28, 35]. The distance measures agreement between segmentations based on distance between probability distributions [36]. The standard overlap measures penalize small objects assuming that most of the error occurs at the boundary of objects thus distance is more appropriate for assessing 3D segmentation [37]. Another standard measure, the Dice measure, was also used [38].

4. Results

Tables 2, 3, 4, and 5 and Figures 2, 3, 4, and 5 show that distances for AKM method are lower than those for Bayesian and other segmentation methods (, Exact Wilcoxon signed rank test). Lower distances mean that AKM segmentation have more overlap with manual segmentation than other methods. Dice measures for AKM were consistently smaller than other methods.

Table 2: Classification error for Bayesian and AKM for hippocampi (3T).
Table 3: Classification error for Bayesian, AKM, and Neyman-Pearson for prefrontal cortices (1.5T).
Table 4: Classification error for Bayesian, BrainVoyager, and AKM for occipital lobes (3T).
Table 5: Classification error for Bayesian, FreeSurfer and AKM for ten hippocampi (1.5T).
Figure 2: Classification error for Bayesian (blue) and AKM (red) for hippocampi (3T).
Figure 3: Classification error for Bayesian (blue), Neyman-Pearson (green), and AKM (red) for prefrontal cortices (1.5T).
Figure 4: Classification error for Bayesian (blue), BrainVoyager (green), and AKM (red) for occipital lobes (3T).
Figure 5: Classification error for Bayesian (blue), FreeSurfer (green), and AKM (red) for ten hippocampi (1.5T).

Figures 6 and 7 explain the reason for low classification errors of AKM. Green, red, and blue curves show the intensity profile of voxels labeled as CSF, GM, and WM, respectively. The figures show how intensity histograms for manual segmentation voxels are similar to those for AKM segmentation. Vertical lines are threshold intensity values calculated from AKM method. Manual segmentation histograms show that each tissue type has wide range of intensities thus resulting in large overlaps between tissue types due to partial volume problems where the boundaries between tissue types are not obvious. Figure 7 shows how the large tails for each tissue types is captured by AKM yielding more accurate threshold values compared with the single Gaussian approach. Further, Table 3 and Figure 3 shows that AKM models the partial volume better than Neyman-Pearson; note that Neyman-Pearson yielded larger errors than Bayesian since the recalibration was based on the averaged thresholds. Finally, Figures 8, 9, and 10 show views of the AKM segmentation of hippocampus, prefrontal cortex, and occipital lobe subvolumes.

Figure 6: Intensity histogram for hippocampus: hand (a) and AKM (b) segmentation with vertical lines from AKM threshold. Green, blue, and red correspond to CSF, GM, and WM segmented voxels, respectively.
Figure 7: Intensity histogram for occipital lobe: hand- (a), AKM (b), and Bayesian segmentation (c) with vertical lines from AKM ((a) and (b)) and Bayesian (c).
Figure 8: Sagittal view of left hippocampus. (a) MRI. (b) AKM segmentation (blue-GM, white-WM, red-CSF).
Figure 9: Axial view of prefrontal cortex. (a) MRI. (b) AKM segmentation (blue-GM, green-WM, red-CSF).
Figure 10: Axial view of left occipital lobe. (a) MRI. (b) AKM segmentation (blue-GM, white-WM, red-CSF).

5. Conclusion

This paper describes an algorithm that models each tissue type in brain MRI subvolumes as a semiparametric mixture of Gaussians. The classification method which uses this algorithm results in better segmentation than a traditional, single-component Bayesian method especially when there is not enough CSF or WM in the subvolume. Human raters are good at segmenting partial volume voxels by adapting to the high variance of intensities in these regions. AKM is also able to adaptively select the bandwidth and the number of Gaussians for each tissue type. Thus, AKM approximated the manual segmentation more closely compared to Bayesian methods. AKM can automatically delineate cortical and subcortical structures which can be distinguished by intensity information. However, there are structures that cannot be segmented by intensity alone. For example, anterior boundary of the hippocampus merges with the amygdala which has similar intensity [39] or the anatomical boundary of prefrontal cortex and occipital lobe has to be defined with spatial information. For these structures, AKM may be useful when combined with mapping and image registration approach. Also, AKM can be applied to other imaging modalities of other anatomical structures, such as segmenting myocardium, blood, and bone in a cardiac CT scan.


This work was supported by National Institute of Health Grant nos. (R01 EB00975-01, P41 RR15241-01A1, P41 RR15241-02S1, P50 MH071616, and P01 AG026276). Assistance from Dr. L. Wang, Dr. Y. Park, Dr. A. Qiu, Dr. S. Yantis, N. Penumetcha, and M. Hosakere is appreciated.


  1. E. Geuze, E. Vermetten, and J. D. Bremner, “MR-based in vivo hippocampal volumetrics: 1. Review of methodologies currently employed,” Molecular Psychiatry, vol. 10, no. 2, pp. 147–159, 2005. View at Publisher · View at Google Scholar
  2. N. C. Andreasen, “Linking mind and brain in the study of mental illnesses: a project for a scientific psychopathology,” Science, vol. 275, no. 5306, pp. 1586–1593, 1997. View at Publisher · View at Google Scholar
  3. T. Onitsuka, R. W. McCarley, N. Kuroki, et al., “Occipital lobe gray matter volume in male patients with chronic schizophrenia: a quantitative MRI study,” Schizophrenia Research, vol. 92, no. 1–3, pp. 197–206, 2007. View at Publisher · View at Google Scholar
  4. R. E. Gur, B. I. Turetsky, P. E. Cowell, et al., “Temporolimbic volume reductions in schizophrenia,” Archives of General Psychiatry, vol. 57, no. 8, pp. 769–775, 2000. View at Publisher · View at Google Scholar
  5. Y. Hirayasu, S. Tanaka, M. E. Shenton, et al., “Prefrontal gray matter volume reduction in first episode schizophrenia,” Cerebral Cortex, vol. 11, no. 4, pp. 374–381, 2001. View at Publisher · View at Google Scholar
  6. R. Kikinis, M. E. Shenton, G. Gerig, et al., “Routine quantitative analysis of brain and cerebrospinal fluid spaces with MR imaging,” Journal of Magnetic Resonance Imaging, vol. 2, no. 6, pp. 619–629, 1992. View at Publisher · View at Google Scholar
  7. J. G. Csernansky, L. Wang, D. Jones, et al., “Hippocampal deformities in schizophrenia characterized by high dimensional brain mapping,” American Journal of Psychiatry, vol. 159, no. 12, pp. 2000–2006, 2002. View at Publisher · View at Google Scholar
  8. L. Wang, D. Y. Lee, E. Bailey, et al., “Validity of large-deformation high dimensional brain mapping of the basal ganglia in adults with Tourette syndrome,” Psychiatry Research, vol. 154, no. 2, pp. 181–190, 2007. View at Publisher · View at Google Scholar
  9. S. Bouix, J. C. Pruessner, D. Louis Collins, and K. Siddiqi, “Hippocampal shape analysis using medial surfaces,” NeuroImage, vol. 25, no. 4, pp. 1077–1089, 2005. View at Publisher · View at Google Scholar
  10. J. W. Haller, A. Banerjee, G. E. Christensen, et al., “Three-dimensional hippocampal MR morphometry with high-dimensional transformation of a neuroanatomic atlas,” Radiology, vol. 202, no. 2, pp. 504–510, 1997.
  11. O. T. Carmichael, H. A. Aizenstein, S. W. Davis, et al., “Atlas-based hippocampus segmentation in Alzheimer's disease and mild cognitive impairment,” NeuroImage, vol. 27, no. 4, pp. 979–990, 2005. View at Publisher · View at Google Scholar
  12. J. T. Ratnanather, K. N. Botteron, T. Nishino, et al., “Validating cortical surface analysis of medial prefrontal cortex,” NeuroImage, vol. 14, no. 5, pp. 1058–1069, 2001. View at Publisher · View at Google Scholar
  13. A. Qiu, M. Vaillant, P. Barta, J. T. Ratnanather, and M. I. Miller, “Surface-based Gaussian random field model with application to cortical thickness variation of left planum temporale in schizophrenia and bipolar disorder,” Human Brain Mapping, vol. 29, no. 8, pp. 923–925, 2008.
  14. A. Qiu, L. Younes, L. Wang, et al., “Combining anatomical manifold information via diffeomorphic metric mappings for studying cortical thinning of the cingulate gyrus in schizophrenia,” NeuroImage, vol. 37, no. 3, pp. 821–833, 2007. View at Publisher · View at Google Scholar
  15. L. Wang, M. Hosakere, J. C. L. Trein, et al., “Abnormalities of cingulate gyrus neuroantomy in schizophrenia,” Schizophrenia Research, vol. 93, no. 1–3, pp. 66–78, 2007. View at Publisher · View at Google Scholar
  16. M. I. Miller, M. Hosakere, A. R. Barker, et al., “Labeled cortical mantle distance maps of the cingulate quantify differences between dementia of the Alzheimer type and healthy aging,” Proceedings of the National Academy of Sciences of the United States of America, vol. 100, no. 25, pp. 15172–15177, 2003. View at Publisher · View at Google Scholar
  17. B. Fischl, A. Liu, and A. M. Dale, “Automated manifold surgery: constructing geometrically accurate and topologically correct models of the human cerebral cortex,” IEEE Transactions on Medical Imaging, vol. 20, no. 1, pp. 70–80, 2001. View at Publisher · View at Google Scholar
  18. M. Joshi, J. Cui, K. Doolittle, et al., “Brain segmentation and the generation of cortical surfaces,” NeuroImage, vol. 9, no. 5, pp. 461–476, 1999. View at Publisher · View at Google Scholar
  19. M. I. Miller, A. B. Massie, J. T. Ratnanather, K. N. Botteron, and J. G. Csernansky, “Bayesian construction of geometrically based cortical thickness metrics,” NeuroImage, vol. 12, no. 6, pp. 676–687, 2000. View at Publisher · View at Google Scholar
  20. W. M. Wells III, W. E. L. Crimson, R. Kikinis, and F. A. Jolesz, “Adaptive segmentation of MRI data,” IEEE Transactions on Medical Imaging, vol. 15, no. 4, pp. 429–442, 1996. View at Publisher · View at Google Scholar
  21. Z. Y. Shan, G. H. Yue, and J. Z. Liu, “Automated histogram-based brain segmentation in T1-weighted three-dimensional magnetic resonance head images,” NeuroImage, vol. 17, no. 3, pp. 1587–1598, 2002. View at Publisher · View at Google Scholar
  22. C. A. Cocosco, A. P. Zijdenbos, and A. C. Evans, “A fully automatic and robust brain MRI tissue classification method,” Medical Image Analysis, vol. 7, no. 4, pp. 513–527, 2003. View at Publisher · View at Google Scholar
  23. T. J. Grabowski, R. J. Frank, N. R. Szumski, C. K. Brown, and H. Damasio, “Validation of partial tissue segmentation of single-channel magnetic resonance images of the brain,” NeuroImage, vol. 12, no. 6, pp. 640–656, 2000. View at Publisher · View at Google Scholar
  24. D. W. Shattuck, S. R. Sandor-Leahy, K. A. Schaper, D. A. Rottenberg, and R. M. Leahy, “Magnetic resonance image tissue classification using a partial volume model,” NeuroImage, vol. 13, no. 5, pp. 856–876, 2001. View at Publisher · View at Google Scholar
  25. C. E. Priebe, M. I. Miller, and J. T. Ratnanather, “Segmenting magnetic resonance images via hierarchical mixture modelling,” Computational Statistics & Data Analysis, vol. 50, no. 2, pp. 551–567, 2006.
  26. C. E. Priebe and D. J. Marchette, “Alternating kernel and mixture density estimates,” Computational Statistics & Data Analysis, vol. 35, no. 1, pp. 43–65, 2000. View at Publisher · View at Google Scholar
  27. L. F. James, C. E. Priebe, and D. J. Marchette, “Consistent estimation of mixture complexity,” The Annals of Statistics, vol. 29, no. 5, pp. 1281–1296, 2001. View at Publisher · View at Google Scholar
  28. J. T. Ratnanather, L. Wang, M. B. Nebel, et al., “Validation of semiautomated methods for quantifying cingulate cortical metrics in schizophrenia,” Psychiatry Research: Neuroimaging, vol. 132, no. 1, pp. 53–68, 2004. View at Publisher · View at Google Scholar
  29. C. B. Kirwan, C. K. Jones, M. I. Miller, and C. E. L. Stark, “High-resolution fMRI investigation of the medial temporal lobe,” Human Brain Mapping, vol. 28, no. 10, pp. 959–966, 2006. View at Publisher · View at Google Scholar
  30. A. Qiu, B. J. Rosenau, A. S. Greenberg, et al., “Estimating linear cortical magnification in human primary visual cortex via dynamic programming,” NeuroImage, vol. 31, no. 1, pp. 125–138, 2006. View at Publisher · View at Google Scholar
  31. J. P. John, L. Wang, A. J. Moffitt, H. K. Singh, M. H. Gado, and J. G. Csernansky, “Inter-rater reliability of manual segmentation of the superior, inferior and middle frontal gyri,” Psychiatry Research, vol. 148, no. 2-3, pp. 151–163, 2006. View at Publisher · View at Google Scholar
  32. R. A. Robb, D. P. Hanson, R. A. Karwoski, A. G. Larson, E. L. Workman, and M. C. Stacy, “Analyze: a comprehensive, operator-interactive software package for multidimensional medical image display and analysis,” Computerized Medical Imaging and Graphics, vol. 13, no. 6, pp. 433–454, 1989. View at Publisher · View at Google Scholar
  33. B. Fischl, D. H. Salat, E. Busa, et al., “Whole brain segmentation: automated labeling of neuroanatomical structures in the human brain,” Neuron, vol. 33, no. 3, pp. 341–355, 2002. View at Publisher · View at Google Scholar
  34. N. Kriegeskorte and R. Goebel, “An efficient algorithm for topologically correct segmentation of the cortical sheet in anatomical MR volumes,” NeuroImage, vol. 14, no. 2, pp. 329–346, 2001. View at Publisher · View at Google Scholar
  35. J. T. Ratnanather, P. E. Barta, N. A. Honeycutt, et al., “Dynamic programming generation of boundaries of local coordinatized submanifolds in the neocortex: application to the planum temporale,” NeuroImage, vol. 20, no. 1, pp. 359–377, 2003. View at Publisher · View at Google Scholar
  36. T. M. Cover and J. A. Thomas, Elements of Information Theory, John Wiley & Sons, New York, NY, USA, 1991.
  37. G. Gerig, M. Jomier, and M. Chakos, “Valmet: a new validation tool for assessing and improving 3D object segmentation,” in Proceedings of the 4th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI '01), vol. 2208 of Lecture Notes in Computer Science, pp. 516–523, Utrecht, The Netherlands, October 2001.
  38. A. P. Zijdenbos, B. M. Dawant, R. A. Margolin, and A. C. Palmer, “Morphometric analysis of white matter lesions in MR images: method and validation,” IEEE Transactions on Medical Imaging, vol. 13, no. 4, pp. 716–724, 1994. View at Publisher · View at Google Scholar
  39. M. A. Munn, J. Alexopoulos, T. Nishino, et al., “Amygdala volume analysis in female twins with major depression,” Biological Psychiatry, vol. 62, no. 5, pp. 415–422, 2007. View at Publisher · View at Google Scholar