Mathematical Methods in Biomedical ImagingView this Special Issue
Research Article | Open Access
XiangBo Lin, Su Ruan, TianShuang Qiu, DongMei Guo, "Nonrigid Medical Image Registration Based on Mesh Deformation Constraints", Computational and Mathematical Methods in Medicine, vol. 2013, Article ID 373082, 8 pages, 2013. https://doi.org/10.1155/2013/373082
Nonrigid Medical Image Registration Based on Mesh Deformation Constraints
Regularizing the deformation field is an important aspect in nonrigid medical image registration. By covering the template image with a triangular mesh, this paper proposes a new regularization constraint in terms of connections between mesh vertices. The connection relationship is preserved by the spring analogy method. The method is evaluated by registering cerebral magnetic resonance imaging (MRI) image data obtained from different individuals. Experimental results show that the proposed method has good deformation ability and topology-preserving ability, providing a new way to the nonrigid medical image registration.
Deformable registration is an important tool in medical imaging with many applications, such as atlas-based image segmentation and labeling, statistical analysis of normal and pathological variations in anatomy, and the study of the growth and development of normal and abnormal anatomical structures. It has been an active research topic for many years, and plenty of achievements have been published [1, 2]. The basic task of image registration is to find a spatial transformation which maps each point of one image onto its corresponding point of another image. The problem of image registration is often considered as a minimization problem, because it looks for increasing some similarity metric between the two images to be registered by moving points with a reasonable deformation field. Common choices of image similarity metric include sum of squared differences (SSD), normalized/cross-correlation (NCC/CC), normalized/mutual information (NMI/MI), or other divergence-based or information-theoretic measures . However, it is not sufficient to rely only on similarity metric, because the solution does not ensure any spatial correlation between the adjacent points. Such high dimensional transformations involved in nonrigid registration make the problem ill-posed. Therefore, additional regularizing constraints are required to enable a reasonable estimation of the displacement field. In general, given the target image and the template image , the common form of deformable registration problem is The first term in (1) measures the similarity between the deformed template image and the target image. The second term , the regularization constraint, ensures the minimization problem is to be well-posed. The set is the space of admissible transformations. The optimal transformation is obtained by minimizing the overall cost function, where is the space of admissible transformations.
The regularization constraint plays crucial role in nonrigid registration problem. Different constraints have been proposed in the literature. References [4, 5] introduced inverse consistency as regularization constraint, which can be explained that the composition of the optimal forward transformation and the backward transformation between the template image and the target image is the identity. Smooth deformation field is also a commonly used constraint [6, 7] against noise. Reference  used an incompressibility constraint ensured by limiting the Jacobian determinant of a transformation should be unity. Diffeomorphic transformation is studied much in recent years [9–11], that means continuous, differentiable, and reversible transformation. If the transformation is diffeomorphic, the deformed image should be topologically preserved. Miller et al.  proposed the group of diffeomorphic mappings for fluid flow registration. The optimal solution is obtained by regularizing the velocity field to avoid singular solution in numerical implementation. LDDMM  aims at finding smooth diffeomorphic mapping for large deformation by searching the smallest geodesic distance.
Direct topology-preserving constraint is another important regularization for nonlinear image registration. The main intuition behind topology preservation in a deformation field is the desire to maintain connectivity between neighboring morphological structures. One way to ensure the topology unchanged during deformation is to keep the Jacobian determinant of the transformation always positive. The other way is to identify a credible deformation space according to the registration model and then to find the optimal transformation in the credible deformation space. Reference  derived elegant linear constraints that provide necessary and sufficient conditions to ensure that the Jacobian determinant values of such transformations are positive everywhere. Reference  extended the work of  to 3D B-splines deformations. They adopted an interval analysis to find the maximum reasonable step along optimal searching path to ensure positive Jacobian determinant. Reference  considered enforcing topology preservation as a hard constraint at several intermediate steps of a deformable registration procedure or after the registration was done. Reference  used a large-scale constrained optimization method to solve the registration problem. By adding conditions involving the gradient of the Jacobian determinant, this method encouraged the topology preserving to be achieved everywhere.
Over the past years, more and more studies have investigated the nonrigid image registration problem with proper regularization energies. Nevertheless, the existing research is far from being mature. There are still different drawbacks. Some methods need to track the discrete Jacobian determinant or its gradient, which significantly increases computational cost. Some deformable registration models are built in continuous domain. Although topology preservation holds for the continuous transformation, it is no longer guaranteed when the practical solution is obtained on the discrete image grid. Here, we propose a new regularization scheme for nonrigid image registration to hold topology preservation. The details are organized as follows. Section 2 illustrates the entire scheme of the proposed nonrigid registration algorithm. Section 3 provides the experimental results and evaluations of the registration algorithm. The conclusion is drawn in Section 4.
The nonrigid image registration model proposed here focuses on maintaining the unchanged topology of the deformed image. A desirable property of intersubject medical image warping is the preservation of the topology of anatomical structures. From medical perspective, some normal homology tissue or structure for any individual, such as internal brain structures, should have the same topology. A topology-preserving transformation guarantees the unchanged connectivity inside a structure and the relationships between the neighboring structures in the deformed image. There is no tearing, no folding, and no appearance or disappearance of structures. To achieve such performance, we propose to cover the deformable template image with a triangular mesh. The triangular mesh is generated according to the position rather than the value of control points. Then the topological relations are controlled by limiting the mesh deformation. The advantage is that the algorithm will get a better deformation quality even if no explicit Jacobian determinant constraint is used. The entire procedure of NR-MDC is showed in Figure 1. The registration procedure employs iterative style: extraction rough displacement field by measurements of similarity without considering spatial relations between points and optimization the displacement field by measurements of regularization energy. A multiresolution strategy propagating solutions from coarser to finer scales is used here to speed up the convergence of the algorithm and to avoid local optima.
2.1. Similarity Measures
Different features can be used to establish a similarity metric between the deformed template image and the target image to guide the deformed image towards the target image . Here we use SSD as the similarity metric because it is simple and easy to deal with. The SSD forms the basis of the intensity-based image registration algorithms, and the optimal solution can be obtained by classical optimization algorithms . It can be written as where is pixel position, , and is the image domain. Optical flow field theory  is usually adopted to find the displacement field. To better understand the method, we will describe its basic principle roughly. Suppose an object evolving over time, and is the images of this object. Based on intensity conservation assumption, the image function satisfies By differentiating (3) with respect to , Consider image and being two samples of and let the sampling time to be unit time, then where is the object moving velocity. By approximation, the velocity can be expressed as Generally, the displacement of the point is . To avoid unstable solution for small values of , (6) can be renormalized to SSD metric is based on the implicit assumption that the intensities of two corresponding points in images and are equal. However this condition is seldom fulfilled in real-world medical image registration, because there are many factors that may affect observed intensity of a tissue over the imaged field, such as the different scanner or scanning parameters, normal aging, different subjects, and so on. In view of such situation, intensity normalization is necessary. In addition, small motion assumption should be satisfied in optical flow field theory. To reduce the difference between the template image and the target image as much as possible, it is better to do spatial normalization using rigid or affine transformation before using (7) to complete the registration.
The deformation field obtained from similarity measures does not consider any spatial relations among neighboring points. The points’ interdependencies should be guaranteed by certain regularization constraints. Here we focus on topology preservation constraints. It is one basic topology property that the connection relationship between points and edges is unchanged in topology transformation. As is analyzed in , three main behaviors, fold, cross, and tear, will cause topological changes during deformation. To eliminate the unfavorable defects, an extra topology correction procedure was done in  by tracking the Jacobian determinant of the deformation field. Thus computational cost will increase inevitably.
The basic motivation of our work is to establish a topology preservation transformation in discrete domain directly and to avoid calculating the Jacobian determinant from time to time. To do that, we assume to cover the deformable image with a suitable mesh. The central idea of the proposed method is to deform the template image in terms of the similarity metric, while controlling the deformation range according to the intrinsic topologies of the triangular mesh. That means for each pixel in image level there is a corresponding mesh node to control its motion. The crucial problem is to control mesh deformation perfectly.
Research about mesh deformation was done in computational fluid dynamics [21, 22]. The common applications in engineering include deformable aircraft, airfoil pneumatic elastic vibration, bionic flow, and so on. To satisfy the topology preservation transformation requirements, we adopt segment spring analogy dynamic mesh technology , which is initially used to deform a mesh around a pitching airfoil. Its basic idea is to replace each mesh edge by a spring. Thus the vertex motion will be controlled by all the springs connected to this vertex.
Suppose the mesh edge between two adjacent vertices, and , to be a line spring. Initially, the mesh is in static equilibrium state with the spring equilibrium length equals to the edge length. Given an external force along the spring, the spring length will change. According to Hook’s Law, the force at vertex will be where is the spring stiffness between and and is the displacement of vertex . Influenced by all the neighboring vertices, the composition of forces at vertex is where is the vertex set whose element connects to vertex directly. For the mesh to be in equilibrium state again, the force at each vertex should be zero. That is Regrouping (10) yields In an iterative style, (11) can be rewritten as where denotes the iterative number. Then the new position of vertex is The interpretation of the segment spring analogy deformation behavior is showed in Figure 2. The green arrow represents the vertex displacement vector from previous position (red dot) to next position (blue dot).
(a) Before deformation
(b) After deformation
As can be seen from (12), the displacement vector of vertex is calculated as a weighted result of the neighboring vertices’ displacement. The weighting value is determined by the spring stiffness. There are different ways to choose the spring stiffness. For simplicity, the spring stiffness proposed by Batina  is used here, which is inversely proportional to the edge length. Consider, As is analyzed in , this spring stiffness diminishes the probability of vertex collision during the mesh deformation. This means that the factors causing topological changes during deformation (fold, cross, and tear) will also be reduced.
Introducing segment spring analogy into nonrigid medical image registration as a regularization constraint, the expression can be written as where index represents vertex , whose position is .
Therefore the problem is described as
The registration energy function (16) is the sum of two measures. The first term is the sum of scalar, while the second term is the sum of vector. One can minimize this function with respect to simultaneously. However, it is not a trivial work. Fortunately, alternating minimization can be used to approximate the optimal solutions [7, 25]. First, the rough displacement field is found by minimizing the similarity metric term. Then the optimized displacement field is found by minimizing the regularization term. This strategy enables the partial minimizations quite fast. In addition, to avoid falling into local minima and to reduce the computational cost, multiresolution framework is adopted. The image is downsampled into several different scales. The registration starts from the coarsest scale to the finest scale. Accordingly, the resulting deformation transfers from the coarsest scale to the finest scale by upsampling. Here the resampling factor is set to be 2, and the image dimensions of the coarsest scale should not be too small. The primary algorithm implementation procedure is summarized as follows.
Algorithm Implementation(1)Given the template image and the target image , perform preprocess procedure, which includes(i)skull stripping using the BrainSuite software ;(ii)linear spatial normalization using FSL software ;(iii)intensity normalization using histogram match.(2)Decompose the images into different scales. For each position at the coarsest scale, set the initial displacement field , :(a)compute the transient displacement field using (7);(b)get the rough displacement field ; (c)get the regularized displacement field using (12);(d)repeat step (a)–(c) until convergence;(e)transfer to the next finer scale, and repeat step (a)–(d) until the finest scale is processed.(3)If there exists a negative Jacobian determinant value of the final deformation field, do 3–5 iterations using (12) to optimize the displacement field. (4)If the similarity between the deformed template image and the target image does not reach the established criteria, update the template image using the obtained transformation and repeat steps (2)–(3).
The proposed nonrigid registration approach is evaluated on real individual’s MRI images and compared with Diffeomorphic Demons algorithm (DD) . The reference image used in the experiment is the one offered by the Surgical Planning Laboratory of Harvard Medical School . It consists of 256 × 256 × 160 voxels with a spatial resolution of . The test images are real brain MRI images of fifteen normal subjects provided by the Center for Morphometric Analysis at Massachusetts General Hospital and available from Internet Brain Segmentation Repository (IBSR) .
3.1. Evaluation of the Topology Preservation Ability
During the registration, both a criterion based on the cross-correlation (noted as ) and the iteration number constitute the iteration stopping criteria. If the cross-correlation between the deformed reference image and the target image equals or exceeds or the iteration number of reregistration using the deformed image as the new reference image reaches the upper limit (here it is three, while within a scale, the iteration number is set to be ten), the algorithm will stop. is defined as where is the initial cross-correlation between the reference image and the target image. The value of 1.2 is suitable for parameter in the experiment.
Figures 3 and 4 show some typical registration results. Figure 3 gives a visual inspection of the registration result using NR-MDC algorithm. Obviously, the deformed template image with updating scheme (Figure 3(e)) is more similar to the target image (Figure 3(b)) than the other two results (Figures 3(c) and 3(d)). Figure 4 compares the local deformation field before and after regularization, where the red circles (Figure 4(a)) mark out the locations with negative Jacobian determinant. It can be seen that after several iterations, the regularized deformation field becomes realistic.
Table 1 compares the NR-MDC algorithm, Diffeomorphic Demons algorithm and method in . In Table 1, the criterion CC (cross-correlation factor) depicts the similarity degree between the deformed template image and the target image. means the maximum similarity. The criterion depicts the number of points with a negative Jacobian determinant of the deformation field when compared to the total point. S1 represents the registration result without additional regularization. S2 represents the registration result without updating the template image. S3 represents the registration result with regularization and updating steps. Since the vertex motion has high-freedom degree and each vertex is closely related to its surrounding vertices, immediate deformation regularization is inadequate. There still exists a small amount of points with changed topologies. Thus in most cases, additional regularization is necessary. Fortunately, less iteration is required to achieve acceptable deformations. In addition, the need for template image updating and the updating number depend on both the initial difference between the template image and the target image after global linear registration and the expected similarity. Proper updating will improve the similarity. The DD algorithm is carried out in a multiresolution manner. The main parameters are three scales; regularization with a Gaussian convolution kernel, whose standard deviation is set to be one; the maximum template image updating number is three. It can be seen from Table 1 that the average CC value is 0.984 for NR-MDC algorithm using S3 strategy, and the deformation field is topologically preserved. While for the DD algorithm, the average CC value is about 0.97, and there are still a small amount of points with negative Jacobian determinants. Since an additional Jacobian determinant tracking procedure was carried out in the method of , the algorithm running time is relatively long.
3.2. Evaluation of the Brain Internal Structures Segmentation Ability
To further evaluate the reasonability of the obtained deformation field, the brain internal structures segmentation experiment is carried out. The segmented structures are left and right caudate (L-Caudate, R-Caudate), putamen (L-Putamen, R-Putamen), thalamus (L-Thalamus, R-Thalamus), and hippocampus (L-Hippocampus, R-Hippocampus). As is known, these brain subcortical structures have relatively small sizes, complex shapes. Moreover, there is only small spacing between different structures, while their intensities in MRI images are very similar. All these negative factors make the fully automatically accurate segmentation a challenging task.
To validate the results quantitatively, a kappa statistic-based similarity index, Dice coefficient, is adopted in this paper. The similarity index measures the overlap ratio between the segmented structure and the ground truth, which is defined as The definitions of the parameters are as follows: : the number of true positive; : the number of false positive; : the number of false negative;where is the ground truth segmentation of a given structure, is the estimated segmentation of the same structure, and denotes the complement of a set . Perfect spatial correspondence between the two segmentations will result in , whereas no correspondence will result in .
The results are presented in Table 2, where the KI values are the mean values of all the volumes. The results indicate that the proposed NR-MDC algorithm gives better segmentations than the DD algorithm.
Typical 3D views for the segmented structures are presented in Figure 5.
In this paper, a new nonrigid medical image registration method, named NR-MDC, is proposed. A new deformable source, a triangular mesh, is added to cover the template image. This mesh is independent of the image intensities. It reflects the points’ intrinsic spatial relations and is used to regularize the basic deformation field computed from the image intensity information. The proposed cost function is optimized in an alternative minimization way. The deformation field is first computed by optimizing a SSD metric and then is regularized by using spring analogy method. This approach enforces a valid topology of the deformed mesh, which means a valid image deformation. To evaluate the performance of NR-MDC algorithm, intersubject brain MRI image registration experiments are done. And a comparative experiment is also done between the proposed method and the state-of-the-art DD algorithm. The results verify NR-MDC method’s excellent deformation ability, as well as its good topology-preserving ability.
This work was supported by National Science Foundation of China (no. 61101230).
- A. Gholipour, N. Kehtarnavaz, R. Briggs, M. Devous, and K. Gopinath, “Brain functional localization: a survey of image registration techniques,” IEEE Transactions on Medical Imaging, vol. 26, no. 4, pp. 427–451, 2007.
- M. Holden, “A review of geometric transformations for nonrigid body registration,” IEEE Transactions on Medical Imaging, vol. 27, no. 1, pp. 111–128, 2008.
- A. Klein, J. Andersson, B. A. Ardekani et al., “Evaluation of 14 nonlinear deformation algorithms applied to human brain MRI registration,” NeuroImage, vol. 46, no. 3, pp. 786–802, 2009.
- G. E. Christensen and H. J. Johnson, “Consistent image registration,” IEEE Transactions on Medical Imaging, vol. 20, no. 7, pp. 568–582, 2001.
- H. J. Johnson and G. E. Christensen, “Consistent landmark and intensity-based image registration,” IEEE Transactions on Medical Imaging, vol. 21, no. 5, pp. 450–461, 2002.
- D. Rueckert, L. I. Sonoda, C. Hayes, D. L. G. Hill, M. O. Leach, and D. J. Hawkes, “Nonrigid registration using free-form deformations: application to breast MR images,” IEEE Transactions on Medical Imaging, vol. 18, no. 8, pp. 712–721, 1999.
- J. P. Thirion, “Image matching as a diffusion process: an analogy with Maxwell's demons,” Medical Image Analysis, vol. 2, no. 3, pp. 243–260, 1998.
- T. Rohlfing Jr., C. R. Maurer, D. A. Bluemke, and M. A. Jacobs, “Volume-preserving nonrigid registration of MR breast images using free-form deformation with an incompressibility constraint,” IEEE Transactions on Medical Imaging, vol. 22, no. 6, pp. 730–741, 2003.
- P. Dupuis, U. Grenander, and M. I. Miller, “Variational problems on flows of diffeomorphisms for image matching,” Quarterly of Applied Mathematics, vol. 56, no. 3, pp. 587–600, 1998.
- J. Ashburner, “A fast diffeomorphic image registration algorithm,” NeuroImage, vol. 38, no. 1, pp. 95–113, 2007.
- T. Vercauteren, X. Pennec, A. Perchant, and N. Ayache, “Diffeomorphic demons: efficient non-parametric image registration,” NeuroImage, vol. 45, no. 1, pp. S61–72, 2009.
- M. I. Miller, A. Trouvé, and L. Younes, “On the metrics and Euler-Lagrange equations of computational anatomy,” Annual Review of Biomedical Engineering, vol. 4, pp. 375–405, 2002.
- M. F. Beg, M. I. Miller, A. Trouvé, and L. Younes, “Computing large deformation metric mappings via geodesic flows of diffeomorphisms,” International Journal of Computer Vision, vol. 61, no. 2, pp. 139–157, 2005.
- O. Musse, F. Heitz, and J. P. Armspach, “Topology preserving deformable image matching using constrained hierarchical parametric models,” IEEE Transactions on Image Processing, vol. 10, no. 7, pp. 1081–1093, 2001.
- V. Noblet, C. Heinrich, F. Heitz, and J. P. Armspach, “3-D deformable image registration: a topology preservation scheme based on hierarchical deformation models and interval analysis optimization,” IEEE Transactions on Image Processing, vol. 14, no. 5, pp. 553–566, 2005.
- B. Karaçalı and C. Davatzikos, “Estimating topology preserving and smooth displacement fields,” IEEE Transactions on Medical Imaging, vol. 23, pp. 868–880, 2004.
- M. Sdika, “A fast nonrigid image registration with constraints on the Jacobian using large scale constrained optimization,” IEEE transactions on medical imaging, vol. 27, no. 2, pp. 271–281, 2008.
- X. Pennec, P. Cachier, and N. Ayache, “Understanding the “Demon’s algorithm”: 3D non-rigid registration by gradient descent,” in 2nd International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI ’99), pp. 19597–22605, Cambridge, UK, September 1999.
- J. K. Aggarwal and N. Nandhakumar, “On the computation of motion from sequences of images—a review,” Proceedings of the IEEE, vol. 76, no. 8, pp. 917–935, 1988.
- X. Lin, T. Qiu, F. Morain-Nicolier, and S. Ruan, “A topology preserving non-rigid registration algorithm with integration shape knowledge to segment brain subcortical structures from MRI images,” Pattern Recognition, vol. 43, no. 7, pp. 2418–2427, 2010.
- D. R. Mcdaniel and S. A. Morton, “Efficient mesh deformation for computational stability and control analyses on unstructured viscous meshes,” in Proceedings of the 47th AIAA Aerospace Sciences Meeting including the New Horizons Forum and Aerospace Exposition, AIAA Paper 2009-1363, Orlando, Fla, USA, January 2009.
- X. Zhou, S. X. Li, S. L. Sun, J. F. Liu, and B. Chen, “Advances in the research on unstructured mesh deformation,” Advances in Mechanics, vol. 41, pp. 547–561, 2011.
- J. T. Batina, “Unsteady Euler airfoil solutions using unstructured dynamic meshes,” AIAA journal, vol. 28, no. 8, pp. 1381–1388, 1990.
- F. J. Blom, “Considerations on the spring analogy,” International Journal for Numerical Methods in Fluids, vol. 32, pp. 647–668, 2000.
- P. Cachier, E. Bardinet, D. Dormont, X. Pennec, and N. Ayache, “Iconic feature based nonrigid registration: the PASHA algorithm,” Computer Vision and Image Understanding, vol. 89, no. 2-3, pp. 272–298, 2003.
- D. W. Shattuck and R. M. Leahy, “Brainsuite: an automated cortical surface identification tool,” Medical Image Analysis, vol. 6, no. 2, pp. 129–142, 2002.
- S. M. Smith, M. Jenkinson, M. W. Woolrich et al., “Advances in functional and structural MR image analysis and implementation as FSL,” NeuroImage, vol. 23, no. 1, pp. S208–S219, 2004.
- T. Vercauteren, X. Pennec, A. Perchant, and N. Ayache, “Diffeomorphic demons: efficient non-parametric image registration,” NeuroImage, vol. 45, supplement 1, pp. S61–S72, 2009.
- R. Kikinis, M. E. Shenton, D. V. Losifescu et al., “A digital brain atlas for surgical planning, model-driven segmentation, and teaching,” IEEE Transactions on Visualization and Computer Graphics, vol. 2, no. 3, pp. 232–241, 1996.
- “Internet brain segmentation repository,” M. G. H. Technical Report, Center for Morphometric Analysis IBSR, 2000, http://www.cma.mgh.harvard.edu/ibsr/.
Copyright © 2013 XiangBo Lin et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.