Table of Contents Author Guidelines Submit a Manuscript
Computational Intelligence and Neuroscience
Volume 2012, Article ID 135204, 9 pages
Research Article

Composite Match Index with Application of Interior Deformation Field Measurement from Magnetic Resonance Volumetric Images of Human Tissues

1School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China
2College of Mathematics and Computer Science, Wuhan Textile University, Wuhan 430073, China

Received 5 April 2012; Revised 8 June 2012; Accepted 6 July 2012

Academic Editor: Yen-Wei Chen

Copyright © 2012 Penglin Zhang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.


Whereas a variety of different feature-point matching approaches have been reported in computer vision, few feature-point matching approaches employed in images from nonrigid, nonuniform human tissues have been reported. The present work is concerned with interior deformation field measurement of complex human tissues from three-dimensional magnetic resonance (MR) volumetric images. To improve the reliability of matching results, this paper proposes composite match index (CMI) as the foundation of multimethod fusion methods to increase the reliability of these various methods. Thereinto, we discuss the definition, components, and weight determination of CMI. To test the validity of the proposed approach, it is applied to actual MR volumetric images obtained from a volunteer’s calf. The main result is consistent with the actual condition.

1. Introduction

The physical property is the base of the biological simulation, computer-assisted medical applications, such as clinical diagnosis, and surgical simulation, surgical planning. And estimation of internal deformation field or deformation motion for the biological tissues plays a very significant role in physical parameters estimation. Thus, measuring the internal deformation field of biological tissues is becoming the focus research. Magnetic resonance (MR) imaging (MRI) provides superb anatomic images with excellent spatial resolution and contrasts among soft tissues; thus, it is widely used in computer-assisted medical applications, such as clinical diagnosis, surgery simulation, operation planning, and evaluation of physical characteristics of biological tissues. Increasing number of researchers in medical simulation and medical virtual reality focus on the interior deformation field or motion measurement of biological tissues from MR volumetric images, and it has become one of the significant branches of medical image analysis. Generally, approaches for estimating the deformation of MR volumetric images can be classified into two typical types: elastic deformation model-based and feature matching-based methods.

The elastic deformation model-based method can be classified into either parametric or geometric active models [1]. To obtain the deformation information of an object, the parametric active contours, also called snakes, try to minimize a defined cost function so that the function deforms a given initial contour toward the boundary of the object. This method was first introduced by Kass et al. in 1987 [2] and subsequently developed and used by Lang et al. [3], Cho and Benkeser [4], and Matuszewski et al. [5] to estimate deformation motion of nonrigid objects. In the geometric active model [1, 68], the curve and the surface of an object are first detected. Then, the deformation propagation of the curve and the surface is used to track the motion. However, irrespective of what elastic deformation models are employed, disadvantages exist in the deformation estimation; for example, the parametric active model cannot handle changes in the topology of the evolving contours when deformation is performed directly, and often, heuristic topology handling procedures are used [8]. In the geometric active model, when contrast is poor and boundaries are not clear or are continuous in the images, the contours tend to leak through the boundary [9]. The tagged images must have a regular grid pattern in the imaging plane because if the number of tagged points is low, the measurement accuracy would be poor. More important than the former two aspects, regardless of what elastic deformation models are used, they can only handle the deformation at the boundary of nonrigid objects and not the interior deformation.

In recent years, researchers have been increasingly concerned on approaches for matching of nonrigid feature points. Typically, thin-plate spline-robust point matching (RPM) is a famous algorithm for matching non-rigid feature points, which can estimate the joint correspondence and non-rigid transformations between two differently sized point sets. However, optimal processing of the energy function utilized in Chui’s method may be trapped in bad local minima [10]. Zheng proposed the RPM-local neighborhood structure (LNS) method of matching non-rigid feature points, based on the supposition that relative distances and orientations among feature points in a neighborhood would be preserved [11]. Lee improved the LNS and presented the topology preserving relaxation labeling (TPRL) algorithm. In the TPRL method, log distance and polar angle bins are utilized to capture the coarse location information of the feature points in a neighborhood. Using shape contexts, Belongie proposed a non-rigid point matching method. In this method, every feature point is represented by a histogram descriptor of the distance and orientation between this feature point and its neighbor feature points [12]. In addition, some other useful methods were also proposed for feature-point matching, such as the coherent point drift matching method of non-rigid points [13, 14] and the preservation of local geometrical characteristics [15]. In these methods, a novel objective function is defined to preserve local image-to-image affine transformations across correspondence. In general, some unsolved problems are involved in the aforementioned matching methods of non-rigid points; for example, the optimal processing of the energy function could be trapped in bad local minima, the topology of the neighboring feature points is not always preserved well, and so on. Most importantly, in these methods, useful information of the feature point is considered singly and lacks a comprehensive approach, which can mix up with the useful and significant information in the point matching of deformation measurement.

Therefore, to improve further the proposed feature-matching-based approach and improve the robustness of the matching result, this paper proposes a composite match index (CMI). In Section 2, we introduce some previous work, in Section 3, we describe the concept and definition of CMI, and Section 4 introduces the CMI application on feature matching of image pairs from non-rigid objects. In Section 5, examples and preliminary experimental results are given, and discussion and conclusions are presented in the final section.

2. Previous Work

Feature matching plays a significant role in human visual perception, recognition, and computer vision. In medical imaging, most existing feature matching-based research has focused on non-rigid registration and internal deformation field measurement. The general idea of these works is first to extract enough feature points or markers from medical images acquired from non-rigid objects on natural and deformed states, respectively. Next, the feature matching algorithm is applied on extracted feature-point sets to establish robust corresponding pairs. Finally, corresponding pairs are used as control points in non-rigid registration and are used to calculate sparse deformation fields in internal deformation field measurements. Therefore, finding robust corresponding pairs is a vital problem in the present work. We surveyed existing works on feature-point matching in computer vision. Relaxation is a valid technique to disambiguate matches and improve the robustness of matches. Finding a globally optimal or reasonably good suboptimal solution in relaxation is a difficult task, and such matching techniques in non-rigid medical image processing have been rarely addressed. However, a potential advantage is that harder matching problems can be solved using global optimization techniques.

Papademetris et al. [16] presented a method for the integration of feature and intensity information for non-rigid registration. In this case, a distance-based robust point matching framework was proposed to estimate feature-point correspondences. A disadvantage of the algorithm is that it estimates transformation using weighted least squares, which affects the strength of matching.

Zhang et al. [17] introduced a feature matching-based algorithm and considered the problem of 2D deformation field measurement as an example. Matching strengths are measured using correlation and relative distance between two feature points. Relaxation by the optimization algorithm is deductive of the function of matching strength. In later research [18], after slight revision, the algorithm was extended to a 3D situation because the intensity in a magnetic resonance (MR) image is the information of tissue mapped on an image. Thus, the correlation intensity of regions between two points in matching and relaxation can effectively use the properties of tissue.

The work [19] proposed a local geometric preserving algorithm to find corresponding feature pairs from given feature points set in MR volumes acquired from an object on natural and deformed states, respectively. The main contribution of the algorithm to feature matching is that for a non-rigid tissue, when an outside force is applied on it, the deformation magnitude and orientation are different in different regions. However, for a local region on the object, the difference is actually very slight and can sometimes be ignored.

Problems in image feature-point matching remain as great challenges for medical image processing. Thus, the accuracy of feature matching needs to be further improved. Typically, single factors, such as intensity and distance, are effective in matching algorithm for specific areas. However, total accuracy cannot be improved. The integration of multifactors to form a composite approach can make use of the advantages of each factor to improve total accuracy. The present work proposes a composite framework that can pose multicomponents in a single cost function with associated weights to find corresponding feature pairs.

3. CMI

CMI-based feature-point matching approach was proposed to address the fusion of different operator types and to improve the reliability of results from single operators. Here, CMI is a scalar quantity that describes the matching possibility of point pairs. Let 𝐜𝑖=𝑐𝑖,1,𝑐𝑖,2,,𝑐𝑖,𝑘𝑇,𝑤𝐰=1,𝑤2,,𝑤𝑘𝑇(1) be the vector of component value and its corresponding weight, respectively. Then, according to the linear weighting method, CMI is defined as 𝜉𝑖𝑡+1=𝐾𝑘=1𝑤𝑘𝑡+1𝑐𝑖,𝑘(2) subject to 𝐾𝑘=1𝑤𝑘=1,(3) where 𝜉𝑖 represents the CMI of the 𝑖-th pair, 𝑐𝑘 represents the value of the 𝑘th component consisting of the CMI, 𝑤𝑘 represents the weight of the 𝑘th component, and 𝐾 is the number of components in the CMI. Here, component is a factor that can be used to evaluate feature-point pair similarities. Weight 𝑤𝑘 is used to measure the significance of a component for CMI. Various weighting methods have been reported for different research fields. In this case, to consider the independence of each component, the correlation weighted method is used to determine the weight of each component. Let 𝐫=[𝑟1,1,𝑟1,2,,𝑟1,𝑘]𝑇 be the correlation vector consisting of correlation score of the component 0 and 𝑘. Then, the weight of the 𝑡+1 time 𝑤𝑘𝑡+1 is defined by 𝑤𝑘𝑡+1=||𝑟𝑡1,𝑘||𝐾𝑘=1||𝑟𝑡1,𝑘||(4) with 𝑟1,𝑘=𝑁𝑖=1𝑐𝑖,1𝑐1𝑐𝑖,𝑘𝑐𝑘𝑁𝑖=1𝑐𝑖,1𝑐12𝑁𝑖=1𝑐𝑖,𝑘𝑐𝑘2,𝑐𝑘=1𝑁𝑁𝑖=1𝑐𝑖,𝑘,(5) where 𝑐𝑖,𝑘 is the value of the 𝑖-th feature-point pair and 𝑁 is the total number of match pairs in the potential matching set obtained at time 𝑡.

Since feature-point pairs within the potential matching set obtained at time 𝑡 are used as samples to compute the weight 𝑤𝑘𝑡+1 of the 𝑘th component in 𝑡+1 times iteration, the pairs in potential matching set are different at each time. Thus, 𝑤𝑘 values are also different at different times, keeping iterations in the matching process.

CMI is an effective way to fuse multifeature matching algorithm. CMI takes full advantage of all the considered factors to generate a more robust feature matching approach and obtain more accurate matching results. Thus, the feature-point matching algorithm, which decides the strength of matching via a similarity judge function, can theoretically be integrated as a CMI component. In this case, the local geometric persistence (LGP), local intensity similarity (LIS), and local correlation score (LCS) between regions around participants are selected as the components to compute the CMI of a match pair (𝐩𝑢,𝑖,𝐩𝑣,𝑖) and demonstrate the validity of CMI. The following section will discuss how to compute LCS, LGP, and LIS.

For convenient descriptions, several definitions are first clarified as follows(1)Initial feature set 𝐩𝑢, feature-point set extracted from the MR volume acquired from the object at a natural state.(2)Deformed feature set 𝐩𝑣, feature-point set extracted from the MR volume acquired from the object at a deformed state.(3)PMS, a potential feature match set composed of a match pair (𝐩𝑢,𝑖,𝐩𝑣,𝑖) if and only if the best match of 𝐩𝑢,𝑖 is 𝐩𝑣,𝑖 and conversely 𝐩𝑢,𝑖 is also the best match of 𝐩𝑣,𝑖.(4)𝐩𝑢,𝑖 represents the feature point 𝑖 in the initial feature set, and 𝐩𝑣,𝑖 represents the feature point 𝑖 in the deformed feature set.

3.1. LGP

Let 𝐜𝑢 and 𝐜𝑣 be the moment center computed using the initial feature set and its mapping in the deformed feature set, respectively, let 𝐩𝑢,𝑖 be the 𝑖th point in the initial feature set, and let the mapping in the deformed feature set be 𝐩𝑣,𝑖. Based on the consistent deformation in a local region, the distance ratio of a potential match pair in a local region far from their moment center is equivalent and thus yields 𝜇𝑖,𝑗𝜇𝑖,𝑗=𝑑𝐩𝑢,𝑖,𝑗,𝐜𝑢𝑑𝐩𝑣,𝑖,𝑗,𝐜𝑣1𝐽𝐽𝑗=1𝑑𝐩𝑢,𝑖,𝑗,𝐜𝑢𝑑𝐩𝑣,𝑖,𝑗,𝐜𝑣,(6) where 𝜇𝑖,𝑗 is the distance ratio of the 𝑗th potential match pair (𝐩𝑢,𝑖,𝑗,𝐩𝑣,𝑖,𝑗) in the local region around pair (𝐩𝑢,𝑖,𝐩𝑣,𝑖), 𝑑(𝐩𝑢,𝑖,𝑗,𝐜𝑢) is the Euclidian distance between 𝐩𝑢,𝑖,𝑗 and 𝐜𝑢, 𝑑(𝐩𝑣,𝑖,𝑗,𝐜𝑣) is the Euclidian distance between 𝐩𝑣,𝑖,𝑗 and 𝐜𝑣, and 𝐽 is the number of potential match pairs in the local region. Ideally, 𝜇𝑖,𝑗 should be a constant in the local region.

Moreover, 𝐝𝑢,𝑖=[𝑑(𝐩𝑢,𝑖,1,𝐜𝑢),𝑑(𝐩𝑢,𝑖,2,𝐜𝑢),,𝑑(𝐩𝑢,𝑖,𝐽,𝐜𝑢)]𝑇 and 𝐝𝑣,𝑖=[𝑑(𝐩𝑣,𝑖,1,𝐜𝑣),𝑑(𝐩𝑣,𝑖,2,𝐜𝑣),,𝑑(𝐩𝑣,𝑖,𝐽,𝐜𝑣)]𝑇 are the distance sets of the potential pairs within a local region around pair (𝐩𝑢,𝑖,𝐩𝑣,𝑖), respectively. Based on the definition of mathematical expectation, we yield 𝐸𝐝𝑢,𝑖=1𝐽𝐽𝑗=1𝑑𝐩𝑢,𝑖,𝑗,𝐜𝑢,𝐸𝐝𝑣,𝑖=1𝐽𝐽𝑗=1𝑑𝐩𝑣,𝑖,𝑗,𝐜𝑣.(7) Thus, if 𝐩𝑣,𝑖 in the deformed feature set is the best match of a given feature 𝐩𝑢,𝑖 in the initial feature set, then, the geometric deformation of potential match pair (𝐩𝑢,𝑖,𝑗,𝐩𝑣,𝑖,𝑗) within a local region around pair (𝐩𝑢,𝑖,𝐩𝑣,𝑖) is defined as 𝑔𝑖,𝑗=||𝜇𝑖,𝑗𝜂𝑖||(8) subject to 𝜂𝑖=𝐸𝐝𝑢,𝑖𝐸𝐝𝑣,𝑖.(9) In a small local region, all the 𝑔𝑖,𝑗(𝑗=1,2,,𝐽) should be approximately identical and go to zero; the smaller the value of 𝑔𝑖,𝑗, the better the geometric persistence of a potential match pair (𝐩𝑢,𝑖,𝐩𝑣,𝑖). This is called geometric persistence in this case. Thus, the impact factor of the 𝑗-th feature pair for the LGP within a small local region is 𝜆𝑖,𝑗=1.01.0+𝑔𝑖,𝑗.(10) The geometric property within a local region is approximately consistent in the initial and deformed states. If a pair is the best match for each other, then the correlation of potential matches within a local region around the pair must be a strong one. The correlated score 𝑔𝑐(𝐩𝑢,𝑖,𝐩𝑣,𝑖) of the geometric persistence of PMS in a small local region around (𝐩𝑢,𝑖,𝐩𝑣,𝑖) can represent the LGP of feature pair (𝐩𝑢,𝑖,𝐩𝑣,𝑖), specifically: 𝐩𝑔𝑐𝑢,𝑖,𝐩𝑣,𝑖=𝐽𝑗=1𝜆𝑖,𝑗𝑑𝐩𝑢,𝑖,𝑗,𝐜𝑢𝐝𝐸𝑢,𝑖𝐽𝑗=1𝑑𝐩𝑢,𝑖,𝑗,𝐜𝑢𝐝𝐸𝑢,𝑖2×𝑑𝐩𝑣,𝑖,𝑗,𝐜𝑣𝐝𝐸𝑣,𝑖𝐽𝑗=1𝑑𝐩𝑣,𝑖,𝑗,𝐜𝑣𝐝𝐸𝑣,𝑖2,(11) where 𝐽 is the number of potential matches within a local region. In (11), if 𝜆𝑖,𝑗 is large, the pair (𝐩𝑢,𝑖,𝑗,𝐩𝑣,𝑖,𝑗) may be a strong match pair; thus, its weight must also be large. In addition, the value range of 𝑔𝑐(𝐩𝑢,𝑖,𝐩𝑣,𝑖) should be [1,1]. Normalizing 𝑔𝑐(𝐩𝑢,𝑖,𝐩𝑣,𝑖) yields normalized LGP as 𝑁𝑔𝑐𝐩𝑢,𝑖,𝐩𝑣,𝑖=𝐩1+𝑔𝑐𝑢,𝑖,𝐩𝑣,𝑖2.(12)

3.2. LIS

LIS is used to describe the intensity difference between regions around a feature-point pair in the initial and deformed volumes. As mentioned earlier, the tissue within a local region is the same in the initial and deformed states. Thus, based on the MRI principle, the intensity difference is small. The inner product between two regions has the same properties with the invariance of rotation, zoom in, and zoom out. The normalized inner product between regions around (𝐩𝑢,𝑖,𝐩𝑣,𝑖) is adopted to define the similarity of two regions. Thus, 𝐩lis𝑢,𝑖,𝐩𝑣,𝑖=𝑋𝑢,𝑖𝑋𝑣,𝑖𝑋𝑢,𝑖𝑋𝑣,𝑖,(13) where 𝑋𝑢,𝑖 is the region in the initial volume centered at feature 𝐩𝑢,𝑖 and 𝑋𝑣,𝑖 is the mapping region of 𝑋𝑢,𝑖 centered at feature 𝐩𝑣,𝑖.

3.3. LCS

Let 𝐼(𝐩𝑢,𝑖,𝑚) and 𝐼(𝐩𝑣,𝑖,𝑚) be the intensity of the 𝑚-th voxel within the region centered at 𝐩𝑢,𝑖 and 𝐩𝑣,𝑖 in the initial and deformed MR volumes, respectively. Let 𝒪 be the local cubic region with a size of 𝑤××𝑙. The local correlation score between local cubic regions around feature 𝐩𝑢,𝑖 in the initial MR volume and its candidate match feature 𝐩𝑣,𝑖 in the deformed MR volume is defined as 𝐩lcs𝑢,𝑖,𝑚,𝐩𝑣,𝑖,𝑚=𝑀𝑚=1𝐼𝐩𝑢,𝑖,𝑚𝑎𝑢,𝑖𝐼𝐩𝑣,𝑖,𝑚𝑎𝑣,𝑖𝑀𝜎2𝐼𝐩𝑢,𝑖,𝑚𝜎2𝐼𝐩𝑣,𝑖,𝑚,(14) where 𝑀=𝑤××𝑙,𝑎𝑢,𝑖=1𝑀𝑀𝑚=1𝐼𝐩𝑢,𝑖,𝑚,𝑎𝑣,𝑖=1𝑀𝑀𝑚=1𝐼𝐩𝑣,𝑖,𝑚.(15) Here, 𝜎2(𝐼(𝐩𝑢,𝑖,𝑚)) and 𝜎2(𝐼(𝐩𝑣,𝑖,𝑚)) are the standard derivation of the local region 𝒪 around feature 𝐩𝑢,𝑖 and 𝐩𝑣,𝑖, respectively. They are given by 𝜎2𝐼𝐩𝑢,𝑖,𝑚=𝑀𝑚=1𝐼𝐩𝑢,𝑖,𝑚𝑎𝑢,𝑖2𝑀,𝜎2𝐼𝐩𝑣,𝑖,𝑚=𝑀𝑚=1𝐼𝐩𝑣,𝑖,𝑚𝑎𝑣,𝑖2𝑀,(16) where 𝑎𝑢,𝑖 and 𝑎𝑣,𝑖 are the averaged intensity in the neighborhood of feature 𝐩𝑢,𝑖 and 𝐩𝑣,𝑖, respectively.

4. Application in Feature Matching

This section describes the measurement of internal deformation fields using CMI. First, the cost function is given to obtain optimal feature pairs iteratively. Then, the actual feature matching algorithm is described. Finally, the internal deformation fields are measured using optimal feature pairs.

4.1. Cost Function

CMI is an index that measures the strength between a given feature and its candidate matches in feature matching. In theory, for a given reference feature, its potential match must have the strongest CMI among all the candidates. Thus, for an optimal potential matching set, its whole CMI will also be the strongest. Based on this idea, we yield 𝑆𝑡=1𝑁𝑁𝑖=1𝜉𝑡𝑖,(17) where 𝑆 is the cost function in iteration and 𝑁 represents the total number of match pairs in the PMS obtained at time 𝑡.

4.2. Actual Matching Algorithm

The objective of the feature matching algorithm is to obtain an optimal PMS ultimately. The idea of PMS optimization is to maximize the aforementioned cost function 𝑆 iteratively. In each iterative step, the current PMS strength is evaluated by all candidate matches within PMS using the defined cost function 𝑆. The iterative steps will stop until 𝑆 no longer increases or is subjected to stop conditions. Specifically, the inputs are two feature-point sets obtained from MR volumetric images of an object under natural and deformed states, respectively. The output is an optimal PMS. The specific process of the algorithm is summarized as follows.(0)Compute LCS and LIS. For each given pair (𝐩𝑢,𝑖,𝐩𝑣,𝑖) consisting of features in initial and deformed volumes, we use a local region (size of 9×9×3 in this case) centered at features to compute LCS and LIS according to (14) and (13), respectively.(1)Form initial PMS. The LCS is used as the initial CMI of each match pair in the step of initial PMS formation. In other words, LCS is the only criterion of this step.(2) Compute LGP. For each given pair (𝐩𝑢,𝑖,𝐩𝑣,𝑖), we first search for neighbor potential matches within a small window (size of 17×17×3 in this case) centered at 𝐩𝑢,𝑖. The potential matches contained within the window are participants in the LGP computation using the approach in Section 3.1.(3) Compute 𝐰. Compute the weight for each CMI component using potential matches in current PMS as samples. The specific computing method can be seen in (4).(4) Update the CMI of each pair. For each given pair (𝐩𝑢,𝑖,𝐩𝑣,𝑖), its corresponding CMI is updated through the weighting sum of the components LCS, LIS, and LCP, which are computed in (0) and (2).(5) Form PMS and compute the cost function 𝑆. The updated CMI of each pair forms new PMS. The cost function in (17) is then computed using potential matches in the current PMS.(6) Repeat (2) to (5) until 𝑆 no longer increases.(7) Return the current PMS.

Although candidate sets LCS and LIS of each pair are constant, PMS is dynamic because of the varying LGP and 𝐰 of the component at 𝑡+1 times iteration. Thus, the match strength index of CMI is varied. Dynamic cost function will move potential matches into or out of the PMS. The best candidate of a feature-point may also change.

4.3. Measuring Density Deformation Fields

After obtaining the optimal PMS, the internal density deformation fields of non-rigid objects are then obtained. In this study, the method proposed in our previous work [20] is used to obtain the internal density deformation fields. In summary, the internal density deformation fields are interpolated by sparse deformation fields using a finite element model. In detail, the magnitude of the sparse deformation field is first computed by its corresponding pair in PMS using Euclidian distance. The start and end points of a field direction are defined by the points of the corresponding pair. Next, a non-rigid object is reconstructed using tetrahedra, whose nodes are points in the PMS. The density deformation fields can then be interpolated using the finite element method.

Let 𝐏 be an arbitrary volume voxel at 𝐱=(𝑥,𝑦,𝑧) within a tetrahedron 𝐏𝑖𝐏𝑗𝐏𝑘𝐏𝑙 consisting of nodal points 𝐏𝑖, 𝐏𝑗, 𝐏𝑘, and 𝐏𝑙. Its displacement may be approximated by weighting the finite element node displacements 𝐮𝑖,𝑗,𝑘,𝑙(𝐱) using their shape function [20]: 𝐮(𝐱)=𝐮𝑖(𝐱)𝑁𝑖,𝑗,𝑘,𝑙(𝐱)+𝐮𝑗(𝐱)𝑁𝑗,𝑘,𝑙,𝑖(𝐱)+𝐮𝑘(𝐱)𝑁𝑘,𝑙,𝑖,𝑗(𝐱)+𝐮𝑙(𝐱)𝑁𝑙,𝑖,𝑗,𝑘(𝐱),(18) where 𝐮𝑖(𝐱) is the displacement of nodal 𝑖, and the shape function 𝑁𝑖,𝑗,𝑘,𝑙(𝐱) on tetrahedron 𝐏𝑖𝐏𝑗𝐏𝑘𝐏𝑙 is given by 𝑁𝑖,𝑗,𝑘,𝑙(𝐱)=𝐏𝐏𝑗𝐏𝑘𝐏𝑙𝐏𝑖𝐏𝑗𝐏𝑘𝐏𝑙,(19) where 𝐏𝐏𝑗𝐏𝑘𝐏𝑙 and 𝐏𝑖𝐏𝑗𝐏𝑘𝐏𝑙 are the volume of tetrahedron 𝐏𝐏𝑗𝐏𝑘𝐏𝑙 and 𝐏𝑖𝐏𝑗𝐏𝑘𝐏𝑙, respectively.

5. Experiments and Results

Our approach consists of four steps: feature extraction, affine transformation, feature matching, and deformation field measurement. Extracting sufficient features from the initial and deformed volumes is necessary to find enough homologous feature pairs. In this study, high-curvature 3D points were preextracted as features from MR volumetric images. In this case, the two-dimensional Harris operator [21] was extended to a 3D operator by extracting features from the MR volumetric images [22].

Some experiments were designed to demonstrate the performance of the proposed approach. All experiments were performed using our own tool developed with Visual C++, which runs on Microsoft Windows XP. All described experimental results were obtained on a Lenovo Portable PC with a 2.20 GHz Intel(R) Core(TM) 2 Duo CPU T6600 and 4 GB of RAM.

In the experiment, the MR images were acquired from a volunteer’s calf (Figure 1(a)) using an MRI scanner at natural state and deformed states (initial and under forcing), respectively. In both cases, the FOV was 20×20cm, and the slice gap was 2 mm. Some slices (Figures 1(b) and 1(c)) placed at the middle section of the calf were selected to form the MR volumes. As a result, initial and deformed volumes with size of 512×512×57 voxels were generated for the experiment.

Figure 1: Acquired MR volumes. (a) Place of acquired volume; (b) MR slices in volume obtained at natural state; (c) MR slices in volume obtained at deformed state.

First, 500 and 800 features were extracted from the volume acquired on the natural and deformed states, respectively. Next, the proposed CMI-based feature match approach was applied on the two feature-point sets to obtain the optimal PMS. As the result, a PMS with 245 potential match pairs was obtained. The sparse and density deformation fields were computed using the method mentioned in Section 4.3. Figure 2 shows 50000 internal density deformation fields, with large deformation at the bottom of the calf. This result is consistent with the actual situation.

Figure 2: Density deformation fields. Deformation fields generated using PMS obtained using the (a) CMI-based feature match algorithm and the (b) RPFM algorithm).

To prove the validity of the proposed CMI-based feature match algorithm, we compared it with a robust point feature matching (RPFM) algorithm proposed by Chen [23]. In the present study, we applied the RPFM algorithm to the same feature-point sets, which resulted in a PMS with 316 potential match pairs.

We selected 12 landmarks in the slice (𝑧=40) of deformed MR volume to test the accuracy of the measured internal deformation fields, as shown in the middle picture of Figures 3 and 4. Then, the landmarks were subjected to reverse moving using the internal deformation fields measured through the CMI-based algorithm and RPFM algorithm. The results on the MR volume acquired at natural state were projected to check the accuracy of the deformation fields. Figures 3 and 4 show the reverse moving results of the landmarks.

Figure 3: Reverse moving result of the landmarks using deformation fields measured through the CMI-based approach.
Figure 4: The reverse moving result of the landmarks using deformation fields measured through the RPFM approach.

In Figures 3 and 4, the center of each red rectangle in the middle picture (𝑧=40) gives the landmark position. Slices that lie on the left and right sides (the middle layer) give the reverse moving result of the landmarks and the 𝑧 value of different slices, respectively. The outer layer is the zoom in for the reverse moving result of each landmark. In the middle and outer layers, the red rectangles represent the reverse moving position of the landmarks, the green rectangles are actual position of landmarks, and the yellow rectangles represent the reverse moving positions and actual position consistency. From Figures 3 and 4, we note the accuracy of the reverse moving position of landmarks using deformation fields calculated by PMS obtained using CMI-based approach obviously is higher than that of RPFM, that is, the reverse moving position of landmarks 0, 1, 2, 3, and 5. Table 1 shows the quantitative accuracy of the reverse moving results of the landmarks using internal deformation fields obtained by PMS via CMI and RPFM.

Table 1: Comparison of the accuracy in different directions.

As shown in Table 1, regardless of the direction (i.e., 𝑥-, 𝑦-, and 𝑧-directions), the accuracy of the deformation fields measured through PMS obtained using the CMI-based approach is better than that using the RPFM algorithm.

The number of potential matches in optimal PMS obtained using the CMI-based feature matching algorithm is fewer than that of RPFM because the CMI-based approach is combined with the multifeatures in feature matching, whereas RPFM is a single-feature approach. In other words, the match requirements of CMI are stricter compared with those of RPFM. The reliability of optimal PMS obtained using the CMI-based algorithm is higher because it has more accurate deformation fields than the RPFM algorithm. This conclusion is supported by the reverse moving results of the landmarks.

6. Conclusions

In this work, a new method called CMI is presented for the integration of feature-based internal deformation field measurements. In general, feature match algorithms using a single property are highly accurate in specific aspects. However, the overall accuracy is limited because the full advantages of different properties in feature-point matching are not fully used. Fusion multialgorithms offer the use of advantages in algorithms to improve accuracy. Such a fusion is necessary for feature matching in non-rigid objects, where the improvement will be more obvious. In addition, the most advantage of the proposed approach is to provide a feasible option to integrate various feature matching algorithms. Each feature matching algorithm can act as the component of the CMI, and if the appropriate weight can be assigned to the component, then, one can obtain more reliable potential matches. Obviously, the effect of the component weight should also be considered. Thus, (1) investigating an approach to determine the appropriate weights should be the focus of future research; (2) the imaging mechanism of MRI should be further considered in component of the CMI to remove the aberrance of machine to improve the accuracy of feature-point matching as possible.


The authors greatly appreciate the support of Professor Shinichi Hirai from Ritsumeikan University for this work. The authors would also like to thank the reviewers for their helpful comments and suggestions, which have improved the presentation of this paper. This work was supported by the National Key Technologies R&D Program of China for the 12th Five-year Plan (2012BAJ15B04).


  1. Y. Chenoune, E. Deléchelle, E. Petit, T. Goissen, J. Garot, and A. Rahmouni, “Segmentation of cardiac cine-MR images and myocardial deformation assessment using level set methods,” Computerized Medical Imaging and Graphics, vol. 29, no. 8, pp. 607–616, 2005. View at Publisher · View at Google Scholar · View at Scopus
  2. M. Kass, A. Witkin, and D. Terzopoulos, “Snakes: active contour models,” International Journal of Computer Vision, vol. 1, no. 4, pp. 321–331, 1988. View at Publisher · View at Google Scholar · View at Scopus
  3. J. Lang, D. K. Pai, and R. J. Woodham, “Robotic acquisition of deformable models,” in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA '02), vol. 1, pp. 933–938, May 2002. View at Scopus
  4. J. Cho and P. J. Benkeser, “Elastically deformable model-based motion-tracking of left ventricle,” in Proceedings of the 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC '04), vol. 1, pp. 1925–1928, September 2004. View at Scopus
  5. B. J. Matuszewski, J. K. Shen, L. K. Shark, and C. J. Moore, “Estimation of internal body deformations using an elastic registration technique,” in Proceedings of the International Conference on Medical Information Visualisation-BioMedical Visualisation (MediVis '06), pp. 15–20, July 2006. View at Publisher · View at Google Scholar · View at Scopus
  6. C. Vicent, C. Francine, C. Tomeu, and D. Francoise, “A geometric model for active contours in image processing,” Numerische Mathematik, vol. 66, no. 1, pp. 1–31, 1993. View at Publisher · View at Google Scholar · View at Scopus
  7. R. Malladi, J. A. Sethian, and B. C. Vemuri, “Shape modeling with front propagation: a level set approach,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 17, no. 2, pp. 158–175, 1995. View at Publisher · View at Google Scholar · View at Scopus
  8. C. Vicent, “Geometric models for active contours,” in Proceedings of the IEEE International Conference on Image Processing, vol. 3, pp. 9–12, October 1995. View at Scopus
  9. F. Huang and J. Su, “Face contour detection using geometric active contours,” in Proceedings of the 4th World Congress on Intelligent Control and Automation, vol. 3, pp. 2090–2093, Shanghai, China, June 2002. View at Scopus
  10. H. Chui and A. Rangarajan, “New algorithm for non-rigid point matching,” in proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR '00), pp. 44–51, June 2000. View at Scopus
  11. Y. Zheng and D. Doermann, “Robust point matching for nonrigid shapes by preserving local neighborhood structures,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 4, pp. 643–649, 2006. View at Publisher · View at Google Scholar · View at Scopus
  12. S. Belongie, J. Malik, and J. Puzicha, “Shape matching and object recognition using shape contexts,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 4, pp. 509–522, 2002. View at Publisher · View at Google Scholar · View at Scopus
  13. A. Myronenko, X. Song, and M. A. Carreira-Perpinan, “Nonrigid point set registration: coherent point drift,” Advances in Neural Information Processing Systems, vol. 19, pp. 1009–1016, 2007. View at Google Scholar
  14. A. Myronenko and X. Song, “Point set registration: coherent point drifts,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 32, no. 12, pp. 2262–2275, 2010. View at Publisher · View at Google Scholar · View at Scopus
  15. O. Choi and I. S. Kweon, “Robust feature point matching by preserving local geometric consistency,” Computer Vision and Image Understanding, vol. 113, no. 6, pp. 726–742, 2009. View at Publisher · View at Google Scholar · View at Scopus
  16. X. Papademetris, A. P. Jackowski, R. T. Schultz, L. H. Staib, and J. S. Duncan, “Integrated intensity and point-feature nonrigid registration,” in Proceedings of the 7th International Conference of Medical Image Computing and Computer-Assisted Intervention (MICCAI '04), vol. 3216, pp. 763–770, September 2004. View at Scopus
  17. P. Zhang, S. Hirai, and K. Endo, “A feature matching-based approach to deformation fields measurement from MR images of non-rigid object,” International Journal of Innovative Computing, Information and Control, vol. 4, no. 7, pp. 1607–1615, 2008. View at Google Scholar · View at Scopus
  18. P. Zhang, S. Hirai, K. Endo, and S. Morikawa, “Local deformation measurement of biological tissues based on feature tracking of 3D MR volumetric images,” in Proceedings of the IEEE/ICME International Conference on Complex Medical Engineering (CME '07), pp. 707–712, Beijin, China, May 2007. View at Publisher · View at Google Scholar · View at Scopus
  19. P. L. Zhang and S. Hirai, “A local geometric preserving approach for interior deformation fields measurement from MR volumetric images of human tissues,” in Proceeding of the IEEE International Conference on Robotics and Biomimetics, pp. 437–441, 2010.
  20. P. L. Zhang, S. Hirai, and K. Endo, “A method for non-rigid 3D deformation fields measurement: application to human calf MR volumetric images,” in Proceedings of the Workshop at IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 8–13, 2007.
  21. C. Harris and M. J. Stephens, “A combined corner and edge detector,” in Proceedings of the 4th Alvey Vision Conference, pp. 147–151, 1988.
  22. P. L. Zhang, S. Hirai, and K. Endo, “A feature tracking-based approach for local deformation fields measurement of biological tissue from MR volumes,” in Proceedings of the 3rd Joint Workshop on Machine Perception and Robotics, December 2007.
  23. G. Q. Chen, “Robust point feature matching in projective space,” in Proceedings of the Robust Point Feature Matching in Projective Space, pp. 717–722, December 2001. View at Scopus