Abstract

Point pattern matching is an important topic of computer vision and pattern recognition. In this paper, we propose a point pattern matching algorithm for two planar point sets under Euclidean transform. We view a point set as a complete graph, establish the relation between the point set and the complete graph, and solve the point pattern matching problem by finding congruent complete graphs. Experiments are conducted to show the effectiveness and robustness of the proposed algorithm.

1. Introduction

Point pattern matching problem is an important task of computer vision and pattern recognition. It is to find a good correspondence between two point sets in m-dimensional space. In general, it can be classified into two kinds. One is that the point number of the two point sets is the same. The other is that the point numbers are different. The first case is called complete matching, while the second case is called incomplete matching or partial matching. Point pattern matching has found many applications, such as image registration, motion detection, object tracking, automated visual inspection of flat objects, autonavigation, and pose estimation.

In the past decades, many researchers have devoted themselves to designing high performance point pattern matching algorithms. Griffin and Alexopoulos [1] present a method for the complete matching problem. They calculate the two pattern controids and align them and then construct a bipartite graph. The point matching is finally found by determining the maximal cardinality matching of the bipartite graph. Vinod and Ghose [2] view point pattern matching problem as 0-1 integer programming problem and then use an artificial neural network to solve the point pattern matching problem under translation and rotation transform. To solve the problem of noisy point pattern matching, Morgera and Cheong [3] propose a hybrid and iterative method accommodating patterns from different dimensions. It exploits singular value decomposition to estimate the rotation matrix and steepest-ascent to find the permutation matrix. In [4], Wang and Chen consider the matching problem of point sets with affine transform and use the intrinsic invariant properties of a line segment to design a pattern-matching method. In another work [5], Chang et al. propose a fast algorithm based on 2D cluster approach. It can find the optimal matching between two point sets under the transform of translation, rotation, and scale. In [6], Chui and Rangarajan propose a robust point matching algorithm based on the softassign and the thin-plate spline. This algorithm can jointly estimate the correspondence and nonrigid transformations between two point sets with different sizes. In [7], Carcassoni and Hancock exploit three ways to improve the recovery of point correspondences using spectral analysis of the point proximity matrix. These ways include an alternative proximity weighting matrix, robust methods for comparing the eigenvectors of the proximity matrix and embedding the correspondence process within the EM algorithm. To solve the incomplete matching problem under affine transform, Zhang et al. [8] design a method combining a genetic algorithm with partial Hausdorff distance.

In [9], Van Wamelen et al. propose a fast algorithm for 2D point matching using probabilistic and sorted nearest neighbors. Its time complexity is O(n(log m)3/2), where and are the point numbers of the point sets. Li et al. [10] introduce a new similarity K-d tree method to establish a one-to-one match and then apply it to matching nonaffinely-related point sets. To target the optimal transform between point sets, Yin [11] exploits the technique of particle swarm optimization, where the transform parameters are encoded as a real-valued vector called particle. Bishnu et al. [12] present simple and deterministic algorithm for point pattern matching under translation and rotation in 2D. It runs O(n 2log n) time for complete matching and O(mn4/3 log n) time for incomplete matching. In [13], Caetano et al. give a graphical models-based algorithm to achieve point pattern matching in Euclidean spaces of any dimension. This algorithm runs in a polynomial time and is provably optimal for complete matching between noiseless point sets. Later, McAuley et al. [14] present a new graph showing better performance than that of [13] and use it to determine point set matching. Li et al. [15] propose a dynamic segment-based hierarchical point matching algorithm for self-initialising articulated motion reconstruction from sparse feature points. Recently, Bhowmick et al. [16] propose a novel data structure called “angular tree” for supporting point pattern matching algorithms. Aiger and Kedem [17] introduce an efficient algorithm for matching point sets under the transform of translation, rotation, and scale by using the Hausdorff metric as a distance function. In another study [18], Aiger and Kedem propose a matching algorithm based on a simple alignment scheme. It runs roughly in O(n log n+ km log n) time, where and are the point number of two point sets and is the number of matched subsets between the two sets.

Most of the above algorithms are designed to solve the matching problem under affine transform or the transform of translation and rotation. These works are not suitable for the point sets under reflection transform. To overcome this problem, we propose an efficient algorithm based on the fact that the Euclidean distance between any two points is invariant. This algorithm is not only suitable for point sets under reflection transform, but also effective for those under translation and rotation transform. The rest of the paper is organized as follows. Section 2 introduces congruent complete graph-based algorithm. Section 3 presents the proposed algorithm. Experimental results are given in Section 4 and conclusions are made in Section 5.

2. Congruent Complete Graph-Based Algorithm

2.1. Congruent Complete Graphs

A point set can be represented by a complete graph as follows. A vertex denotes a point and the weight of an edge connecting two vertices represents the Euclidean distance between the corresponding two points. For a given point set, if the point number is n, the edge number of its corresponding complete graph is n(n−1)/2. Clearly, if and are two matched point sets under reflection transform, or transform of translation and rotation, the corresponding edges of their complete graphs are equal, and vice versa. In general, translation and rotation transform and reflection transform are collectively called Euclidean transform.

Definition 2.1. If all corresponding edges of two complete graphs are equal, they are congruent graphs.
Let G(V) and G() be the complete graphs of and , respectively, and represent that G(V) and are congruent graphs. Thus, there is a property of congruent graphs.

Property 1. If , the point sets and are the matching sets under Euclidean transform.
If two point sets are the matching sets under Euclidean transform, corresponding edges of congruent graphs formed by these point sets are equal, and vice versa. As shown in Figure 1, since and are the matching sets under reflection transform. Similarly, and are the matching sets under translation and rotation transform since .
Let V = {} and be two planar point sets. If we use the Euclidean distance between any two points to represent the corresponding edge weight of graph, the complete graph of each point set has edges. Clearly, we can find congruent complete graphs by calculating all edges and establishing their corresponding relations. However, such computational cost is large. To reduce computation, we can calculate matched edges based on the following theorem.

Theorem 2.2. Let and be two pairs of matched points between and . Thus, we have if they satisfy the following conditions.(1)= and .(2) If are on one side of the straight line , their corresponding points are also on the corresponding side of the straight line .(3) If , and are collinear, their corresponding points , and are also collinear.

Proof. As shown in Figure 2(a), suppose that , , and are not collinear, and for a given vertex , there are also no three collinear vertices among , , , . According to the condition (2), assume that and are on one side of the straight line . Thus, and are on the corresponding side of straight line . Using the condition (1), it is deduced that , and . Therefore, by Definition 2.1. Similarly, . The Property 1 shows that . Thus, because and . Since   and    (Condition 1), by Definition 2.1. Thus, . This means that the distance between and other vertex is equal to that between and the corresponding vertex. The case that are on different side of straight line vavb can be proven by using the similar steps.

Consider the case that vertices are collinear. If , and are collinear, , and are also collinear (Condition 3). If and are on the straight lines and respectively, it is clearly that . If they are not on the straight lines as shown in Figure 2(b), is also available.

From the above analysis, it can be found that can be derived if the vertices and satisfy the above-mentioned conditions. So .

Obviously, the pattern matching between two point sets and under Euclidean transform can be achieved by calculating their congruent complete graphs. The detailed algorithm is as follows.(1) For each vertex , calculate the Euclidean distance between and and sort these distances to make an ascending sequence. (2) For each vertex , calculate the Euclidean distance between and and sort these distances to make an ascending sequence. (3) Compute the congruent complete graphs between G(P) and G(Q) by Theorem 2.2 and determine whether or not and are matched.

2.2. Parameters of Congruent Complete Graphs

If two point sets are matched, one can be viewed as the transformed result of the other, where the transform may be translation and rotation transform or reflection transform. Note that Euclidean distance between two points is invariant under these transforms. Parameters of the above transforms are discussed as follows. (1) Translation and rotation transform denoted as : let (x,y) be the coordinates of a point and the coordinates of its transformed version. If they satisfy the following equation: the transform is called translation and rotation transform, where is the rotation angle and are the translations along -axis and -axis, respectively. The , , and are the parameters of translation and rotation transform. (2) Reflection transform denoted as : if is the perpendicular bisector of the line segment connecting (x,y) and , the two points are a pair of matched points under the , where is the symmetry axis and the parameter of the reflection transform. Parameter calculations are as follows.

For translation and rotation transform, let (, ) and (, ) be two pairs of matched points under translation and rotation transform, that is, , where the coordinates of and are (,) and (), respectively. Substitute the coordinates of each pair of points into (2.1) and then obtain the following equation: where is the included angle between and . From (2.2), it is found that the transform parameters , , and can be uniquely determined by two pairs of matched points.

For reflection transform, suppose that is the transformed result of under the transform , as shown in Figure 3. If and are not the same point, the perpendicular bisector of the line segment connecting and is the symmetry axis of the reflection transform.

From the above analysis, it is clearly that the parameters , , and can uniquely determine a translation and rotation transform, and the symmetry axis can determine a reflection transform. If is the transformed result of under the Euclidean transform, V and are a pair of matched point sets.

3. Proposed Algorithm

3.1. Calculation of Congruent Complete Graphs

Let and be two matched point sets in a 2D plane. To find the congruent complete graphs containing vertices and , we calculate the distances and , and make these distances in ascending order, where the sorted result of is and that of is . Thus, congruent complete graphs can be calculated by the following steps.(1)Let and . If , record the matched points forming the matched sets and let . If , let . If , let . Repeat the computation until or .(2)Select a pair of matched points and from the above matched sets, whose distances to and are equal. Calculate the distances from and to other corresponding matched points, respectively, and compute the congruent complete graphs by the Theorem 2.2. If the congruent complete graphs are available, we extract other congruent complete graphs from the rest points. Otherwise, we select another matched pair to calculate congruent complete graphs until all matched pairs are used.

3.2. Matching Algorithm Based on Complete Graphs

For incomplete matching problem, if we calculate complete graphs of all points to identify congruent graphs, the computational cost is large. In here, nearest neighbor algorithm is exploited to improve efficiency. Let and be two matched point sets, and the matched probability in is , that is, points of have matched points in . Thus, the matched probability in can be calculated by

Note that the minimum point number of congruent complete graphs is 3. Suppose that the selected neighbor point numbers in and are and . For each point of and Q, we apply the method [19] to find its nearest neighbor points. A small number of neighbor points is helpful to improve computational speed. However, average matched point number for each point could not be smaller than 3. In the words, the or value must satisfy or . Thus, we have where means upward rounding. So we have

Detailed steps of the proposed matching algorithm are as follows.

Step 1. For each point of Q, extract neighbor points by the method [19], calculate the distances to the neighbor points, and sort these distances.

Step 2. Randomly select a point from and find its neighbor points by the method [19] again. Next, calculate its distances to the neighbor points, and sort these distances. Apply the Theorem 2.2 to determine matched graphs between the complete graph forming by these points of and the other complete graph of each point of . During the determination, we record the transform parameters and the transform type, that is, translation and rotation transform or reflection transform.

Step 3. Repeat Step 2 and merge the congruent complete graphs with the same transform parameters and the same transform type. If the point number of the congruent complete graphs is bigger than a predefined threshold T, we recalculate the transform parameters. If the calculated results are equal to the prior values, the corresponding points forming the congruent complete graphs are the matched points. The algorithm is done. Otherwise, turn to Step 2.

4. Experimental Results

To validate the proposed algorithm, many experiments are conducted and all results show the effectiveness of our algorithm. In here, typical examples including the synthesized point sets and the real point sets from fingerprints are presented. For the synthesized examples, point sets under the two kinds of Euclidean transform are both considered, where the matched probability in is 0.8, that is, . As the points may be perturbed by noises in a real-world situation, we define a threshold . If the difference between two distances is smaller than the threshold, their corresponding edges are considered as a matched pair.

4.1. Reflection Transform

The point sets are produced as follows. Firstly, 40 random points with integer coordinates are generated in a square sized 256 × 256 to form the point set . A reflection transform with symmetric axis and a translation transform with and are then applied to the 40 points. So 40 points of are then obtained. To test the robustness of our algorithm, 10 random points in the 256 × 256 square are generated and then added into . Another reflection is applied to the 10 points to generate their transformed versions, which are then added to . Moreover, another 10 points, which do not belong to , are added to . During the point generations, the distance between each two points is not smaller than 10. Furthermore, the coordinates of points in and are both perturbed by Gaussian noises with 0 mean and 1 variance, and the quantization errors caused by the noises are controlled within . Coordinates of the points in and are presented in Tables 1 and 2, where the serial numbers of points are randomly arranged. As expected, the propose algorithm correctly finds 40 matched pairs of points. The matched results are listed in Table 3.

4.2. Translation and Rotation Transform

The point set used in Subsection 4.1 is also adopted here. We apply the translation and rotation transform with , and (radian) to the first 40 points of and then obtain 40 points of . Next, we apply another transform of translation and rotation to the last 10 points of and add the transformed points to . Moreover, another 10 points are added to . During generation, the distance between each two points is also not smaller than 10. Similarly, Gaussian noises with 0 mean and 1 variance is also exploited to perturb the points of . Table 4 are the coordinates of those points of . Our algorithm correctly determines 40 matched pairs of points, as shown in Table 5.

4.3. Fingerprint Matching

To view the performance in a real-world situation, the proposed algorithm is applied to fingerprint recognition. Figure 4 presents two fingerprint images taken from the same finger of a person. The circled feature points are manually selected and their coordinates are also manually extracted by using the software origin. In this experiment, the circled features represent those points for pattern matching and the total number of used features in each fingerprint image is 42. Our algorithm finds 35 matched pairs of features, indicating the practicability of the proposed algorithm. The results are as shown in Figure 5, where the “×” marks represent the feature points in Figure 4(a), the “+” marks represent the feature points in Figure 4(b), and the circle marks mean the matched pairs.

5. Conclusions

A novel point pattern matching algorithm is proposed in this paper, which views point pattern matching problem as complete graph matching. For each point, the proposed algorithm constructs its complete graph by using its neighbor points. Point pattern matching is then solved by finding congruent complete graphs between the point sets. The proposed algorithm is suitable for the point sets under Euclidean transform. Many experiments are done, and the results show that our algorithm is robust and effective. As finding a matched pair of points in advance is not needed, the proposed algorithm is not influenced by calculation errors causing in point pair determination, and, therefore, achieves robustness. Complete graphs are formed by those points in neighbor. It effectively reduces computational cost and improves speed.

Acknowledgments

This work was partially supported by the Natural Science Foundation of China (60963008), the Guangxi Natural Science Foundation (2011GXNSFD018026, 0832104), the Project of the Education Administration of Guangxi (200911MS55), the Scientific Research and Technological Development Program of Guangxi (10123005–8), and the Scientific and Technological Research Projects of Chongqing’s Education Commission (KJ081309). The authors would like to thank Dr. Zhenjun Tang for English correction and the anonymous referees for their valuable comments and suggestions.