Abstract

Ship surveillance using space-borne synthetic aperture radar (SAR), taking advantages of high resolution over wide swaths and all-weather working capability, has attracted worldwide attention. Recent activity in this field has concentrated mainly on the study of ship detection, but the classification is largely still open. In this paper, we propose a novel ship classification scheme based on analytic hierarchy process (AHP) in order to achieve better performance. The main idea is to apply AHP on both feature selection and classification decision. On one hand, the AHP based feature selection constructs a selection decision problem based on several feature evaluation measures (e.g., discriminability, stability, and information measure) and provides objective criteria to make comprehensive decisions for their combinations quantitatively. On the other hand, we take the selected feature sets as the input of KNN classifiers and fuse the multiple classification results based on AHP, in which the feature sets’ confidence is taken into account when the AHP based classification decision is made. We analyze the proposed classification scheme and demonstrate its results on a ship dataset that comes from TerraSAR-X SAR images.

1. Introduction

With the rapid development of worldwide cooperation in ocean economics and military affairs, ship surveillance has attracted many countries’ attention. Among various sensors, space-borne synthetic aperture radar (SAR) is considered to be an operational choice for its high resolution over wide swaths and all-weather working capability. Ship surveillance based on space-borne SAR has been widely applied to ocean traffic monitoring, environmental protection, antipiracy operation [1], and so forth. There exist many maritime surveillance systems and projects including ocean monitoring workstation (OMW), IMPAST (improving fisheries monitoring through integrating passive and active satellite based technologies), and DECLIMS (detection and classification of marine traffic form space) [2]. Ship detection in space-borne SAR [3, 4] has been investigated with great progress. Although SAR automatic target recognition (ATR) techniques [58] have been investigated a lot, ship classification still has a long way to go. With the rapid development of space-borne SAR, the research on ship classification using high resolution SAR imagery attracts much attention.

In the recent work on SAR ship classification, how to extract features that describes ship accurately and effectively is emphasized. Knapskog et al. [9] investigated the classification of ships based on 3D model and the contour feature. Margarit and Mallorqui [10] extracted scattering center feature for ship classification. They also applied localized RCS features to ship classification and used ships’ structural information with ENVISAT data [2, 11]. Margarit and Tabasco [12] presented a new ship classification methodology that uses single-pol synthetic aperture radar (SAR) images to categorize targets based on a fuzzy logic decision rule, via radar signature isolation, parametric vector estimation, and decision steps. Premaratne and Safaei [13] extracted superstructure moment invariants feature from ISAR images for ship classification. Pilcher and Khotanzad [14] classified ships by nonlinear joint classifiers based on multiple feature including length, centroid, and peak value features. Touzi et al. [15] described ships based on the permanent symmetric scatters to achieve better classification results. Margarit et al. [16] investigated ship scattering in polarimetric SAR for an improved classification under high clutter conditions and evaluated the potentialities of polarimetric ship scattering for classification methods that provide reasonable performance within cluttered scenes. To utilize the polarimetric interferometric SAR capabilities, they combined Pauli CTD with interferometric-based height retrieval to provide an accurate 3D representation of the ship geometry in terms of a set of persistent polarimetric scatterers [17]. Wu et al. [18] analyzed three types of features from fine quad polarization Radarsat-2 SAR image to characterize the ships and prepare for ship classification. Lakshmi et al. [19] analyzed the polarimetric SAR data for identification and characterization of ships, and the polarimetric signature of interaction of the metallic structure of the ship with water is clearly demarcated for the first time through a particular scattering mechanism representing a dipole scatterer. In the related researches, multifeature is much preferred than single feature and achieves better performance. However, the state-of-the-art feature selection is usually based on the experiences or rough evaluations, and lacks valid comprehensive evaluations.

Feature selection is an essential and fundamental problem for classification. Different feature always leads to various classification performances. To choose an optimal feature subset is significant for classification. There are kinds of feature selection methods (i.e., filter and wrapper). State-of-the-art evaluation criteria for filter methods [2022] include discriminability measure, stability measure, and information measure. Single criteria based feature selection can be easily implemented, but it lacks quantitative and objective evaluation for multifeature combination. Therefore, it is necessary to establish objective and comprehensive evaluation criteria for feature selection.

Analytic hierarchy process (AHP) is a structured technique for organizing and analyzing complex decisions. In this paper, we firstly introduce AHP to feature selection. It accounts for the comprehensive performances of multiple evaluation measures and provides valid and objective criteria to make comprehensive decisions for their combinations quantitatively. Moreover, similar to the feature selection procedure, we also introduce AHP to the classification decision to fuse the results of different feature sets. The contribution of the proposed AHP based ship classification scheme lies on two aspects: (1) a feature selection method is derived based on the AHP; (2) a classification decision rule is proposed based on AHP to fuse the classification results of different selected feature sets. The proposed classification scheme has been tested on a ship dataset that comes from high resolution TerraSAR-X SAR images. Preliminary results illustrate that the feature selection method is effective and the classification scheme achieves a ratio of positive classifications around 87.7%.

This paper is organized as follows. Section 2 provides a brief review of the analytic hierarchy process. Section 3 includes the description of the classification scheme, with special concern on the procedure of feature selection and classification decision based on AHP, respectively. Then, Section 4 validates the method with high resolution TerraSAR-X SAR images, including the detail implementation of AHP for feature selection and classification decision. Finally, the paper is concluded in Section 5.

2. Analytic Hierarchy Process

Analytic hierarchy process (AHP) [2330] is a structured technique for organizing and analyzing complex decisions. Since presented by Saaty in the 1970s, it has been applied in a wide variety of decision situations. The AHP provides a comprehensive and rational framework for structuring a decision problem, for representing and quantifying its elements, for relating those elements to overall goals, and for evaluating alternative solutions. When a hierarchy is built, the decision-makers systematically evaluate various elements by comparing them to one another two at a time, with respect to their impact on an element above them in the hierarchy.

AHP has unique advantages when important elements of the decision are difficult to quantify or compare. It is applicable in the condition that there exists multiple-goal decision on evaluating the schemes based on multiple influencing factors. When AHP is applied, four premises need to be satisfied: the elements on every layer are known and the hierarchy is clear; the elements on the same layer are uncorrelated; the elements on the lowest layer could be quantitated; the relations among different elements on different layers need to be definite. The procedure for the AHP can be summarized as follows.

(i) Build the hierarchy model. Classify the correlative factors into three or more layers: Top layer (the purpose to solve problem); middle layer (the measures and criteria to use, also called strategy layer or criteria layer), whose number could be more than one; bottom layer (the schemes used to resolve problems).

Constitute the pair-wise comparison matrix for the middle layer based on the pair-wise comparison method and 1–9 comparison measure. Priorities among the elements of the hierarchy are achieved by making a series of judgments based on pair-wise comparisons. When comparing the importance of the th factor with the th factor on the middle layer, it is described by the quantitative relative weighting (1~9 and their reciprocals). 1~9 represents different levels for importance; see Table 1. Assume there are factors to be compared for the middle layer; the pair-wise comparison matrix is .

(ii) Calculate the weight vector of and check the consistency of the judgments. Calculate the maximum eigenvalue and corresponding eigenvector of , and then check the consistency. If the check succeeds, the normalized eigenvector is assigned as the weight vector . If not, the comparison matrix needs to be constituted again. In detail, the steps are illustrated below. Firstly, calculate the indexto assess the nonconsistency of pair-wise comparison matrix : And, then, calculate the average random consistency index. It is acquired by building pair-wise comparison matrix randomly to get the average of maximum eigenvalues with large enough random samples. It is validated to be related to matrix rank numberonly (see Table 2).

Thirdly, calculate the random consistency ratio: When, the consistency of matrix is satisfied. Otherwise, needs to be reconstructed.

(iii) Corresponding to each element of the middle layer, a pair-wise comparison matrix for the bottom layer could be derived. So there arepair-wise comparison matrix for the bottom layer. Assume that the number of the elements for the bottom layer is; thepair-wise comparison matrix could be expressed as . And then, check the consistency of them using (1) and (2). If the check succeeds (), the maximum eigenvalue and corresponding eigenvector are derived for each of them. The weight vectors are calculated by normalizing the maximum eigenvalue vectors. So there areweight vectors , and they could be concatenated into a weight-vector matrix .

(iv) Come to a final decision based on the results of this process. There is a need needs to calculate the total scores for every scheme of bottom layer and give the orders of them. The final decision is made based on the order of .

3. Ship Classification Based on AHP

In this section, we present the proposed ship classification scheme, with special concern on the AHP based feature selection and classification decision procedures.

3.1. Classification Scheme

The proposed scheme for ship classification is illustrated in Figure 1. The basic process includes four main parts: feature extraction, feature selection, classifier training and classification decision. The kernel idea of the proposed model is to apply analytic hierarchy process to the feature selection and classification decision. In this paper, the evaluation for feature selection adopts filter measures. Ship classification is mainly based on the single classifier and takes the KNN classifier as an example to illustrate the problem. It is worth noting that the feature extraction and classifier training have been widely investigated [3133] and this paper will not pay additional attention to these processes.

3.2. Feature Selection Based on AHP

Features derived from ship slices are used as the input of classifier for ship classification. Considering the same classifier, different feature set always leads to different classification result. The feature selection is necessary to improve the performance. The hierarchy model for feature selection is presented in Figure 2.

Assume that the evaluation measure vector is. The weightiness of them could be expressed as. The relative weightinesscould be expressed as whereis the mapping from accuracy rate domainto the discrete weighting domain illustrated in Table 1. So the pair-wise comparison matrix is:

After calculation for the maximum eigenvalue of matrix , the check of consistency can be performed through comparison betweenand 0.1. In addition, the maximum eigenvalue vector can also be derived:

It needs to be normalized to a standardization vector with the conditions that

As to one of the evaluation measures, the pair-wise comparison matrix for the scheme layer is

The weight vectors of can be calculated by the normalization of the maximum eigenvalue vectors:

And then constitutes a matrix :

The final decision on feature selection can be made through comparisons of total scores of the features to be chosen:

3.3. Classification Decision Based on AHP

Because the evaluation measures including discriminability, stability, and information are calculated based on certain amount of samples (nonsufficient theoretically), the errors are unavoidable. According to the calculated orders of features, feature selection needs to consider the error tolerance. For example, if the optimal feature set is made up of five features, six or seven features (the former six or seven of the descending order) need to be taken into account, so there are or feature sets that should be considered.

To set the feature sets derived above as the input for KNN classifier, respectively, multiple classification measurement value vectors (not the final labels) could be acquired. And then the final classification decision is made using the AHP based comprehensive processing of these measurement value vectors.

Firstly, construct the hierarchy model. When a ship is classified into three kinds (e.g., cargo ship, oil tanker, and container ship) based on the KNN classifier, feature sets make up the evaluation evidence (criteria layer). The hierarchy model is shown in Figure 3. Unlike the feature selection, the pair-wise comparison matrix for the scheme layer is constructed based on the classification measurement value vectors of a feature set, neither the value of the feature set itself nor the final classification labels (cargo ship, oil tanker, or container ship).

Secondly, the pair-wise comparison matrix can then be constructed based on the comparisons of different feature sets’ contributions. Due to the stochastic errors, the feature sets could be considered with the same importance (the comparison matrix of all ones). Another method to determine the weighting among the feature sets is based on the feature’s priority in the feature set. For example, there are two feature setsand; assume that the feature priorities are ; then the first feature set is judged to be prior to the second. The priorities for multiple feature sets could be transformed into their confidence, so is the confidence ratio between feature sets and. The comparison matrix could be constituted. After calculation for the maximum eigenvalue of matrix , the check of consistency can be performed through comparison betweenand 0.1. In addition, the maximum eigenvalue vector can also be derived:

It also needs to be transformed into a standardization vector . There are three schemes (type I: cargo ship, type II: oil tanker, and type III: container ship) for classification under every feature set, so the corresponding pair-wise comparison matrix , could be produced:

The weight coefficients are calculated by where is the measurement value of the classifier’s output.

Take the KNN classifier [34] as an example; when a ship chipis classified, the discriminant of the th type of ship is whereis the number ofnearest neighbor samples which belongs to the th type of ship. So the measurement value is

After checking it consistency, if succeeded, the weight vectors matrixofcould be calculated. The total scores of the three types are calculated by the products of the weight vector of the middle layer pair-wise comparison matrix and the weight vector of the bottom layer pair-wise comparison matrix. The final decision on classification for a single classifier based on multiple feature sets can be made through comparisons of the total scores:

4. Experiments and Analysis

4.1. Data Set

To validate the proposed methods, the experiments are carried out using TerraSAR-X SAR imagery with VV polarization, azimuth resolution 3.3 meters, and ground range resolution 1.9 meters [35]. Ship chips extracted from the imagery make up the experiment database.

In SAR images, the appearance of ship varies with many factors, such as atmospheric phenomena, image resolution, ship speed, ship orientation, ship size, and the material of the ship. In this paper, the high resolution TerraSAR-X images are captured from the near coastal areas; the sea state is considered as stable. For simplification, the atmospheric effects are neglected. For the cases of nonmetallic or small ship, the ship scattering is not clear and difficult to be identified even by experts. It is a challenging work for the state-of-the-art methods to recognize these kinds of ships. Additionally, the ships with severe smearing and occlusion that result from ship cruising and various orientations are discarded when the data set is constituted. Therefore, we focus on the metallic ships with relative large dimensions and clear appearances on the SAR images.

The number of TerraSAR-X ship chips collected is 286. Ship classification was firstly done by the human operator. There are 56 oil tanker ships, 160 cargo ships, and 70 container ships, respectively. Figure 4 shows two examples of each kind. We choose 60% of each kind of ships as the training set and the left 40% as the test set, whereas the training set includes 96 cargo ship samples, 42 container ship samples, and 34 oil tanker ship samples, and the test set is composed of 64 cargo ship samples, 28 container ship samples, and 22 oil tanker ship samples.

4.2. Feature Selection

In this experiment, 21 features [3133] were extracted from each ship from the database (). They include length, width, length to width ratio, area, perimeter, shape complexity, centroid, moment of inertia, mass, the mean intensity, variance coefficient, weighted-rank fill ratio, standard deviation, fractal dimension, and Hu moment. These features belong to the geometrical structural features and gray intensity statistical features.

In addition, electromagnetic scattering features are also important to ship classification, but they are normally difficult to extract and require much higher image resolution. They increase the information quantity using both the magnitude and phase information of the complex SAR image, relate closely to the ships’ scattering characteristics, and reflect the targets’ essential information. In this paper, in order to illustrate the problem concisely, we only choose the 21 features presented above.

Three evaluation measures including feature discriminability, feature stability, and BIF (best individual feature) are considered in this experiment. Correlation measure is one of the important measures for feature selection to reduce the redundancy. The paper selects three measures just to illustrate the problem, and actually more measures could be adopted including the correlation measure. The definition of the features and the evaluation measures are beyond the scope of this paper, and they can be referenced in the literatures [2022].

Firstly, the comparison matrix for the three evaluation measures could be set according to the experiences. If it is not easy to decide the weighting, it could also be set as all ones (with the same importance). In this paper, it is set by experience. Discriminability (measure I) is considered as the most important one, and stability (measure II) is more important than BIF (measure III). So , and could be set as

And then, the maximum eigenvalue of is , . We look up Table 2 to get the value of , so, and the consistency of is satisfied.

The standardization form of the maximum eigenvector is

Based on the training samples, the three evaluation measures are calculated and the results are illustrated in Figure 5, respectively.

According to the results above, the comparison matrix for discriminability, stability, and BIF could be derived: . And then, the weighting vectors of them are acquired:

The total score for each feature is shown in Figure 6.

Thus the descending order of them is .

It can be concluded that all the geometrical structural features have better performances except feature (width). Geometrical structural features relate closely to the ships’ size, shape, and structure. In the metallic large ship cases (cargo, oil tanker, and container ship), geometrical structural features perform better theoretically. Three typical types of ships differ from each other in terms of size, shape, and structure, and the results indicate that these features have better performance, especially for feature (length to width ratio) which is important for ship classification. Most of the Hu moment features perform better in the experiment. They describe the characteristics of ships’ gray intensity distribution and edge shapes and reflect the ships’ essential attributes. Gray intensity statistical features including weighted-rank fill ratio , standard deviation , and fractal dimension describe the regularity and structure information of the pixels’ gray intensity distribution. They are preferable and also widely used in the ship classification; however, the experimental results illustrate that they perform worse than the geometrical structural features as a whole for ship classification of these three types.

Feature selection could be implemented according to the results above. The features with higher scores or orders should be considered to make up the optimal feature set, but the number is still unknown. To derive it, 20 feature sets are constructed based on the derived order and ship classification based on the test set is carried out to evaluate the accuracy. The first set is , adding one feature based on the order once a time, so the second one isand the third is. The rest may be deduced by analogy. The KNN based classification result is shown in Figure 7.

Figure 7 illustrates that the accuracy curve presents an ascending-stable-descending trend as a whole (red dot line). The accuracy rises firstly (from 61.4% to 85%) and maintains a relatively stable level (around 85%); then it falls below 80% primarily due to the features’ redundancy. From the fifth to the tenth feature set, the accuracy varies slightly and keeps constant approximately, so the fifth feature set could be considered as a turning point (intersection of the red solid line and the curve), and it is set as the optimal feature set here (the number of features is six). In practice, the first seven features are selected to constructfeature sets to enlarge the scope of tolerance error, and then the derived feature sets are According to the feature scores, the feature sets’ priorities are derived:

4.3. Ship Classification Based on Single Classifier

The experiment is carried out based on the test set of ship chips. When a ship chip is input for classification, the feature setsderived above are set as the inputs for KNN classifier (the neighbor parameterin this experiment). In this experiment, , . According to the feature sets’ priorities derived in the feature selection, the pair-wise comparison matrix can be set as The maximum eigenvalue ofis, . From Table 2, the value ofcould be acquired (), and then, so the consistency ofis satisfied. The standardization form of the maximum eigenvector is

Then, ship classification using KNN classifier is based on the seven feature sets. As to each feature set, the comparison matrix for the scheme layer is constructed according to Section 3.3. And then, the comparison matrix for other feature sets could be constituted similarly. The corresponding weighting vectors can be calculated. The total scores for the three kinds (cargo ship, container ship, or oil tanker) can be derived and the final decision (the type of input ship chip) is made.

When the classification decision of one ship chip is made, others are processed one by one based on the same method. Once the classification decisions of all the ship chips are made, the classification accuracy (for each type and the total accuracy) is calculated by the ratio of correct-classified number to the total number. Classification accuracies of the comparisons between the single-feature-set based classifications and the presented AHP-based classification are shown in Table 3. The corresponding diagram of confusion matrix is presented in Figure 8. KNN classification based on the derived feature sets ~could achieve satisfied performance. Inparticular for the AHP based method, the classification accuracy rates of the cargo and container ship come to 89.1% and 89.3% respectively, and the comprehensive performance is superior to other methods with the total accuracy of 87.7%.

In addition, some cases in which the vessel was wrongly classified (take the oil tanker case as an example) are presented in Table 4 and some analysis of the possible causes is also presented. There are three chips whose oil pipe structure could be identified by human operator but not as clear as the ideal ones due to many interferential brighter scattering points around the oil pipe. However, they are all wrongly classified into cargo ships. In these three cases, the third chip is disturbed by strong scattering points badly and none of the chosen feature sets could be classified correctly, so the final decision based on AHP considers 0% possibility for the oil tanker. From the cases for chips No. 1 and No. 2, we can see that onlyandclassify the first one into oil tanker, and , , , andclassify the second one correctly. Referring to the detailed features for each set shown in Section 4.2, the possible reasons for these two cases are analyzed below.

classifies the first and second one wrongly; however,classifies both correctly andclassifies the second one correctly. The features affecting their performances focus on the features (area), (shape complexity), and (Hu moment). Considering their detailed performances,andare more sensitive to the classification of these two chips compared to other features. Actually, the interferential scattering points really affect ships’ shape complexity and the accurate extraction of targets’ area. Meanwhile, we can see that featuremight be more preferable toorfor the oil tanker classification although Section 4.2 shows that the latter two are a little more superior in the overall performance. Concluded from the performance of feature set(compared to), possibly Hu momentis superior to Hu momentin oil tanker classification.

Actually ship features are due to the ship scattering, and the relations among them could be considered as being nonlinear, not totally independent. Essentially, the feature set including several features contributes to the classification as a whole. It is quite difficult to clarify their independent contribution clearly.

When it refers to the second ship chip classification, four of seven feature sets are classified correctly, however, , , , and have their own superiorities (in this experiment they are assigned 1/2, 1/3, 1/5, and 1/6). When the final decision based on AHP is made, the total score of classification into oil tanker is a little less than the score of classification into cargo. Actually, this is only a decision problem, and it just illustrates the possibility of falling within a certain type of ships. When the superiority factors of the feature sets vary proportionally, the results might vary but the conclusions are roughly consistent.

5. Discussion and Conclusion

This paper investigates the application of AHP in the feature selection and classification decision. Ship classification based on AHP could make more accurate decisions. It considers various contributions which is beneficial to the final decision and optimizes the process of decision. The experiment results illustrated that the AHP-based classification achieves higher accuracy.

Similar to the KNN classifier, ship classification based on Bayes classifier, BP-NN classifier, SVM classifier, and the combination of multiple classifiers could also be implemented using AHP. The comparison matrix for the classifiers is amatrix. Because there exit no absolute assessments for the classifiers’ performance, the weighting coefficients need to be determined according to the different conditions. For example, when there are less samples comparatively, SVM has better performance, but the classification accuracy of BP-NN is difficult to be improved, so SVM has higher priority than BP-NN. When it is not easy to decide, the coefficients could be set as all ones (with coequal importance). The following steps are similar to ship classification based on single classifier. The only difference is the evaluation criteria. AHP based feature selection and classification are easy to be affected by the subjective factors, so the classification results may vary according to the different evaluations on the importance of criteria. How to establish objective evaluation criteria to constitute reasonable pair-wise comparison matrix needs to be emphasized in the future.

Essentially, ship classification using space-borne SAR imagery is a quite difficult problem to deal with. This paper primarily researches on the decision problems for feature selection and classification. Ship classification is based on scattering characteristics affected by SAR monitoring, environmental conditions, and ship status, such as sea state, atmospheric phenomena, ship speed, and ship orientation. Emphasizing the illustration the AHP decision method concisely, this paper simplifies these experimental conditions properly. These problems are important for accurate classification and need to be considered in the future research. Ground truth could also be retrieved via transponder polls, that is, automatic identification system (AIS) [36], and provides references for the ship classification. Multisource data fusion (including SAR, optical satellite, infrared, coastal radar, and AIS, etc.) would provide more valid references and benefit ship classification [37]. These effective validation approaches are necessary to aid ship classification based on SAR imagery.

Acknowledgments

This work is supported by the National Natural Science Foundation of China under Grant 61240058 and the Fund of Innovation provided by Graduate School of National University of Defense Technology under Grant S130401. The authors would like to thank the anonymous reviewers for their very competent comments and helpful suggestions.