Abstract
This paper deals with the problem of nonlinear uncertainties when tracking an infrared dim small target with fast maneuvers. The particle filter (PF)-based methods are mostly considered. The existing improvement methods for the PF can handle the infrared dim small target with the conventional maneuver, the motion state of which changes slowly and in most cases is assumed to be linear. However, when fast maneuvers appear on the target, the PF-based method will soon suffer from particle degeneracy, or even loss of the target. In this paper, a robust exact differentiator (RED)-based particle generating method is proposed to improve the PF. New birth particles are produced by the proposed method, which can keep up with the fast maneuvers, and ensure the particle diversity of the PF, so as to avoid the particle degeneracy and depletion, meanwhile the number of particles required can be decreased. Numerical simulations are conducted, showing that the proposed algorithm has more advantages than the state-of-the-art method.
1. Introduction
The target tracking technology estimates and predicts the motion state of the target by establishing a motion model [1, 2] and integrating filtering methods [3], based on the data information obtained from radar, infrared imaging system, or other sensors [4–6]. Traditional target tracking technology adopts the detect-before-track (DBT) method, which directly uses the original observation date obtained from the sensors with low thresholds and mines the data information. Through the integration of observations over time, the signal-to-noise ratio can be improved, so as to achieve the tracking of the target. The DBT method works well under high signal-to-noise ratio, however, cannot handle the target well under low signal-to-noise ratio. The track-before-detect (TBD) method is then introduced by scholars, which can handle weak target with good effects through noncoherent integration [7]. The TBD method searches for the target trajectory from multiple frames of data and accumulates the energy along the trajectory. The key problem of the method is how to obtain the prior information about the target.
Fast maneuvering targets, such as vehicles, aircrafts, and missiles, are able to change the motion states with quick speed, or big acceleration in a short time [8], so as to realize the maneuvering motivation, which will bring nonlinear uncertainties to the information about the target [9]. Due to the nonlinear uncertainty of the target model [10, 11], the traditional Kalman filter (KF) [12] is not applicable. Besides, an infrared dim small target in a complex background will also bring difficulties to filters. Infrared image is obtained by making use of the intensity of infrared light of the object. Different objects or different parts of the same object in most cases have different thermal radiation characteristics, such as temperature and emissivity. Through the infrared imaging system, the differences are converted into electrical signals, and then the electrical signals are converted into visible light images. Infrared image is generally dim, with low contrast resolution between the target image and background, and the noise, meanwhile is large, which affects the subsequent processing of the image.
In recent years, the particle filter (PF)-based methods have been used to detect and track targets, [13–16] and have performed good results on tracking dim small targets [16, 17]. Different from the KF, the PF can get rid of the limitations of linear and Gaussian assumptions [18]. However, the PF has two major problems. One is the large number of samples required to approximate the posteriori probability density. When the background is complex, the sample size should be huge, which consequently increases the algorithm complexity. The other is the sample depletion. The resampling process abandons particles with low weights, which will cause the loss of diversity and effectiveness in particles after iterations for times, resulting in particle degeneracy and sample depletion. Studies [19–21] show that these two problems of the PF are particular serious on tracking non-Gaussian targets with strong nonlinearities.
Aiming at solving the two problems of the PF, this paper proposed a new target tracking method, with which the PF can be ensured to keep up with the change of the target motion when the target is highly maneuvered, and meanwhile the target motion trajectory can be estimated accurately.
The rest of this paper is organized as follows: Section 2 reviews related works on the PF method and the KF method. Section 3 develops the robust exact differentiator (RED)-based particle generating method and improved PF algorithm. Section 4 discusses experimental results and, finally, Section 5 concludes the paper.
2. Related Work
The tracking ability of the filter is usually determined by the reasonable mathematical model of the target motion. However, in the real situation, the motion law of the target will be affected by many factors [22, 23], which causes a mismatch between the target motion and the filtering model. The state of the target, consequently, cannot be estimated accurately. Denote the state vector of the target at time as , which consists of the position, the speed, and the acceleration of the target, with size of . Denote the observation vector of the target at time as with size of . Then, the state model and observation model can be described as follows:where and are the nonlinear functions of the state vector, representing the state transition function and the observation function, respectively, is the process noise vector of the discrete system, and is the observation noise vector.
2.1. PF
The PF is a sequential Monte Carlo method, with the idea which makes use of the weighted random samples and the estimations based on these samples to achieve the posterior probability density . corresponds to the infrared image measurements obtained from infrared sensors at frame .
Denote the random sample set of the posterior probability density as , where is the th particle at frame , is the weight of the particle , and is the number of particles. Normalization processing is usually made that . The posterior probability density is given as follows:
is updated by the following recursive equations [24]:where is the importance density, of which three forms are commonly used [25]:(i)the prior probability ;(ii)the likelihood ; and(iii)the optimal by minimizing the weight variance .
Denote the weighted particle set with joint state vector as , where indicates that the target exists, and indicates that the target is absent. Resample from the previous particle set and newly weighted particle set. Finally, the position of the target can be estimated by the following equation:
2.2. KF
The KF always makes an assumption that the system can be regarded to be linear and Gaussian, so the model in (1) needs to be simplified as follows:where is the linearized form of in (1), representing the state transition matrix, and is the linearized form of in (1), representing the observation matrix.
and are assumed to be mutually independent, with a zero mean and covariance matrices and , respectively,
The KF searches for the optimal solution by minimizing the mean square error,
Denote the estimation of at frame given the observations of frame that as . Denote the error covariance matrix as with . The predictions of and are given as follows:
Thenwhere the gain matrix is given by
3. Approach
To handle the maneuvering target, the KF usually makes the assumption of constant acceleration. The state vector is defined as follows:where is the x position of the target in the infrared image at frame , is the y position of the target in the infrared image at frame , and are speeds along x-axis and y-axis, and and are accelerations along x-axis and y-axis.
Based on the assumption of constant acceleration that the acceleration of the target is constant in small time interval [26, 27], the state and observation equations can be obtained as follows:where is the time interval between adjacent frames.
Considering the situations that the target maneuvers at a fast-varying speed, the assumption of constant acceleration is no longer suitable. This paper uses the robust exact differentiation (RED), proposed by Levant, to deal with the practical real-time differentiation problem and obtain the real-time acceleration of the target [28]. We use to represent the estimation of x-position of the target in the image, is the estimation of speed along x-axis, and is the estimation of acceleration along x-axis. The same goes for y. According to the RED based on the supertwisting algorithm [29], the tracking observation model of is given as follows:where are measurable locally bounded functions, having derivatives with Lipschitz constants , and , are the gain parameters.
|
Apart from the persisting particles, we generate new birth particles according to the estimations obtained from Algorithm 1, with the importance density of . The weights of the new birth particles are given by [30].where is the number of new birth particles and is given by the uniform distribution over the state space around the target predictions of Algorithm 1.
The flow chart of the proposed algorithm as a whole is shown in Figure 1. At the initial stage, the tracking target is specified manually. Then, the features of the target are calculated. At the searching stage, the particles are uniformly assigned. Then, the weights of the particles are updated according to the results of similarity calculation. Based on the updated weights, the efficient number of particles is calculated.
The efficient number is the indicator to determine whether to generate new particles. Particle resampling process is then conducted. By repeating the abovementioned processes for several times, the most likely place for the target will be calculated. Algorithm 2 describes the iteration of the improved PF.
|
4. Experiments
The experiments adopt the dataset download from https://www.dx.doi.org/10.11922/sciencedb.902 [31]. The dataset contains image sequences for tracking low altitude flying dim small targets. Fast maneuvers are also included in some of the image sequences.
Image preprocessing is firstly made. To reduce the noise, the images are improved by enhancing the information required and weakening the information unwanted. The original small range of gray value is broadened. Then, image segmentation is carried out to make the target separated from the background.
We compare the proposed method with the basic PF and KF-PF. For the convenience of intuitive understanding, we name our method as RED-KF-PF. The three methods give the same parameter settings for KF and PF in the initialization step so as to guarantee the fairness. The comparison results of RMSE are listed in Table 1. The RMSE is the square root of the mean square error, which is given as follows:
The comparison results of running time are listed in Table 2. According to Tables 1 and 2, higher accuracy with less particles and less time is achieved by the proposed method.
By choosing the dataset with fast-maneuvering test, Figure 2 demonstrates the tracking process with the proposed algorithm. By choosing the close-range test and the distant-range test, Figures 3 and 4 demonstrate the detection results and particle distributions. The target takes slow motions, so the particle distributions did not show apparent characteristics of the proposed idea. As in Figure 5, in which a quick maneuver is taken by the target, the particles with great importance mainly come from the RED-based particle generating method. If not, the green dot in Figure 5(a) calculated from the persistent particles would influence the tracking result heavily.
(a)
(b)
(c)
(d)
(e)
(f)
(g)
(h)
(i)
(a)
(b)
(a)
(b)
(a)
(b)
5. Conclusion
To improve the distribution of the particles, the KF with the constant acceleration model is considered to generate particles around the estimation center. In the cases the KF is not capable to track the motions of the target, the RED is constructed to update the estimation center. The generated particles not only improve the diversity of particles but also make the resampled particles much closer to the real target state, so that the PF can approximate the posterior probability density better. Method for modification of the Lipschitz constants and in real time is considered for future work.
Data Availability
All data used during this study are included in this published article [31], and its supplementary information files can be downloaded from https://www.dx.doi.org/10.11922/sciencedb.902.
Conflicts of Interest
The authors declare that they have no conflicts of interest.
Acknowledgments
The authors would like to thank the anonymous reviews for their helpful suggestions to improve the quality of the paper. This work was supported by the Fundamental Research Funds for the Central Universities of China under Grant 2022RC24.
Supplementary Materials
The dataset contains image sequences for tracking low altitude flying dim small targets. The supplementary material file, including 100 frames, provides a group of data for one fixed-wing UAV target with fast maneuvers under complex field background. The dataset can serve research studies on infrared fast-maneuvering target tracking. (Supplementary Materials)