Mathematical Problems in Engineering

Volume 2012 (2012), Article ID 372161, 25 pages

http://dx.doi.org/10.1155/2012/372161

## Multiple Maneuvering Target Tracking by Improved Particle Filter Based on Multiscan JPDA

^{1}MOE Key Lab for Intelligent and Networked Systems, Institute of Integrated Automation, School of Electronics and Information Engineering, Xi’an Jiaotong University, Xi’an, Shaanxi Province 710049, China^{2}School of Aeronautics, Northwestern Polytechnical University, Xi’an, Shaanxi Province 710072, China

Received 5 September 2012; Revised 20 October 2012; Accepted 3 November 2012

Academic Editor: Suiyang Khoo

Copyright © 2012 Jing Liu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

The multiple maneuvering target tracking algorithm based on a particle filter is addressed. The equivalent-noise approach is adopted, which uses a simple dynamic model consisting of target state and equivalent noise which accounts for the combined effects of the process noise and maneuvers. The equivalent-noise approach converts the problem of maneuvering target tracking to that of state estimation in the presence of nonstationary process noise with unknown statistics. A novel method for identifying the nonstationary process noise is proposed in the particle filter framework. Furthermore, a particle filter based multiscan Joint Probability Data Association (JPDA) filter is proposed to deal with the data association problem in a multiple maneuvering target tracking. In the proposed multiscan JPDA algorithm, the distributions of interest are the marginal filtering distributions for each of the targets, and these distributions are approximated with particles. The multiscan JPDA algorithm examines the joint association events in a multiscan sliding window and calculates the marginal posterior probability based on the multiscan joint association events. The proposed algorithm is illustrated via an example involving the tracking of two highly maneuvering, at times closely spaced and crossed, targets, based on resolved measurements.

#### 1. Introduction

The problem of multiple maneuvering target tracking has received a considerable attention in recent years. Multiple model approaches are proposed to model highly maneuvering targets and the interacting multiple model (IMM) algorithm [1–3] is the most popular one among them. Moreover, in the presence of clutter, some of the sensor measurements may not relate to the target of interest. The problem of data association has to be solved. Effective approaches in a Bayesian framework include the probabilistic data association (PDA) approach [4, 5] and the integrated probabilistic data association (IPDA) approach [6–8] for tracking a single target in clutter, the JPDA approach [4, 9, 10], and the joint integrated probabilistic data association (JIPDA) approach [11] for tracking multiple targets in clutter. The PDA and JPDA approaches address the track maintenance issue, while the IPDA and JIPDA approaches tackle the issues related to track initiation and track termination as well as track maintenance.

Different combinations of the IMM method and the PDA/JPDA/IPDA/JIPDA methods have been used to tackle multiple maneuvering target tracking problems. In [12], the IMM algorithm is combined with the PDA filter in a multiple sensor scenario proposing a combined IMMPDA algorithm. The IMMPDA algorithm has good tracking performance when the targets are sufficiently separated. In [13], an IMMJPDA-coupled filter is developed for situations where the measurements of two targets are unresolved during periods of close encounter. The filters corresponding to the individual targets are coupled through cross-target-covariance terms. In [14], JPDA is combined with a crude approximation of IMM, under the name IMMJPDA. In [15], an IMMJIPDA algorithm is used in situations with a small number of crossing targets and low clutter measurement density. In order to deal with more complex scenarios with a large number of targets, an IMM-LMIPDA algorithm has been proposed by integrating linear multitarget (LM) method with IMM-IPDA. The computational requirements of the proposed IMM-LMIPDA algorithm increase linearly in the number of targets and the number of measurements.

Recently, several methods which significantly outperform IMMJPDA have been proposed to deal with the multiple maneuvering target tracking problem. In [16], an IMMJPDA uncoupled fixed-lag smoothing algorithm is proposed, which performs far better than IMMJPDA filtering. In [17, 18], the descriptor system approach [19] is used to develop a track-coalescence-avoiding version of IMMJPDA. In [20], multiscan information is incorporated in JPDA to tackle the data association problem associated with the multiple maneuvering target tracking. In [21], a new track-coalescence-avoiding IMMCPDA method is proposed to improve the situation of tracking closely spaced targets by characterizing the exact Bayesian filter, and by developing novel target tracking combinations of IMM and PDA.

In the above methods, the data models are assumed Gaussian and weakly nonlinear, and the Kalman filter/extended Kalman filter (KF/EKF) is used to perform target state estimation. More recently, nonlinear filtering techniques have been gaining more attention. The most common one among them is the particle filter [22], a state estimate pdf sampling based algorithm.

There are not many reported works concerning the particle filter based multiple maneuvering target tracking methods. In [23], the problem of maintaining tracks of multiple maneuvering targets from unassociated measurements is formulated as a problem of estimating the hybrid state of a Markov jump linear system from measurements made by a descriptor system with independent, identically distributed (i.i.d.) stochastic coefficients. The possible multiple motion models and transition probability matrices are assumed to be known in the proposed method. In [24], the marginal filtering distributions for each of the targets are approximated with particles. The posterior marginal probability is calculated based on the joint association hypotheses, which are examined in a single scan. However, single scan information may not be enough for tracking maneuvering targets, especially in the condition of tracking two closely spaced targets.

In this work, a novel method is proposed for a multiple maneuvering target tracking, which is a combination of the particle filter based process noise identification algorithm and the particle filter based multiscan JPDA algorithm. The process noise identification process is effective in estimating both the maneuvering movement and the random acceleration of the target, using one general model for each of the maneuvering targets. The multiscan JPDA is effective in maintaining the tracks of multiple targets using multiple scan information. Compared with the single scan JPDA method, the multiscan JPDA method uses richer information, which results in better estimated probabilities.

The rest of the paper is organized as follows. Section 2 provides a brief introduction to particle filter, and the multiple maneuvering target tracking problem is defined in Section 3. The particle filter based process noise identification method for tracking highly maneuvering target is introduced in Section 4. The data association method based on multiscan JPDA is discussed in Section 5. The proposed multiple maneuvering target tracking algorithm, which is a combination of the above two algorithms, is introduced in Section 6. The simulation results are shown in Section 7 and the paper is summarized in Section 8.

#### 2. Basic Theory of Particle Filter

To define the problem of tracking, consider a dynamic system represented by the state equation: where is the state, is a possibly nonlinear function, and is the known process noise with a zero mean Gaussian distribution. The objective of tracking is to recursively estimate from a sequence of measurements up to time step , . The observation model is described as follows: where is a possibly nonlinear function. is the observation noise with a zero mean Gaussian distribution. From the Bayesian perspective, the tracking problem is to recursively calculate the posterior distribution .

In this paper, a particle filter is considered to solve the state estimation problem due to its ability to tackle the nonlinear and non-Gaussian systems. The posterior distribution is approximated by a set of particles with associated weights. The detailed introduction about particle filter algorithm can be found in [22]. The procedures associated with the standard particle filter are listed in the following.

*Algorithm 2.1 (particle filter algorithm). *(1) *Initialization*. Sample initial particles from the initial posterior distribution and set the weights to , . is the number of particles.

(2) *Prediction*. Particles at time step , , are passed through the system model (2.3) to obtain the predicted particles at time step , :
where is a sample drawn from the known zero mean Gaussian distribution.

(3) *Update*. Once the observation data, , is measured, evaluate the importance weight of each predicted particle and obtain the normalized weight for each particle:
Thus at time step we can obtain the estimate of the state, .

(4) *Resample*. Resample the discrete distribution , times to generate particles , so that for any , . Set the weights to , , and move to Stage 2.

#### 3. Multiple Maneuvering Target Tracking Problem Formulation

The number of maneuvering targets () to be tracked is assumed as fixed and known, where each target track has been initiated, and our objective is to maintain the tracks. Each target is parameterized by a state , where denotes the target and denotes time step . The combined state, , is the concatenation of the individual target states. The individual targets are assumed to evolve independently according to a general motion model, where is the maneuver acceleration and is the process noise.

The observation vector is composed of multiple sensor measurements , where is the total number of measurements. It is assumed that there are no unresolved measurements (i.e., measurements associated with two or more targets simultaneously); any measurement is either associated with a single target or caused by clutter. Clutter is modeled as independently and identically distributed (IID) with an uniform spatial distribution over the surveillance area.

In this paper, the multiple maneuvering target tracking problem is divided into two parts: single maneuvering target tracking and multiple target tracking, which are introduced in Sections 4 and 5, respectively. The particle filter based process noise identification method for tracking a highly maneuvering target is introduced in Section 4. The data association method based on multiscan JPDA is discussed in Section 5. Finally, in Section 6, the combination of the two methods is combined to deal with the multiple maneuvering target tracking problem.

#### 4. Maneuvering Target Tracking Based on Process Noise Identification

In this section, the particle filter based process noise identification method is proposed for tracking highly maneuvering target. The general motion model of a maneuvering target is described by (3.1). In the equivalent-noise approach [25–27], it is assumed that the general motion model (3.1) that describes target motions can be simplified to with an adequate accuracy, where is the equivalent noise that quantifies the error of this model in describing the target motions, in particular, maneuvers. The statistics of this noise , nonstationary in general, are not known.

In this section, a novel method is proposed for process noise identification. The process noise is modeled as a dynamic system. The noise vector is chosen as the state of the noise system. The observation vector is , which is the same as in (2.2). The observation equation is defined in The aim of the proposed method is to estimate the posterior distribution of the process noise, . According to the Bayesian inference theory, where is a normalizing constant and is defined as . So we can obtain The noise may be from random accelerations, sudden maneuvers, or both, and there is no information about the distribution of . is not dependent on the previous measurements , which results in According to the Bayesian theory, the prior distribution of parameters, on which there is no information, could be considered as a uniform distribution. In this paper, the prior distribution of the process noise is considered as a uniform distribution, and the posterior distribution of the process noise is then obtained via a Monte Carlo deviation process. The general procedure of the particle filter based process noise identification algorithm is as follows.

Initially a number of process noise samples are generated from a uniform distribution since there is no information on the process noise distribution due to the uncertain dynamics. Each of the process noise samples is assigned with a weight based on the current measurement and the particles from the previous time step. According to Monte Carlo theory, the process noise samples and their associated weights approximate the true posterior distribution of the process noise. The process noise samples are then resampled according to their associate weights. The samples with large weights are duplicated, while the samples with small weights are removed. The resampled process noise samples distribute approximately according to the true posterior distribution of the process noise.

Since there is no information about , it is reasonable to assume that is uniformly distributed in the range of , where denotes a uniform distribution and is the known process noise bound accounting for the maximin uncertain dynamics. According to the Monte Carlo theory, can be represented by samples, , from . Consider The number of process noise samples () is proportional to the magnitude of the maximum uncertain dynamics (). The posterior distribution of can be represented as where is defined as the weight assigned to the process noise sample . The process noise samples are then resampled according to based on the principle that, where are the process noise samples obtained from resampling. The obtained resampled process noise samples are approximately distributed according to the posterior distribution .

In order to calculate , the likelihood function is expanded based on the resampled state particles at time step , . Consider Since and are independent, .

The resmapled particles at time step , , should be assigned with the same and equal weights, . We can then obtain

To calculate , define as the intermediate particle, and expand based on , Since and are known and is obtained from a purely deterministic relationship in (4.10), we obtain Combining (4.9) and (4.13) with (4.8) results in At each time step, the process noise samples are drawn from a uniform distribution . Each process noise sample is evaluated and assigned its corresponding weight . A resampling procedure is then used to redistribute the process noise samples, from which the process noise samples with large weights are replicated while the samples with small weights are eliminated.

The standard particle filter procedure for state estimation follows next. The predicted particles are then obtained based on the resampled process noise samples through the dynamic model (4.1). The predicted particles are updated and resampled as in the conventional particle filter algorithm.

The complete algorithm including the process noise estimation and state estimation parts is summarized below.

*Algorithm 4.1 (particle filter based process noise identification). * At time step , draw process noise samples from a uniform distribution .

Calculate the intermediate particles according to (4.10).

Calculate the process noise sample weights via (4.14).

Resample the discrete distribution , times to generate the resampled process noise samples , so that for any , . Set the weights to ,.

Calculate the predicted particles at time step , ,
and are the same with the stages and in Algorithm 2.1.

*Algorithm 4.2 (simplification of the proposed algorithm). *In the proposed algorithm, at each iteration, intermediate particles are calculated through the permutation of particles and process noise samples in (4.10) and evaluated via (4.13). This increases the computation burden and the algorithm runs slowly compared to the conventional particle filter, which are based on particles (Algorithm 2.1). It is observed that at each time step, after resampling the particles focus in some smaller area, a large portion of particles are with the same value (Algorithm 2.1, Step ). To simplify the algorithm, it is assumed that the particles (Algorithm 2.1, Step ) are less variable compared with the process noise samples (4.10). In (4.10), particles are replaced by , the estimate of the state at time step , which results in a simplified version of (4.10),
and is expanded directly on ,
Using the similar derivation process with (4.12), we can obtain

In the simplified version of the proposed algorithm, the number of intermediate particles is reduced to , which reduces the computation burden and increases the computing speed. More importantly, the performance of the algorithm with the simplification procedure is verified through simulation study. In the following sections, the particle filter based process noise identification algorithm refers to the simplified version.

*Discussion. *It is required to set the process noise bound preliminarily, which could be estimated based on the maximin uncertain dynamics. For most of the manned air vehicles, the process noise bound could be determined according to the flight envelop of the aircraft. For the unmanned air vehicles with unexpected maneuvers, is set large enough to cover the unexpected maneuvers. If our knowledge about is imprecise, tracking process may fail when coping with the maneuvers that are not covered by the process noise bound .

#### 5. Multiple Target Tracking Using Particle Filter Based Multiscan JPDAF

The number of targets () to be tracked is assumed as fixed and known, where each target track has been initiated, and our objective is to maintain the tracks. Each target is parameterized by a state , where denotes the target and denotes time step . The combined state, , is the concatenation of the individual target states. The individual targets are assumed to evolve independently according to the Markovian dynamic models . The observation vector is composed of multiple sensor measurements , where is the total number of measurements. It is assumed that there are no unresolved measurements (i.e., measurements associated with two or more targets simultaneously); any measurement is either associated with a single target or caused by clutter. Clutter is modeled as independently and identically distributed (IID) with uniform spatial distribution over the surveillance area.

In the particle filter based JPDA algorithm, the distributions of interest are the marginal filtering distributions for each of the targets , and these distributions are approximated with particles, , and their associated weights , as in At each time step, when the new observation vector arrives, the marginal filtering distributions for each of the targets are updated through the Bayesian sequential estimation recursions [24].

In the standard single scan JPDA framework, a track is updated with a weighted sum of the measurements which could have reasonably originated from the target in track. The only information the standard JPDA algorithm uses is the measurements on the present scan and the state vectors. If more scans of measurements are used, additional information is available resulting in better computed probabilities [4]. Since the tracking systems are unable to store all of the measurements from all the scans, a Bayesian tracking system can at best rely on a sliding window of scans. In [28], the single scan JPDA filter is extended to the multiple scan JPDA filter for tracking multiple targets. And in this work the multiple scan JPDA filter is developed in a particle filter framework.

The multiple scan JPDA calculation examines multiple scan joint association events [28]. The measurement to target the association event of a multiple scan is defined as , where denotes the length of the multiple scan sliding window. The multiple scan joint association events are mutually exclusive, and they form a complete set [11]. is composed by the association vectors at each scan in the sliding window, . The elements of the association vector at time step , are given by The heart of the new algorithm is to find the posterior probability for the joint association event of multiple scans. That is to calculate and it can be written as where the conditioning of on the history of measurements before the sliding window has been eliminated.

The distribution of the measurements in the sliding window based on a specific association event is given by To reduce the notation, the index of the scan in the sliding window is denoted by . Then we can obtain where and are, respectively, the subsets of measurement indices corresponding to clutter measurements and measurements from the targets being tracked, on scan . denotes the clutter likelihood model, which is assumed to be uniform over the volume of the surveillance area . The volume of the surveillance area could be calculated as per , where is the maximum range of the sensor. is defined as the number of clutter measurements.

The joint association prior , can be calculated as in (5.6) according to [4, 16], where is a “diffuse” prior [16] and is the detection probability. is a binary variable and set to one if the target is assigned with a measurement in the event .

The posterior probability for the joint association event of multiple scans is obtained as The posterior probability that the measurement is associated with the target on scan , , is calculated by summing over the probabilities of the corresponding joint association events via

These approximations can, in turn, be used in (5.9) to approximate the target likelihood according to [24], where is the posterior probability that the target is undetected. Finally, setting the new importance weights to where is the proposal distribution, which is used to generate the predicted particles. Equation (5.10) leads to the sample set being approximately distributed according to the marginal filtering distribution .

A summary of the particle filter based multiple scan JPDA filter algorithm is presented in what follows. Assuming that the sample sets , are approximately distributed according to the corresponding marginal filtering distributions at the previous time step , the algorithm proceeds as follows at the current time step.

*Algorithm 5.1 (particle filter based multiscan JPDA filter). * For , generate predicted particles for the target states .

For , calculate , the preapproximation of , which is to be substituted into (5.7) to calculate the posterior probability of the joint association event in multiple scan, . Consider

Enumerate all the valid joint measurement to target association events in the sliding window to form the set .

For each , compute the posterior probability of the joint association event in multiple scan, , via (5.7).

For , compute the marginal association posterior probability, , via (5.8).

For , compute the target likelihood, , via (5.9).

For , compute and normalize the particle weights, via (5.10).

Resample the discrete distribution , times to generate particles , so that for any , . Set the weights to ,, and move to Stage 1.

#### 6. An Algorithm for Tracking Multiple Maneuvering Targets

The proposed multiple maneuvering target tracking algorithm is a combination of the particle filter based process noise identification algorithm (proposed in Section 4) and the particle filter based multiscan JPDA algorithm (proposed in Section 5). In the proposed algorithm, firstly the particle filter based process noise identification algorithm is used to estimate the maneuvering movement for each target. Then the particles of each target model are propagated to the next time step based on the new distributed process noise samples to obtain the predicted particles. In the update process, each predicated particle of one target model is assigned with a weight based on the multiscan JPDA process. The steps of the proposed multiple maneuvering target tracking algorithm are listed in the following.

*Algorithm 6.1 (multiple maneuvering target tracking). * At time step , for ,(a)draw process noise samples from a uniform distribution ,(b)calculate the intermediate particles according to
(c)calculate the process noise sample weights via (6.2) and normalize each weight:
where are the measurements that are close to obtained from the nearest neighbor method,(d)resample the discrete distribution , times to generate the new process noise samples , so that for any , . Set the weights to ,,(e)obtain the predicted particles at time step from the new process noise samples via

At time step , for , calculate , the postapproximation of ,
where are the process noise samples' weights and are calculated based on the measurements at the current time step (). However, in (5.11) is calculated based on , which rely on the measurements at the previous time step . As a result, in maneuvering target tracking, calculated via (6.4) is closer to the true state than that via (5.11) since the information from the current time step is considered in (6.4).

– are the same with the stages – in Algorithm 5.1.

Thus we can obtain is the estimate of the true state .

#### 7. Simulation Results and Analysis

This section consists of three parts. In the first and second part, the particle filter based process noise identification algorithm and the particle filter based multiscan JPDA algorithm are, respectively, used to track single maneuvering targets and two slow-maneuvering targets in clutter. In the third part, the combination of the two algorithms are used to track two highly maneuvering, at times closely spaced and crossed, targets.

##### 7.1. Single Maneuvering Target Tracking

The simulation study using nearly coordinate turn model is performed. The maneuvering target tracking is done by setting up a 2D flight path in plane, which is similar to the path considered in [16]. At time step 1, the target starts at location in Cartesian coordinates in meters with initial velocity (in m/s) . The following trajectory is considered: a straight line with constant velocity between and s, a coordinated turn ( rad/s) between and s, a straight line with constant velocity between and s, a coordinated turn ( rad/s) between and s, and a straight line with constant velocity between and s.

In the particle filter with process noise identification, a general model is adopted during the whole tracking process, where in (7.1), Matrix is the transition matrix and is the sample interval. is the state vector; , and denote, respectively, the position, velocity, and acceleration of the moving object along the -axis of Cartesian frame and, , and along the -axis. The equivalent process noise, , with unknown statistics is required to be identified. The bound of the process noise (), which accounts for the uncertain dynamics, is chosen as . The number of the process noise samples is equal to the number of particles, which is set as 500. The algorithm is initialized with Gaussian around the initial state of the true target, and the standard deviation of the Gaussian distribution is chosen as .

A track-while-scan (TWS) radar is positioned at the origin of the plane. The measurement equation is as follows: where is the observation vector. is the distance between the radar and the target, and is the bearing angle. The measurement noise is a zero mean Gaussian white noise process with standard deviations of and . Resolution of the sensor is selected after from [29] (twice of the standard deviations of the measurement noise). The sampling interval is .

The particle filter based process noise identification algorithm is compared to the IMM filter and the regularized particle filter. The IMM filter consists of three extended Kalman filter (EKF) with different motion models. The details regarding these models may be found in [16]. The initial model probabilities and the mode switching probability matrix are set the same values as in [16]. For the regularised particle filter, Epanechnikov kernel is chosen as the rescaled kernel density, which is the same as in [30]. Moreover, the proposed algorithm is compared to its complete version in the same simulation setup.

The simulation results are obtained from Monte Carlo runs except the results from the complete version of the particle filter based multiscan JPDA algorithm, which is run for times. Figure 1 shows the true trajectory of the maneuvering target. The root mean-square errors (RMSEs) in position at each time step, respectively, using the four methods are shown in Figure 2, where RPF and PFPNI represent the regularised particle filter algorithm and the particle filter based process noise identification algorithm. The performance of the methods is also compared via the global RMSE (in position), the tracking loss rate (TLR), and the executing time (ET), which are listed in Table 1. The tracking loss rate (TLR) is defined as the ratio of the number of simulations, in which the target is lost in track, to the total number of simulations carried out. The target is defined as lost in track when its global RMSE in position is larger than the ten times of the magnitude of the standard deviation in position. The executing time (ET) is the CPU time needed to execute one time step in MATLAB 7.1 on a 3 GHz (Mobile) Pentium IV operating under Windows 2000.

From the simulation results, it can be seen that the simplified version of the proposed particle filter based process noise identification algorithm outperforms the IMM filter and the regularised particle filter algorithm, with computing time within the limits of practically realizable systems. Moreover, the proposed algorithm needs neither the possible multiple motion models nor the transition probability matrices, which makes it a more general algorithm for maneuvering target tracking. From the simulation results, it can also be seen that the complete version of the particle filter based process noise identification algorithm is not suitable for practical application due to the long computing time, though it gains a increase in accuracy (RMSE) compared with its simplified version.

##### 7.2. Multiple Target Tracking

The simulation is carried out for tracking two slow-maneuvering targets in clutter. The Wiener process acceleration model (7.1) is chosen as the motion model for the two targets. The process noise, , is a zero mean Gaussian white noise process with standard deviations of , , , , , and .

At time step 1, target one starts at location in Cartesian coordinates in meters with the initial velocity (in m/s) . Target two starts at location (in m) with the initial velocity (in m/s) . The length of each simulation run is seconds. A TWS radar is positioned at the origin of the plane, whose details are provided in Section 7.1.

The sampling interval is and it is assumed that the probability of detection for the radar. For generating measurements in simulations, the clutter is assumed uniformly distributed with density .

In the particle filter based multiscan JPDA methods, each target model is assigned with 500 particles. The algorithm is initialized with Gaussians around the initial states of the true targets, and the standard deviations of the two Gaussian distributions are chosen equally as .

In the simulations carried out, the length of the multiple scan sliding window () varies from 1 to 3. The corresponding particle filter based multiscan JPDA methods with are utilized to track two slow-maneuvering targets individually. A comparison to the standard JPDA filter is also studied on the same simulation setup. The simulation results are obtained from Monte Carlo runs. Figure 3 shows the true trajectories of the two targets and Figure 4 shows the distance between the two targets along time, through which we can see that the two targets reach the smallest distance at time step . The RMSEs in position for the two targets are, respectively, shown in Figures 5 and 6, where PFJPDA represents the particle filter based JPDA filter with its following number in the bracket (e.g., (2.1)) denoting the scan number (). The performance of the four methods is also compared in Table 2. The swap rate (SR) is defined as the ratio of the number of simulations, in which the two targets swap, to the total number of simulations.

Compared with the standard JPDA method (based on extended Kalman filter), the particle filter based JPDA methods (single scan and multiple scan) are much more accurate and robust, at the cost of longer computing time. This verifies that when dealing with nonlinear problem (nonlinear observation equation) and large random acceleration (large process noise), the performance of particle filter is better than extended Kalman filter using local linearization.

In the comparison between the three particle filter based JPDA methods (, resp.), from Figures 5 and 6 it can be seen that there is no significant deference between the three methods except around time step , when the two targets are very close to each other (Figure 4). As the scan number increases, the RMSE (in position) of the corresponding algorithm decreases significantly around time step (Figures 5 and 6). This verified that the particle filter based multiscan JPDA method provides a better performance especially when the targets are very close. The additional information of more scans improve the association probabilities in such critical situation, resulting in lower estimation errors (RMSE) and larger robustness (tracking loss rate).

##### 7.3. Multiple Maneuvering Target Tracking

We now consider tracking two highly maneuvering targets in clutter. The true trajectories are shown in Figure 7 in plane. The velocities of the targets are shown in Figure 8, where and represent the velocity, respectively, in and coordinate. The distance between the two targets is shown in Figure 9. Target one is with the same setup as in the example proposed in Section 7.1. Target two starts at location in Cartesian coordinates in meters with the initial velocity (in m/s) . Its trajectory is a straight line with constant velocity between and s, a coordinated turn between and s, and a straight line constant velocity between and s.

A TWS radar is positioned at the origin of the plane (refer to Section 7.1). The sampling interval (), the probability of detection (), and the clutter density are the same as in Section 7.2.

In the proposed method, each target model is assigned with 1000 particles. The length of the multiple scan sliding window () is chosen equal to . The bound of the process noise () is the same as in Section 7.1. The algorithm is initialized with Gaussians around the initial states of the true targets, and the standard deviations of the two Gaussian distributions are chosen equally as .

In this work, the proposed method is compared to an IMMJPDA method and a multiscan IMMJPDA method, whose details could be found in [16, 20], respectively.

The simulation results are obtained from Monte Carlo runs. The RMSEs (resp. in position and velocity) at each time step for the two targets are shown in Figures 10, 11, 12, and 13, where MS-IMMJPDA and PFPNI-PFMSJPDA represent, respectively, the multiscan IMMJPDA algorithm and the proposed algorithm. The performance comparison is listed in Table 3. Moreover, for the proposed algorithm, the influence of the particle number in its performance is studied and simulations are carried out based on different sample sizes. The results are listed in Table 4.

The simulation results show that the proposed algorithm is more accurate than the multiple scan IMMJPDA filter and IMMJPDA filter, though it takes longer computing time. However, the three algorithms are implemented using Matlab. The computing time is considerably reduced when coded in C++. For the proposed method, it takes about 0.8 second for one time step in C++.

In the scene of simulation, at the period of ~, the two targets are very near to each other, which easily results in track swap. In the IMMJPDA method, the judgement of which measurements belong to which target depends on the information from the current scan. If the measurements from two targets are very close, it is hard to distinguish the different targets based on the measurements from a single scan, which leads to a track swap. In the proposed method and the multiple scan JPDA method, the information from several previous scans is combined with the information from current scan to calculate the association probabilities. The decision of which measurements belong to which target based on the information from multiple scans will be more accurate than single scan method, which reduces the swap rate effectively.

From Table 4, it can be seen that when the number of particles is increased, the performance of the proposed algorithm also increases. But when the number of particles exceeds some threshold (1000), the increase in the performance slows down.

#### 8. Conclusions

A new algorithm is proposed for multiple maneuvering target tracking in the particle filter framework. In order to track the highly maneuvering target, the particle filter based process noise identification method is proposed to estimate the equivalent process noise induced by both maneuvering and random acceleration. Compared with the multiple model based methods for maneuvering target tracking, only one general model is adopted in the proposed method. In order to tackle the data association problem in multiple maneuvering target tracking, the particle filter based multiscan JPDA filter is adopted. Compared with the single scan JPDA method, the multiscan JPDA method uses richer information, which results in better estimated probabilities.

#### Acknowledgments

This work was supported by the Foundation for Innovative Research Groups of the National Natural Science Foundation of China (60921003), the Natural Science Foundations of China (nos. 61104051, 61074176, and 61004087), and the Program for New Century Excellent Talents in University.

#### References

- H. A. P. Blom and Y. Bar-Shalom, “The interacting multiple model algorithm for systems with a jump-linear smoothing application,”
*IEEE Transaction on Automatic Control*, vol. 33, no. 8, pp. 780–783, 1988. View at Google Scholar - Y. Bar-Shalom, K. Chang, and H. Blom, “Tracking a maneuvering target using input estimation versus the interacting multiple model
algorithm,”
*IEEE Transactions on Aerospace and Electronic Systems*, vol. 25, no. 2, pp. 296–300, 1989. View at Google Scholar - A. Munir and P. Artherton, “Adaptive interacting multiple model algorithm for tracking a maneuvering target,”
*IEE Proceedings Radar, Sonar and Navigation*, vol. 142, no. 1, pp. 11–17, 1995. View at Google Scholar - Y. Bar-Shalom and T. E. Fortmann,
*Tracking and Data Association*, vol. 179, Academic Press, Orlando, Fla, USA, 1988. View at Zentralblatt MATH - Y. Bar-Shalom and X.-R. Li,
*Estimation and Tracking*, Artech House, Norwood, NJ, USA, 1993. View at Zentralblatt MATH - D. Musicki, R. Evans, and S. Stanković, “Integrated probabilistic data association,”
*IEEE Transactions on Automatic Control*, vol. 39, no. 6, pp. 1237–1241, 1994. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - D. Mušicki and R. Evans, “Integrated probabilistic data association—finite resolution,”
*Automatica*, vol. 31, no. 4, pp. 559–570, 1995. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - D. Mušicki and R. Evans, “Clutter map information for data association and track initialization,”
*IEEE Transactions on Aerospace and Electronic Systems*, vol. 40, no. 2, pp. 387–398, 2004. View at Google Scholar - Y. Bar-Shalom and X. Li,
*Multitarget-Multisensor Tracking: Principlesand Techniques*, YBS Publishing, Storrs, Conn, USA, 1995. - T. E. Fortmann, Y. Bar-Shalom, and M. Scheffe, “Sonar tracking of multiple targets using joint probabilistic data association,”
*IEEE Journal of Oceanic Engineering*, vol. 8, pp. 173–184, 1983. View at Google Scholar - D. Mušicki and R. Evans, “Joint integrated probabilistic data association: JIPDA,”
*IEEE Transactions on Aerospace and Electronic Systems*, vol. 40, no. 3, pp. 1093–1099, 2004. View at Google Scholar - A. Houles and Y. Bar-Shalom, “Multisensor tracking of a maneuvering target in clutter,”
*IEEE Transactions on Aerospace and Electronic Systems*, vol. 25, pp. 176–188, 1989. View at Google Scholar - Y. Bar-Shalom, K. Chang, and B. H. A. Blom, “Tracking splitting targets in clutter by using an interacting multiple model joint probabilistic data
association filter,” in
*Multitarget Multisensor Tracking: Applications and Advances*, Y. Bar-Shalom, Ed., vol. 2, pp. 93–110, Artech House, 1992. View at Google Scholar - M. de Feo, A. Graziano, R. Miglioli, and A. Farina, “IMMJPDA versus MHT and Kalman filter with NN correlation: performance comparision,”
*IEE Proceedings—Radar Sonar and Navigation*, vol. 144, pp. 49–56, 1997. View at Google Scholar - D. Musicki and S. Suvorova, “Tracking in clutter using IMM-IPDA Based algorithms,”
*IEEE Transaction on Aerospace and Electronic Systems*, vol. 44, pp. 111–126, 2008. View at Google Scholar - B. Chen and J. K. Tugnait, “Tracking of multiple maneuvering targets in clutter using IMM/JPDA filtering and fixed-lag smoothing,”
*Automatica*, vol. 37, no. 2, pp. 239–249, 2001. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - H. A. P. Blom and E. A. Bloem, “Combining IMM and JPDA for tracking multiple maneuvering targets in clutter,” in
*Proceedings of the 5th International Conference on Information Fusion*, vol. 1, pp. 705–712, July 2002. - H. A. P. Blom and E. A. Bloem, “Interacting multiple model joint probabilistic data association avoiding track coalescence,” in
*Proceedings of the 41st IEEE Conference on Decision and Control*, vol. 3, pp. 3408–3415, December 2002. - H. A. P. Blom and E. A. Bloem, “Probabilistic data association avoiding track coalescence,”
*IEEE Transactions on Automatic Control*, vol. 45, no. 2, pp. 247–259, 2000. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - S. Puranik and J. K. Tugnait, “Tracking of multiple maneuvering targets using multiscan JPDA and IMM filtering,”
*IEEE Transactions on Aerospace and Electronic Systems*, vol. 43, no. 1, pp. 23–35, 2007. View at Google Scholar - H. A. P. Blom and E. A. Bloem, “Exact Bayesian filter and joint IMM coupled PDA tracking of maneuvering targets from possibly missing and false measurements,”
*Automatica*, vol. 42, no. 1, pp. 127–135, 2006. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - M. Arulampalam, S. Maskell, N. Gordon, and T. Clapp, “A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking,”
*IEEE Transactions on Signal Processing*, vol. 50, pp. 174–188, 2002. View at Google Scholar - H. A. P. Blom and E. A. Bloem, “Joint particle filtering of multiple maneuvering targets from unassociated measurements,”
*Journal of Advances in Information Fusion*, vol. 1, no. 1, pp. 15–34, 2006. View at Google Scholar - J. Vermaak, S. J. Godsill, and P. Pérez, “Monte Carlo filtering for multitarget tracking and data association,”
*IEEE Transactions on Aerospace and Electronic Systems*, vol. 41, pp. 309–332, 2005. View at Google Scholar - A. H. Jazwinski,
*Stochastic Processes and Filtering Theory*, Academic Press, New York, NY, USA, 1970. - X. R. Li and Y. Bar-Shalom, “A recursive multiple model approach tonoise identification,”
*IEEE Transactions on Aerospace and Electronic Systems*, vol. 30, no. 3, pp. 671–684, 1994. View at Google Scholar - X. R. Li and Y. Bar-Shalom, “A recursive hybrid system approach to noise identification,” in
*Proceedingsof the 1st IEEE Conference on Control Applications*, pp. 847–852, 1992. - J. Roecker, “Multiple scan joint probabilistic data association,”
*IEEE Transactions on Aerospace and Electronic Systems*, vol. 31, pp. 1204–1209, 1995. View at Google Scholar - W. Koch and G. Keuk, “Multiple hypothesis track maintenance with possibly unresolved measurements,”
*IEEE Transaction on Aerospace and Electronic Systems*, vol. 33, pp. 883–892, 1997. View at Google Scholar - C. Musso, N. Oudjane, and F. LeGland, “Improving regularized particle filters,” in
*Sequential Monte Carlo Methods in Practice*, A. Doucet, N. DeFreitas, and N. Gordon, Eds., pp. 247–271, Springer, New York, NY, USA, 2001. View at Google Scholar