• Views 712
• Citations 1
• ePub 20
• PDF 401
`Mathematical Problems in EngineeringVolume 2013 (2013), Article ID 970158, 8 pageshttp://dx.doi.org/10.1155/2013/970158`
Research Article

## IMM Iterated Extended Particle Filter Algorithm

Air Force Early Warning Academy, Wuhan 430019, China

Received 2 March 2013; Accepted 28 March 2013

Copyright © 2013 Yang Wan et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

In order to solve the tracking problem of radar maneuvering target in nonlinear system model and non-Gaussian noise background, this paper puts forward one interacting multiple model (IMM) iterated extended particle filter algorithm (IMM-IEHPF). The algorithm makes use of multiple modes to model the target motion form to track any maneuvering target and each mode uses iterated extended particle filter (IEHPF) to deal with the state estimation problem of nonlinear non-Gaussian system. IEHPF is an improved particle filter algorithm, which utilizes iterated extended filter (IEHF) to obtain the mean value and covariance of each particle and describes importance density function as a combination of Gaussian distribution. Then according to the function, draw particles to approximate the state posteriori density of each mode. Due to the high filter accuracy of IEHF and the adaptation of system noise with arbitrary distribution as well as strong robustness, the importance density function generated by this method is more approximate to the true sate posteriori density. Finally, a numerical example is included to illustrate the effectiveness of the proposed methods.

#### 1. Introduction

In the field of manoeuvring target tracking, IMM [1, 2] algorithm is a popular method. It uses multiple modes to model the target motion form to track any maneuvering target and modes transition governed by a first-order Markov chain. However, in every mode a Kalman filter is running that the performance is deteriorated by nonlinearities and non-Gaussian. Although EKF [3, 4] and UKF [5] can deal with the nonlinear problem, they cannot avoid the limitation of Gaussian hypotheses.

Recently, particle filter (PF) [6] has been paid attention to due to its capacity of dealing with the state estimation problem in any nonlinear non-Gaussian system and it has been widely applied [710]. It represents the required state posteriori density by a stochastic particles (or samples) with associated weights and to compute estimates based on these particles and weights. Particle filter methods for Markovian switching systems have also been proposed in [1113]. However, a major drawback of these methods is that the number of particles in each mode is proportional to the mode probability. If a mode probability is close to 0, the particles in that mode will be lost in a large number. When the mode probability increases again, particles need to be reconfirmed, which certainly will result in a significant increase of estimation errors in certain period. This phenomenon is known to cause numerical problems and is also discussed in [14]. To overcome this problem, Boers and Driessen [15] combine IMM with particle filter (IMM-PF) and there is an interaction between modes. Each mode uses a fixed number of particles and runs a regularised particle filter. The state posteriori density of the system is a weighted sum of posteriori density of each mode. Subsequently, the approach has been extensively used in variety manoeuvring target tracking scenarios. For example, in [16, 17], IMM-PF was applied to the problem of tracking ground target, and in [18, 19], it was applied to solve the maneuvering target tracking problem in non-Gaussian noise background. The multirate IMM-PF developed in [20] placed emphasis on computation savings, which enabled the particles in each model to be updated at a different rate. An IMM Gaussian particle filter was proposed in [21], which made particle filter able to concurrently process and saved operation time.

However, in IMM-PF, the particles in each mode are drawn according to the prior density without any consideration of current measurements, which have a large deviation with the particles generated from the true posteriori density. Particularly in the case of the measurement model with high accuracy or target maneuvering, this issue will be more serious. To import the current measurements into the particle sampling process, an EKPF and an UPF were applied in each mode of the IMM algorithm presented in [20] and in [22], respectively. They used EKF or UKF to construct an importance density function for approximating the posteriori density for the state in each mode, during which the measurements were utilized. And then the particles were drawn from the function. Nevertheless, due to the limitation of Gaussian hypothesis, their filter performance has no obvious improvement in non-Gaussian condition.

On the other hand, over the past decades, considerable attention has been devoted to filtering, and many important results have been reported in [2334], and references therein. One of its main advantages is the fact that it is insensitive to the exact knowledge of the statistics of the noise signals. The idea of substituting an extended filter (EHF) for EKF or UKF in the PF framework (called PF-EHF) was first proposed in [24]. However, direct utilization of EHF can face the same problem of model linearisation error as EKF. To eliminate this error and further enhance the filter accuracy, this paper uses an iterative technique to improve the Jacobian linearisation of nonlinear system on basis of EHF, namely, linearize the dynamical model at smoothed values and linearize measurement model at filtered value, respectively (called IEHF). Meanwhile, the iterative technique can repeat many times at one step to improve the degree of linearisation approximation of nonlinear system. As the importance density function generated by IEHF, the resulting filter called IEHPF.

In this paper, we propose to combine IMM with IEHPF (IMM-IEHPF) for the tracking problem of maneuvering target in nonlinear non-Gaussian system. The filter accuracy of IEHF is higher than that of EKF and UKF, and IEHF is insensitive to the exact knowledge of the noise processes, therefore the importance density function generated by it is more approximate to the true state posteriori density.

The structure of this paper is as follows. Section 2 presents the problem formulation of the dynamical system model for maneuvering target. Section 3 describes the IMM-IEHPF algorithm to be used for the modes. In Section 4, through simulation example, several algorithms are compared and analyzed. Finally, the conclusion is provided in Section 5.

#### 2. System Model and Problem Description

Consider the following discrete nonlinear time-varying systems for maneuvering target tracking: where and represent the system function and process noise function in mode , respectively. The target state vector is , where , , and , denote the target position, velocity in Cartesian coordinates. represents transpose. is the measurements at time . is the nonlinear measurement function in mode . The process noise and the measurement noise are mutually independent. The mode transition of the system is modelled by a Markov chain with where is the transfer probability and is the number of modes in the IMM.

The state estimation problem of system described in (1)~(2) solved by IMM can be divided into four parts, which are interaction, filtering, mode probability update, and combination. Among them, the combination is a weighted sum of filtering estimation and mode probability of each mode. Therefore, filtering is the key element. Take model as an example and in view of Bayesian estimation, the filtering estimation of this mode is to obtain the posteriori density of state in model given all measurements . Based on this a posteriori density, an estimate of the state is, easily obtained as So, the final combination is given by where and represent the state estimation and mode probability of mode at time , respectively.

It is well known that Kalman filter can get the optimal state estimation in the linear Gaussian system. However, in practice, most cases belong to nonlinear non-Gaussian system, so the analytic expression of posteriori density is difficult to get. Even though we can get it, the integral operation involved in (3) is very complex. Therefore, it is urgent to find out an effective filtering method to solve the problem of state estimation of nonlinear non-Gaussian system.

#### 3. Proposed Algorithm

IMM-IEHPF algorithm proposed in this paper, in fact, is the combination of IMM algorithm and IEHPF algorithm. Compared with IMM-PF, IMM-IEHPF has considered the latest measurements in the particle sampling process by utilizing the prediction and updating mechanism of IEHF. Therefore, the distribution of particles is more approximate to the true state posteriori density and the filter accuracy can be enhanced. We first briefly describe the filter [23] ahead of IEHF and then provide the mathematical model and the concrete implementation steps of IMM-IEHPF algorithm.

##### 3.1. Filter

Consider the following state space model of linear time-varying system: where , , , and are known and the definition of other parameters is the same as the above. The statistical properties of and are unknown and mutually independent. The system initial state is unknown. is the signal we intend to estimate. If we want to directly estimate then we set ( represents the identity matrix). Let denote the estimate of for a given set of measurements . The estimation error can be described as and the norm [23] can be defined as where is a positive-definite matrix which reflects a priori knowledge as to how close is to the initial guess . The norm can thus be interpreted as the maximum energy gain from the input to the output . However, the closed-form solution of the optimal estimation problem is available only in specific cases, so the realization of optimal filter is a suboptimal filtering.

Suboptimal filtering problem: given a scalar , find an suboptimal estimation strategy that achieves . This clearly requires checking whether The solution of the optimal filtering problem can be obtained by iterating on of the suboptimal problem.

For a given , if the is full rank, then an estimator that achieves exists if, and only if [24], where is a given positive definite matrices and satisfies the Riccati recursion [24] where represents the identity matrix.

The covariance updating is

filter gain is given by

So, the state updating equation of filter is given by

filter can be extended to nonlinear systems by using Jacobian linearisation technique. The resulting filter is called EHF. Compared to EKF and UKF, the main advantage of EHF is that there is no limitation about system noise distribution and it treats the system noise as an energy-bounded signal. Through adjusting parameter , the state estimation error can be minimized.

##### 3.2. IEHF

Although EHF can adapt to the case of system noise with non-Gaussian distribution, it also will face the problem of model linearisation error. Therefore, to further enhance the degree of linearisation approximation of nonlinear system, this paper makes improvements on model linearisation technique and proposes IEHF algorithm. Its fundamental idea is as below.

Given the filtered estimation at time . Take the general nonlinear system described in (1) as an example, linearize the dynamical model at , and retain first-order small quantity (for simplicity, omit model variable ) Similarly, linearize measurement model at state predictive value

It is not difficult to see that and have nothing to do with the current measurement . However, the smoothed value and filtered value obtained from measurement are obviously superior to and . If we linearize the dynamical model and linearize measurement model at the smoothed value and filtered value, respectively, the approximation degree of the model linearisation will be further improved. Therefore, this paper adopts the linearisation form as follows.

Linearize the dynamical model at the smoothed value

Linearize the measurement model at the filtered value

In order to further improve the filtering accuracy, the linearisation technique can be repeated many times at one step. All these contribute to IEHF algorithm. However, for many nonlinear filtering problems, the performance is not significantly improved after repeating iterations. Usually it ends after two or three times of iterations. According to the above thoughts, the implementation steps of IEHF algorithm are as follows.

Assume that the iterative filtering value and covariance at time are known, the iterative filtering value in iteration process at time can be solved according to the following expression: where

The smoothing value required by iteration is

##### 3.3. IMM-IEHPF

On the basis of IMM-PF [15] algorithm, this section provides the implementation process of IMM-IEHPF algorithm.

Step 1 (interaction stage). Calculate the mixing probability where represents the mixed probability of the mode at time . The interactive input state and the corresponding covariance are given by where and are the state estimate and covariance estimation in mode-matched filter at time , respectively.

Step 2 (filtering stage). According to the Gaussian distribution constructed by and , each mode draws particles randomly, where is the number of particles.
Importance sampling. Use IEHF algorithm in Section 3.2 to update every particle and obtain a combination of a bank of Gaussian distribution . Then draw particles according to this distribution
Calculate the particle weights [6] where is likelihoods function, is the priori density, and represents importance density function generated by IEHF.
Normalizing
Resampling. According to the normalized weight, resample to get the new particles .
(4) State estimation of each mode

Covariance estimation

Step 3 (update the mode probability). Particle residual of each mode where is measurement predicted output.

Covariance of residual where is mean of predicted output over the sample set.

Mode likelihood function

Mode probability

Step 4. Combination

#### 4. Simulation Results and Analysis

In order to validate the filtering performance of IMM-IEHPF algorithm, this paper compares standard IMM, IMM-PF, and IMM-IEHF algorithm. The experiment scene is designed as follows. Radar scanning interval is s and repeat for times. The target moves in straight line in the former s, then it turns anticlockwise with turning speed of rad/s until 67 s and moves in straight line in the last 33 s. Adopt the system model in (1)~(2) and the target state , which includes the position and velocity component in -axis and -axis. Mode , corresponds to the uniform rectilinear model. The and correspond to the anticlockwise turning mode and clockwise turning mode, respectively. With the known initial state , the target state was evoluted according to different system functions as follows.

Mode (CV mode, ):

Mode (CT mode, ): where is the turning coefficient.

Mode is the same as Mode ; however, in mode , corresponds to the anticlockwise manoeuvre, and in mode , corresponds to the clockwise manoeuvre. The initial mode probabilities are set as , and the mode transition matrix is given by [15]

We measure the range and bearing, and the measurement function is mode- and time-independent and is given by

Measurement noise standard deviations are m for the range measurement, mrad for the bearing, and the number of particles is [15]. In IMM-IEHPF algorithm, parameter . Usually, in order to ensure the robustness of the algorithm, parameter should be as small as possible when meeting the existence conditions of (9). At present, it can only be got through trial and error. Iteration times . We carried out Monte Carlo simulation for times and the position root mean square error (RMSE) at time is defined as

Figure 1 compares the state estimation generated from a single run of IMM, IMM-IEHF, IMM-PF and IMM-IEHPF. For observing the state estimation diversity of the four methods, we have magnified Figure 1.

Figure 1: Position estimate.

As seen from Figure 1, these four methods do well in the target state estimation in the two straight-line movements. However, in the anticlockwise turning period, the deviation from the true values obtained from IMM is larger than those of the other three methods. Among them, IMM-IEHPF has the best state estimation in the maneuvering stage. We can see that the trajectory of IMM-IEHPF is in accordance with the true trajectory.

To compare the filtering accuracy of the previous four methods, Figure 2 shows the position root mean square error of the four methods. From Figure 2, we observe that the IMM filter diverges after until . The reasons for this is that in the IMM filter the speed is wrongly estimated. This is due to the nonlinearity in the measurements in the maneuvering mode. Compared with IMM, the position RMSE of IMM-IEHF, and IMM-PF also increase to certain extent, but both are less than that of IMM. IEHF improves the degree of approximation of the nonlinear system through iteration and PF can deal with nonlinear filtering problem by describing posteriori density through a series of particles, which achieve better filtering accuracy than EKF. However, IEHF is just a linear approximation for nonlinear system and improvement of filtering accuracy is limited. PF adopts the prior density as the importance density function without considering the latest measurement information. When the target maneuvering and the measurement information change greatly, the particles generated from the function may deviate from the true posteriori density, resulting in a bad filtering performance.

Figure 2: Position RMSE.

The IMM-IEHPF algorithm, however, can deal with target maneuvering and we see that the filter also performs well after until . IEHPF takes advantages of IEHF and PF together in itself. In the filtering process, IEHPF not only considers the latest measurements in the particle sampling process but also reduces the influence of error caused by linearizing measurement model. When these algorithms are directly applied to the IMM framework, posteriori density of each mode is described much more well by IEHPF than EKF, IEHF, and PF. Therefore, the filtering accuracy of IMM-IEHPF is the highest.

To quantitatively analyse the filtering performances of the four methods, Table 1 lists the mean value and variance of position RMSE of each method in different observed bearing standard deviation, which stands for different disturbances of receiver noise and atmospheric. From Table 1, we can see that the mean value and variance of position RMSE of all four methods grow with the increase of the observed bearing standard deviation , nevertheless, which of IMM-IEHPF are less than those of the others (which is in accordance with the analytical results in Figure 2), especially when the bearing standard deviation is considerable high, our proposed method still demonstrates higher tracking precision (i.e., , taking the mean of RMSE as the metric, it reduces by compared with IMM, and compared with IMM-PF).

Table 1: Mean and variance of RMSE under different measurement bearing deviations.

#### 5. Conclusions

This paper has investigated the problem of maneuvering target tracking in the nonlinearities of the dynamic state-space and the non-Gaussian measurement noise. We have presented a new IEHPF method in the IMM framework. The performance of the proposed method is evaluated via simulations and compared with IMM, IMM-IEHF, and IMM-PF, which illustrates that the tracking performance of our proposed method is superior to the others. We have also provided insight into the influence of various bearing standard deviations. Three bearing standard deviations are given for comparing the performance of our proposed method with the other methods. We have found that IMM-IEHPF is weakly sensitive to noise levels. The simulation results have well verified the validity of the proposed method.

This paper only considers a maneuvering target appearing in the scanned region of radar at whole time step. However, in actual radar target tracking, target may disappear at any time step. Therefore in future work, we will study how to construct a suitable model to describe target appearance or disappearance in maneuvering target tracking under a low SNR environment.

#### Acknowledgments

The authors thank the referees for their careful reading, invaluable comments, and suggestions on improving the quality of this paper. This work is supported in part by the National Natural Science Foundation of China under Grant nos. 61179014 and 60872156.

#### References

1. H. A. P. Blom and Y. Bar-Shalom, “Interacting multiple model algorithm for systems with Markovian switching coefficients,” IEEE Transactions on Automatic Control, vol. 33, no. 8, pp. 780–783, 1988.
2. E. Mazor, A. Averbuch, Y. Bar-Shalom, and J. Dayan, “Interacting multiple model methods in target tracking: a survey,” IEEE Transactions on Aerospace and Electronic Systems, vol. 34, no. 1, pp. 103–123, 1998.
3. Z. Wei and S. X. Yang, “Neural network based extended kalman filter for localization of mobile robots,” in Proceedings of the 8th World Congress on Intelligent Control and Automation, pp. 937–942, Taipei, Taiwan, 2011.
4. M. H. Bahari, A. Karsaz, and N. Pariz, “High maneuvering target tracking using a novel hybrid Kalman filter-fuzzy logic architecture,” International Journal of Innovative Computing, Information and Control, vol. 7, no. 2, pp. 501–510, 2011.
5. W. Zou, Q. X. Du, K. Yuan, and J. F. Li, “An attitude tracking method considering acceleration compensation and based on UK,” in Proceedings of the 8th World Congress on Intelligent Control and Automation, pp. 52–57, Taipei, Taiwan, 2011.
6. A. Doucet, S. Godsill, and C. Andrieu, “On sequential Monte Carlo sampling methods for Bayesian filtering,” Statistics and Computing, vol. 10, no. 3, pp. 197–208, 2000.
7. J. Sherrah, B. Ristic, and N. J. Redding, “Particle filter to track multiple people for visual surveillance,” IET Computer Vision, vol. 5, no. 4, pp. 192–200, 2011.
8. A. D. Bimbo and F. Dini, “Particle filter-based visual tracking with a first order dynamic model and uncertainty adaptation,” Computer Vision and Image Understanding, vol. 115, no. 6, pp. 771–786, 2011.
9. S. Aihara, A. Bagchi, and E. Imreizeeq, “Identification of electricity spot models by using convolution particle filter,” International Journal of Innovative Computing, Information and Control, vol. 7, no. 1, pp. 61–72, 2011.
10. M. H. Refan, B. Sareh, and B. Mahdi, “A particle filtering-based framework for on-line fault diagnosis in hybrid systems,” International Journal of Innovative Computing, Information and Control, vol. 6, no. 8, pp. 3669–3680, 2010.
11. S. McGinnity and G. W. Irwin, “Multiple model bootstrap filter for maneuvering target tracking,” IEEE Transactions on Aerospace and Electronic Systems, vol. 36, no. 3, pp. 1006–1012, 2000.
12. Y. Zhai, M. B. Yeary, S. Cheng, and N. Kehtarnavaz, “An object-tracking algorithm based on multiple-model particle filtering with state partitioning,” IEEE Transactions on Instrumentation and Measurement, vol. 58, no. 5, pp. 1797–1809, 2009.
13. T. Sathyan and M. Hedley, “Efficient particle filtering for tracking maneuvering objects,” in Proceedings of the IEEE/ION Position, Location and Navigation Symposium, pp. 332–339, Indian Wells, Calif, USA, May 2010.
14. N. Gordon, S. Makell, and T. Kirubarajan, “Efficient particle filters for joint tracking and classification,” in Signal and Data Processing of Small Targets, vol. 4728 of Proceedings of SPIE, pp. 439–449, 2002.
15. Y. Boers and J. N. Driessen, “Interacting multiple model particle filter,” IEE Proceedings: Radar, Sonar and Navigation, vol. 150, no. 5, pp. 344–349, 2003.
16. R. H. Guo, Z. Qin, X. N. Li, and J. L. Chen, “Interacting multiple model particle-type filtering approaches to ground target tracking,” Journal of Computers, vol. 3, no. 7, pp. 23–30, 2008.
17. S. Maresca, M. Greco, F. Gini, and L. Verrazzani, “Radar tracking of a maneuvering ground vehicle using an airborne sensor,” in Proceedings of the International Radar Conference Surveillance for a Safer World, pp. 1–6, Bordeaux, France, December 2009.
18. H. W. Li and J. Wang, “Particle filter for manoeuvring target tracking via passive radar measurements with glint noise,” IET Radar, Sonar & Navigation, vol. 6, no. 3, pp. 180–189, 2012.
19. M. R. Morelande and S. Challa, “Manoeuvring target tracking in clutter using particle filters,” IEEE Transactions on Aerospace and Electronic Systems, vol. 41, no. 1, pp. 252–270, 2005.
20. L. Hong, N. Cui, M. Bakich, and J. R. Layne, “Multirate interacting multiple model particle filter for terrain-based ground target tracking,” IEE Proceedings: Control Theory and Applications, vol. 153, no. 6, pp. 721–731, 2006.
21. Z. G. Liu and J. K. Wang, “Interacting multiple model gaussian particle filter,” in Proceedings of the 8th World Congress on Intelligent Control and Automation, pp. 270–273, Taipei, Taiwan, 2011.
22. X. L. Deng, J. Y. Xie, and H. W. Ni, “Interacting multiple model algorithm with the unscented particle filter (UPF),” Chinese Journal of Aeronautics, vol. 18, no. 4, pp. 366–371, 2005.
23. B. Hassibi, A. H. Sayed, and T. Kailath, “Linear estimation in Kreĭn spaces. II. Applications,” IEEE Transactions on Automatic Control, vol. 41, no. 1, pp. 34–49, 1996.
24. K. Nishiyama, “Fast and effective generation of the proposal distribution for particle filters,” Signal Processing, vol. 85, no. 12, pp. 2412–2417, 2005.
25. J. Seo, M. J. Yu, C. G. Park, and J. G. Lee, “An extended robust ${H}_{\infty }$ filter for nonlinear constrainted uncertain systems,” IEEE Transactions on Signal Processing, vol. 54, no. 11, pp. 4471–4475, 2006.
26. L. Wu and D. W. C. Ho, “Fuzzy filter design for Itô stochastics systems with application to sensor fault detection,” IEEE Transactions on Fuzzy Systems, vol. 17, no. 1, pp. 233–242, 2009.
27. L. Wu, P. Shi, H. Gao, and C. Wang, “${H}_{\infty }$ filtering for 2D Markovian jump systems,” Automatica, vol. 44, no. 7, pp. 1849–1858, 2008.
28. L. Wu, P. Shi, H. Gao, and C. Wang, “Delay-dependent robust ${H}_{\infty }$ and ${L}_{2}$-${L}_{\infty }$ filtering for LPV systems with both discrete and distributed delays,” IEE Proceedings: Control Theory & Applications, vol. 153, no. 4, pp. 483–492, 2006.
29. L. Wu, Z. Wang, H. Gao, and C. Wang, “${H}_{\infty }$ and ${L}_{2}$-${L}_{\infty }$ filtering for two-dimensional linear parameter-varying systems,” International Journal of Robust and Nonlinear Control, vol. 17, no. 12, pp. 1129–1154, 2007.
30. R. Yang, P. Shi, and G.-P. Liu, “Filtering for discrete-time networked nonlinear systems with mixed random delays and packet dropouts,” IEEE Transactions on Automatic Control, vol. 56, no. 11, pp. 2655–2660, 2011.
31. R. Yang, H. Gao, and P. Shi, “Delay-dependent ${L}_{2}$-${L}_{\infty }$ filter design for stochastic time-delay systems,” IET Control Theory & Applications, vol. 5, no. 1, pp. 1–8, 2011.
32. F. B. Li and X. Zhang, “Delay-range-dependent robust ${H}_{\infty }$ filtering for singular LPV systems with time variant delay,” International Journal of Innovative Computing, Information and Control, vol. 9, no. 1, pp. 339–353, 2013.
33. X. J. Su, P. Shi, L. G. Wu, and Y. D. Song, “A novel approach to filter design for T-S fuzzy discrete-time systems with time-varying delay,” IEEE Transactions on Fuzzy Systems, vol. 20, no. 6, pp. 1114–1129, 2012.
34. M. S. E. Abadi, V. Mehrdad, and M. Norouzi, “A family of set-membership affine projection adaptive filter algorithms,” International Journal of Innovative Computing, Information and Control, vol. 8, no. 2, pp. 1313–1326, 2012.