Research Article | Open Access
Hongjian Wang, Cun Li, "An Improved Gaussian Mixture CKF Algorithm under Non-Gaussian Observation Noise", Discrete Dynamics in Nature and Society, vol. 2016, Article ID 1082837, 10 pages, 2016. https://doi.org/10.1155/2016/1082837
An Improved Gaussian Mixture CKF Algorithm under Non-Gaussian Observation Noise
In order to solve the problems that the weight of Gaussian components of Gaussian mixture filter remains constant during the time update stage, an improved Gaussian Mixture Cubature Kalman Filter (IGMCKF) algorithm is designed by combining a Gaussian mixture density model with a CKF for target tracking. The algorithm adopts Gaussian mixture density function to approximately estimate the observation noise. The observation models based on Mini RadaScan for target tracking on offing are introduced, and the observation noise is modelled as glint noise. The Gaussian components are predicted and updated using CKF. A cost function is designed by integral square difference to update the weight of Gaussian components on the time update stage. Based on comparison experiments of constant angular velocity model and maneuver model with different algorithms, the proposed algorithm has the advantages of fast tracking response and high estimation precision, and the computation time should satisfy real-time target tracking requirements.
With the universality of nonlinear problems, the principle and method of nonlinear filtering are being widely used for the nonlinear systems. One of the applications is target states estimation.
For the currently nonlinear systems, the possible solution approaches are some approximate methods, such as approximating the probability density of system state as the Gaussian density, which is called Gaussian filtering. The Gaussian filtering could sum up three classes according to the different approximate methods: the first is function approximation, which approximates the nonlinear system function using the low-order expansion such as the extended Kalman filtering (EKF)  and the improved algorithms (adaptive fading EKF , strong tracking EKF , and central difference Kalman filtering (CDKF) [4, 5]). The EKF is a suboptimal filter that demands not only that the system has accurate states and accurate observation models but also that the observation noise is Gaussian in nature. However, the Gaussian Hypothesis is poor when the system model is highly nonlinear, and the estimation results are divergent. The CDKF based on Stirling’s polynomial interpolation has better performance including accuracy, efficiency, and stability than EKF for the nonlinear problems but would cause the greater computation burden. The second is deterministic sampling approximation method, which approximates system state and the probability density using deterministic sampling such as the Unscented Kalman Filter (UKF) [6, 7] and the improved algorithms [8, 9]. In principle, the UKF is simple and easy to implement, as it does not require the calculation of Jacobians at each time step. However, the UKF requires updating the matrix with sigma points with weighted negative values, which makes it difficult to preserve the positive definiteness during the iterative filter process. The third is approximation using quadrature, which approximates the multidimensional integrals of Bayesian recursive equation using some numerical technologies, such as the Gaussian-Hermite Kalman Filter (GHKF)  and the Cubature Kalman Filter (CKF) [11–13]. GHKF acquires the statistic characteristics after nonlinear transformation by Gaussian-Hermite numerical integral, which has higher accuracy. The shortcoming of GHKF is that it may not be suitable for addressing the high-dimensional nonlinear filtering issue. The CKF is proposed based on the spherical-radial cubature rule and can solve the Bayesian filter integral problem using cubature points with the same weight. The high-degree CKFs have high accuracy and stability but at a high computational cost.
In actual application on target tracking, the noise of system processes or observations do not have ideal Gaussian density. In addition, the various Gaussian approximate filtering algorithms based on Gaussian noise do not display ideal performance because of the mismatched model. Besides Gaussian filter, other solution approaches for the nonlinear estimation problem involve the particle filter (PF)  based on the Monte Carlo numerical integral theory and sequence importance sampling and Gaussian sum filter [15, 16] based on the mixture of several Gaussian components. Although the PF do not require any assumption about the probability density function, they inevitably face enormous undesirable computational demands owing to the numerous stochastic sampling particles for fulfilling the estimation accuracy. The PF algorithm is unable to avoid the disadvantages of particle degradation and sample dilution; hence, the research on PF is focused on the revolution of particle degradation and sample dilution [17, 18]. A Gaussian sum CKF has been proposed for bearings-only tracking problems in the literature , and this CKF displays comparable performance to the particle filter. An improved Gaussian mixture filter algorithm has been proposed for highly nonlinear passive tracking systems in the literature , and the limited Gaussian mixture model has been used to approximate the posterior density of the state, process noise, and measurement noise. However, in all of these methods, the weights of the Gaussian components are kept constant while propagating the uncertainty through a nonlinear system and are updated only in the stage of measurement update. This assumption is valid if the system is marginally nonlinear or measurements are precise and available very frequently. The same is not true for the general nonlinear case. Terejanu et al. [21, 22] proposed a new Gaussian sum filter by adapting the weights of Gaussian mixture model in case of both time update and measurement update, which could obtain a better approximation of the posterior probability density function.
In this paper, we focus on the target tracking problem on offing and design an improved Gaussian mixture CKF based on the GMCKF algorithm. Firstly, the formulation of target tracking is described, and the observation model with glint noise based on sensor is introduced. Secondly, the derivate steps of IGMCKF based integral square difference and Gaussian mixture density are designed. At last, the comparison experiments of constant angular velocity model and maneuver model with different algorithms are present, respectively.
2. Problem Formulation
Consider the target tracking problem on offing, giving the motion model and observation model:where denotes the target states, including the position and velocity of the target, and denotes the state process noise, which is assumed as Gaussian density with covariance . denotes the observation noise which is assumed as glint noise because of the complicated environment on offing and the characteristics of sensors. The observation noise could be approximated as glint noise which is composed of Gaussian noise and Laplace noise. We modelled the observation noise as 2 Gaussian components with different covariance:where denotes Gaussian noise with mean and covariance . is the glint frequency factor.
Consider that the position of sensor is , and the sensor in this paper is Mini RadaScan; the observation information of the target including distance and bearing is as follows:
3. Design of Improved Gaussian Mixture Cubature Kalman Filter Algorithm
Lemma 1. The probability density function of the -dimension vector can be approximated by the following equation:The approximate error can be arbitrarily small as soon as the number of components is large enough. denotes the weighted value of the th component; denotes the Gaussian distribution with mean and covariance . Consider
3.1. Time Update
Consider that the discrete nonlinear system with Gaussian mixture added noise and the prior and posterior density can be indicated by a Gaussian sum. The process noise and observation noise could be approximated as follows:where denotes the weighted value of the th component of the process noise and is the weighted value of the th component of the observation noise. ConsiderThen, consider that the posterior density can be approximated with a Gaussian mixture model at :We can obtain the prior density of state transition equation by the following equation:According to the Bayesian formula, the predicted state density function can be approximated using a Gaussian mixture model:where . is the set of real numbers, and is the dimension of the state vector. and are the number of Gaussian components of system state and process noise, respectively. and could be calculated by the time update steps of CKF:where is the number of cubature points.
3.2. Adaptive Weight Update
Consider the following nonlinear system (1) with the probability density function of the initial conditions . According to formula (4), the Gaussian mixture approximation of the probability density function is given:The true probability density function of system state by the Chapman-Kolmogorov equation is given:
Mean-square optimal new weights can be obtained by minimizing the following integral square difference between the true probability and the approximation one in the least square algorithm:where denotes the vector of the weights of every Gaussian component at time . In order to resolve formula (17), the cost function is given as follows :where the first term represents the self-likeness of the true probability density function of the system state and . The first term is not needed in the optimization process and it is used only to provide an overall magnitude of the uncertainty propagation error . The second represents the cross-likeness of the true probability and the approximation one, and . The last term is the self-likeness of the approximation probability of the system state, and .
Formula (16) is based on the assumption that the Gaussian mixture approximation is equal to the true probability density function at time ; namely, . Consider
Now the derivation of the terms of cost function is given as follows:Similarly,The elements of the matrix are given as follows:where is the cubature points. Consider
3.3. Measurement Update
Consider the observation equation; the likelihood density of observation equation can be approximated as follows:Then, we can obtain the following equation:where The term in is calculated by the adaptive weight update (21). ConsiderThe estimation of state of Gaussian components is as follows:The Kalman gain is as follows:The covariance and cross covariance are, respectively, as follows:Hence, the output of the filter is as follows:where .
3.4. Merging the Gaussian Components
As we know from (31), the number of Gaussian components is . If , some of the Gaussian components must be merged after the measurement update stage so that the total number of Gaussian components calculated in the next time index can be reduced to .
There is no harm in considering the index of Gaussian components to be , according to their weight values in descending order, such that the Gaussian component with the largest weight value has an index . The Gaussian components with indices are selected first. The other Gaussian components with indices will be merged. The weight value of the th component is as follows:and the mean and covariance are, respectively, as follows:where are the normalised weight values of the Gaussian components to be merged.
4.1. Simulation 1
4.1.1. Simulation Parameter
The proposed algorithm is simulated by Monte Carlo with , the simulation time is , simulation step size is , the covariance of observation noise in (2) is , , , and the glint frequency factor ; the other filter parameters are set as follows:The other parameters are in Table 1.
4.1.2. Simulation Results and Analysis
We compare the performances of GMEKF, GMUKF, GMCKF, and IGMCKF algorithms with the conditions mentioned above. Figure 1 shows the results of the trajectory estimations of the target from the different algorithms versus the truth trajectory. Figure 2 shows the position error of different algorithms, and Figure 3 compares the position errors in direction and direction among the different algorithms.
In Figure 1, the red dotted-dashed line denotes the trajectory of observation station, and the arrow denotes the movement heading.
From Figure 2, it can be observed that the GMEKF and GMUKF have bad stability, and the error can be up to 25 m. The performance improvement of GMCKF is much better, and the error could be up to 13 m. The IGMCKF has the best tracking performance with an error up to 10 m, and the error could be limited to 3 m during stabilization.
From Figure 4, it can be observed that the GMCKF algorithm could track the target velocity after about 30 s, while the other algorithms need about 80 s.
Figure 6 shows the comparison of velocity errors of different algorithms.
Figure 7 shows the comparison of target headings of different algorithms.
The accuracy achieved by the filtering methods was analyzed using the following metrics.
The Root-Mean-Square Error (RMSE) is defined aswhere is the simulation steps and and are the true position and estimated position, respectively, of target at time .
Table 2 gives the NCI, RMSE, and the computing time cost of different tested algorithms.
From Table 2, we can see that IGMCKF has the smallest RMSE which illuminates that the algorithm has the highest precision. The running time of IGMCKF is the longest because IGMCKF needs to update the weight during the time update stage and split the observation noise into several Gaussian components and merge them based on CKF estimating the cubature points. But the running time could satisfy the requirement of real-time target tracking. The NCI of the algorithms except the GMEKF are below 1, which illuminate that the credibility of the various filter algorithms is high.
4.2. Simulation 2
4.2.1. Simulation Parameter
We will compare the performance of proposed algorithm (interacting multiple model CKF, IMMCKF) and interacting multiple model Gaussian mixture CKF (IMMGMCKF) algorithms. The filter parameters are set as follows. The initial position of target is , the initial velocity is , and the acceleration is . The target moves with constant initial velocity in a straight line from 0 s to 100 s. Then it maneuvers and moves with constant acceleration from 101 s to 200 s. From 201 s to 300 s, it moves with constant velocity . From 301 s to 380 s, it maneuvers with constant acceleration , and it moves with constant velocity for the last 20 s.
The observation noise is set the same as simulation 1. Singer model is employed for the IGMCKF algorithm, the state vector is , and other filter parameters are set as follows:
For the IMMCKF and IMMGMCKF algorithms, three models are employed: two constant acceleration models with different acceleration and constant velocity model. The model initial distribution is , and Markov transition matrix is as follows:
4.2.2. Simulation Results and Analysis
The simulation results are obtained from 50 Monte Carlo runs. Figure 8 shows the position trajectory of various algorithms. Figures 9 and 10 denote the RMSE of position tracking in direction and direction, respectively. Figures 11 and 12 denote the RMSE of velocity tracking in direction and direction, respectively.
From the above simulation results and Table 3, it can be seen that the IMMCKF has the worst accuracy of estimation, and because of that the observation noise is modelled as glint noise, and the IMMCKF algorithm is suitable for the Gaussian noise. The IMMGMCKF and IGMCKF have the similar accuracy of estimation and because of that the Gaussian mixture algorithm could deal with the non-Gaussian noise well. The running time of the IMMGMCKF is the longest and because of that the algorithm needs to switch between different motion models. The proposed algorithm has the best estimation accuracy and best computation complexity and could satisfy the real-time target tracking requirement.
An alternative efficient nonlinear filtering algorithm is designed in this paper, which is an improved Gaussian mixture filter within the Cubature Kalman Filter frame. The algorithm could deal with the nonlinear filtering problem with non-Gaussian noise using Gaussian mixture density approximating the observation noise and update the weight adaptively with integral square difference during the time update stage. The feasibility of the algorithm was proven using a simulation based on the target tracking on offing, and the simulation shows that the proposed algorithm has higher estimation precision and faster tracking response.
The authors declare that there are no competing interests.
- Y. Bar-Shalom, X. R. Li, and T. Kirubarajan, Estimation with Applications to Tracking and Navigation: Theory Algorithms and Software, John Wiley & Sons, New York, NY, USA, 2001.
- O. Levent and F. A. Aliev, “Comment on ‘adaptive fading Kalman filter with an application’,” Automatica, vol. 34, no. 12, pp. 1663–1664, 1998.
- D. H. Zhou and P. M. Frank, “Strong tracking filtering of nonlinear time-varying stochastic systems with coloured noise: application to parameter estimation and empirical robustness analysis,” International Journal of Control, vol. 65, no. 2, pp. 295–307, 1996.
- M. Nørgaard, N. K. Poulsen, and O. Ravn, “New developments in state estimation for nonlinear systems,” Automatica, vol. 36, no. 11, pp. 1627–1638, 2000.
- M. Norgaard, K. N. Poulsen, and O. Ravn, Advances in Derivative-Free State Estimation for Nonlinear Systems, Department of Mathematical Modeling, Technical University of Denmark, Kongens Lyngby, Denmark, 2000.
- S. J. Julier and J. K. Uhlmann, “Unscented filtering and nonlinear estimation,” Proceedings of the IEEE, vol. 92, no. 3, pp. 401–422, 2004.
- W. Fan and Y. Li, “Accuracy analysis of sigma-point Kalman filters,” in Proceedings of the Chinese Control and Decision Conference (CCDC '09), pp. 2883–2888, Guilin, China, June 2009.
- X.-X. Wang, L. Zhao, Q.-X. Xia, W. Cao, and L. Li, “Design of unscented Kalman filter with correlative noises,” Control Theory & Applications, vol. 27, no. 10, pp. 1362–1368, 2010.
- W. Xiaoxu, Z. Lin, and P. Quan, “Design of UKF with correlative noises based on minimum mean square error estimation,” Control and Decision, vol. 25, no. 9, pp. 1393–1398, 2010.
- K. Ito and K. Xiong, “Gaussian filters for nonlinear filtering problems,” IEEE Transactions on Automatic Control, vol. 45, no. 5, pp. 910–927, 2000.
- I. Arasaratnam and S. Haykin, “Cubature Kalman filters,” IEEE Transactions on Automatic Control, vol. 54, no. 6, pp. 1254–1269, 2009.
- A. Dhital, Bayesian Filtering for Dynamic Systems with Applications to Tracking, Universitat Politecnica de Ctalunya, Barcelona, Spain, 2010.
- B. Jia, M. Xin, and Y. Cheng, “High-degree cubature Kalman filter,” Automatica, vol. 49, no. 2, pp. 510–518, 2013.
- O. Cappe, S. J. Godsill, and E. Moulines, “An overview of existing methods and recent advances in sequential Monte Carlo,” Proceedings of the IEEE, vol. 95, no. 5, pp. 899–924, 2007.
- D. L. Alspach and H. W. Sorenson, “Nonlinear Bayesian estimation using Gaussian sum approximations,” IEEE Transactions on Automatic Control, vol. 17, no. 4, pp. 439–448, 1972.
- G. Terejanu, P. Singla, T. Singh, and P. D. Scott, “Adaptive Gaussian sum filter for nonlinear Bayesian estimation,” IEEE Transactions on Automatic Control, vol. 56, no. 9, pp. 2151–2156, 2011.
- X. Y. Fu and Y. M. Jia, “An improvement on resampling algorithm of particle filters,” IEEE Transactions on Signal Processing, vol. 58, no. 10, pp. 5414–5420, 2010.
- N. Kabaoglu, “Target tracking using particle filters with support vector regression,” IEEE Transactions on Vehicular Technology, vol. 58, no. 5, pp. 2569–2573, 2009.
- P. H. Leong, S. Arulampalam, T. A. Lamahewa, and T. D. Abhayapala, “A Gaussian-sum based cubature Kalman filter for bearings-only tracking,” IEEE Transactions on Aerospace and Electronic Systems, vol. 49, no. 2, pp. 1161–1176, 2013.
- Y.-B. Kong and X.-X. Feng, “Passive target tracking algorithm based on improved gaussian mixture particle filter,” Modern Radar, vol. 34, no. 7, pp. 44–50, 2012.
- G. Terejanu, P. Singla, T. Singh, and P. D. Scott, “Uncertainty propagation for nonlinear dynamic systems using gaussian mixture models,” Journal of Guidance, Control, and Dynamics, vol. 31, no. 6, pp. 1623–1633, 2008.
- G. Terejanu, P. Singla, T. Singh, and P. D. Scott, “A novel Gaussian sum filter method for accurate solution to the nonlinear filtering problem,” in Proceedings of the 11th International Conference on Information Fusion (FUSION '08), pp. 1–8, Cologne, Germany, July 2008.
- J. L. Williams and P. S. Maybeck, “Cost-function-based Gaussian mixture reduction for target tracking,” in Proceedings of the 6th International Conference on Information Fusion (FUSION '03), pp. 1047–1054, IEEE, Queensland, Australia, July 2003.
- G. Terejanu, “An adaptive split-merge scheme for Uncertainty propagation using Gaussian mixture models,” in Proceedings of the 49th AIAA Aerospace Sciences Meeting including the New Horizons Forum and Aerospace Exposition, Orlando, Fla, USA, January 2011.
- X. R. Li and Z. Zhao, “Measuring estimator's credibility: noncredibility index,” in Proceedings of the 9th International Conference on Information Fusion (FUSION '06), pp. 1–8, IEEE, Florence, Italy, July 2006.
- R. P. Blasch, A. Rice, and C. Yang, Nonlinear Track Evaluation Using Absolute and Relative Metrics, The International Society for Optical Engineering, 2006.
Copyright © 2016 Hongjian Wang and Cun Li. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.