Abstract

A new sparse Gauss-Hermite cubature rule is designed to avoid dimension explosion caused by the traditional full tensor-product based Gauss-Hermite cubature rule. Although Smolyak’s quadrature rule can successfully generate sparse cubature points for high dimensional integral, it has a potential drawback that some cubature points generated by Smolyak’s rule have negative weights, which may result in instability for the computation. A relative-weight-ratio criterion based sparse Gauss-Hermite rule is presented in this paper, in which cubature points are kept symmetric in the input space and corresponding weights are guaranteed to be positive. The generation of the new sparse cubature points set is simple and meaningful for practice. The difference between our new sparse Gauss-Hermite cubature rule and other cubature rules is analysed. Simulation results show that, compared with Kalman filter with those types of full tensor-product based Gauss-Hermite rules, our new sparse Gauss-Hermite cubature rule based Kalman filter can lead to a substantially reduced number of cubature points, more stable computation capability, and maintaining the accuracy of integration at the same time.

1. Introduction

Bayesian recursive estimation is commonly used in target tracking, positioning, and signal processing [1]. Generally, a Bayesian recursive estimation algorithm requires a state model and a measurement model. The a posteriori density function can describe the behaviour of the estimated state [2]. Since a closed form solution to the Bayesian recursive estimation is available only for a few special cases [3], such as the linear Gaussian system (which leads to the classical standard Kalman filter), a suboptimal solution is a preferable choice in the general case [4, 5]. Ito and Xiong [4] suggest that a local Gaussian filter can be used to approximate the general Bayesian recursive estimation suboptimally. The core problem of local Gaussian filters is in fact a high dimensional Gaussian weighted integration, which has been studied in numerical analysis; see [69] and the references therein. Lots of researches concentrate on the numerical approximation methods to solve the Gaussian weighted integral problem, and different approaches result in different local Gaussian filters, such as the cubature Kalman filter [10], the quadrature Kalman filter [11], and related variants [1214]. Gauss-Hermite filter, introduced by [2, 4], makes use of the Gauss-Hermite quadrature rule and has the highest accuracy among all the above filters. However, it suffers from the curse of dimensionality since the number of cubature points increases exponentially with the dimension of the state.

To avoid the curse of dimensionality, several sparse rules are developed. Smolyak rule [15] is one of the useful tools to generate a small number of cubature points for high dimensional integral. The computational cost does not increase exponentially by using this sparse grid method. Reference [16] compares the approximation accuracies of various sparse grid methods, including trapezoidal rule, Crenshaw Curtis rule, and Gauss Patterson rule. Reference [17] combines Smolyak’s rule and Gaussian Quadrature rule for high dimensional likelihood function in economic models. Jia et al. [18, 19] make a tracking comparison among Smolyak’s rule based Gauss-Hermite filter of different levels and the traditional cubature filters in the context of determination of the spacecraft attitude and the lower-earth orbit satellite orbit. Simulations prove the effectiveness of Smolyak’s rule based Gauss-Hermite filter. Reference [20] proposes the multiple sparse grid Gauss-Hermite filter based on sparse grid Gauss-Hermite filter and state-space partitioning. It is claimed that the computational burden is further reduced with respect to the Gauss-Hermite filter and the sparse grid Gauss-Hermite filter.

However, as Heiss and Winschel [17] mentioned, there exists a potential drawback that some of the cubature points have negative weights, which may result in instability for computation. So we come up with the idea to avoid this potential drawback. In this paper, a classification of full tensor-product Gauss-Hermite cubature points is obtained by using equivalence classification by position permutation and signum function. There exist plenty of cubature points with low weights, which can be deleted from the cubature scheme directly considering a relative-weight-ratio threshold. Comparing with the Smolyak-based rule, our construction of the new Gauss-Hermite rule is simple and practically meaningful. The corresponding weights of the cubature points are all positive; meanwhile, the full symmetry property still remains. There also exist some interesting relationships among the Gauss-Hermite filter, the 3rd embedding cubature filter, the sparse Gauss-Hermite filter, and the Unscented Kalman filter.

The remainder of this paper is organized as follows: In Section 2, a brief review of the nonlinear system and its Bayesian recursive estimation framework is presented. In Section 3, a cycle of general local Gaussian filter is presented, which offers six kinds of Gaussian weighted integrals. This leads to various specific local Gaussian filters by various choice of the cubature points set and the corresponding weights. In Section 4, a full tensor-product Gauss-Hermite integral cubature rule is presented. By introducing a simple and elegant operator, the full tensor-product based cubature points can be divided into different categories. A small set of positive weighted cubature points is generated by a threshold of relative-weight-ratio. Relationships between the new sparse Gauss-Hermite filter and the traditional cubature filters are analysed as well. In Section 5, a typical Bearing-Ranging tracking problem with a general 2D manoeuvring target motion is demonstrated to test the performance of our new sparse Gauss-Hermite filter. Some conclusions are given in Section 6.

2. Bayesian Recursive Estimation Algorithm

Consider the following discrete nonlinear system:

where (1) and (2) are the motion model and the measurement model of the system, respectively; is the state of the system and is the measurement; is the process noise and is the measurement noise. is independent with and . By the discrete time Chapman-Kolmogoroff equation,where . By the Bayesian formula,where . Equations (3) and (4) are the time update formula and the measurement update formula. Figure 1 shows the recursive Bayesian estimation algorithm. When is obtained, we can estimate the state and its covariance matrix by minimizing the mean square error. The results are presented as follows:However, when becomes an arbitrary probability density distribution, it is difficult to calculate the high dimensional integrations in (5) directly. A suboptimal way is to place normal distributions on , , and ; thus the first-order moment and second-order moment can be used to describe the posterior probability. In other words, at time epoch , the posterior density isAt time epoch , the predicted probability density of the state isCorrespondingly, the posterior density of the state is

3. Local Gaussian Filter

Section 2 points out that, under the Gaussian assumption, the first-order moment and second-order moment can be used to describe the property of the state. Hence, a suboptimal local Gaussian filter algorithm can replace the Bayesian recursive estimation (3) and (4). Details of general Gaussian filter can be found in [4].(1)Time update.(i)Prediction of state :(ii)Prediction of covariance matrix given state :(2)Measurement update.(i)Prediction of measurement :(ii)Covariance matrix given : (iii)Covariance matrix between state and measurement :(iv)Gain of the filter:(v)State update and its covariance matrix :

We can see that (9), (10), (14), and (15) are similar to those corresponding formulae of standard Kalman filter. The only difference between local Gaussian filter and standard Kalman filter is the calculation of , , , , and . For standard Kalman filter, there exist specific formulae, while for the local Gaussian filter, numerical approximation methods need to calculate the higher dimensional integrals. A general high dimensional integral with Gaussian type weighting function can be expressed as follows:Suppose that , where is a lower triangular matrix. By a linear transform , we can get thatVarious methods can approximate (17), such as the spherical radial integral rule [7, 21], Gauss-Hermite rule [2], central differential rule [4], Stochastic Integral Rule [22], Gaussian localized cumulative distribution rule [23], and Smolyak rule based sparse grid rule [18]. All of them use specific ways to generate and their corresponding weights , where is the number of cubature points set.

Remark 1. Generally, the choice of has no relationship with the estimation of state and its covariance matrix , but uniquely determined by the specific cubature integral rule. In fact, almost all cubature rules based can be computed and stored offline.

4. Sparse Gauss-Hermite Integral Rules

4.1. Symmetry Set Based on Full Position Permutation

Definition 2. In order to utilize the symmetry property of the cubature points, is introduced to achieve a more concise denotation of the cubature points set. Denote as a nonnegative seed; we have its corresponding seed vector as a -dimensional vector , where is the state dimension. Then we have , where means that the set of elements consists of the full permutation vectors of the seed vector and is generated by randomly setting one or several nonzero values to their opposites in .

Let the state dimension be and take as an example, where is the seed. Since two values are given, then the -dimensional seed vector is . It has total full permutation, so has elements. For simplicity, suppose ; then has elements, which is presented as the following set:

Remark 3. With the help of full position permutation, it becomes much easier to describe the cubature points set . Furthermore, it brings some interesting properties for the cubature points.

4.2. Full Tensor-Product Based Gauss-Hermte Integral Rule

The classical one-dimension Gauss-Hermite rule can be easily obtained according to [24]. Table 1 presents us with cubature points set and corresponding weights from orders to . Here the order also represents the number of cubature points in each dimension. We can see that the points and weights are both symmetric in . For details about the construction of Gauss-Hermite quadrature points, one can refer to [25]. Furthermore, [26] provides a better and more stable way to construct cubature points and weights than moment matching method.

For dimension integral problem, a full tensor-product based Gauss-Hermite rule can be obtained directly by the following formula [2]:As mentioned above, is the dimension of the state, is the number of the cubature points for each dimension, and as presented in (19). Each point of the cubature set is a -dimensional vector; that is, . The weight of point can be calculated as . For example, let and ; we can easily get the cubature points and the corresponding weights as follows:Recall Definition 2; the cubature points in (20) can be categorized as three sets ; that is,and the weights can be summarized as three types as well: The number of each category can be easily computed asThe total number of cubature points . Equations (21), (22), and (23) show that such a classification is an equivalent notation of the full tensor-product rule. Now suppose that remains unchanged; we would like to consider the general case of dimension. According to Definition 2, there exist categories. The corresponding , , and the number of each category are shown as follows:

The total number of cubature points . It also shows that such an expression is another form of the full tensor-product based rule. When the dimension of state increases, the number of cubature points increases exponentially with . The curse of dimensionality limits the usage of Gauss-Hermite integral rule.

Now, we are going to give the cubature points set and their corresponding weights with . It can be easily conducted that when , there is only one cubature point; that is, , and its weight is . When , we can refer to Table 1 to find that there is only one nonnegative value (i.e., 1), so there exists only one category as well: When , it is interesting to find that the GHKF is similar to the 3rd embedding cubature Kalman filter [27]. We will elaborate their connections in the following Remark.

Remark 4. The main difference between GHKF and the 3rd embedding cubature Kalman filter is the central point and its weight utilized. The classical standard 3rd cubature rule based on spherical radial rule [10, 28], whose cubature points set is , may exceed the range of state. Both the GHKF and the 3rd embedding cubature rule are stable for high dimensional integral rule. However, since the number of cubature points in 3rd embedding cubature Kalman filter is , we still face the threat of dimension explosion when dealing with high dimensional system.

When , there still exists type of category which is analogous to the case . Here we can simply regard as of case only to remember that is positive. We have and   according to Table 1. The total number of cubature points becomes . More specifically, the cubature points set , the corresponding weights , and the number for each category are shown as follows:where . It can be seen that the number of each cubature category has a factor , which will result in the dimension explosion as well.

When , the total number of cubature points is . It can be classified as follows:The corresponding weights are presented aswhere . , . We can calculate the number of each category to obtain the following equations:Here we can see that, for , the number of each category has a factor , so those cubature points sets are not a good choice for the high dimensional system. However, the number of each category is a polynomial of the dimension of state when . In the face of the dimension explosion, it is rather tempting that we can just choose several categories to approximate the high dimensional integration. We have introduced the relative-weight-ratio as a criterion to achieve this goal. Detailed analysis is presented in the following subsection.

4.3. Sparse Gauss-Hermite Rule Based on Relative-Weight-Ratio

Take as an example and recall (21) and (22) which present the cubature points set and corresponding weights set, respectively. The relative-weight-ratio between category and category can be easily obtained:Equation (30) shows that as the subindex of the cubature points set increases, the decreases exponentially. It indicates that when considering a certain degree of accuracy, there is no need to use all Gauss-Hermite cubature points. When a threshold value is settled, only the categories satisfying will be sufficient for the high dimensional integral. For example, set ; then we haveAccording to the criterion, the categories including , , , and are enough to approximate the integral. The total number of the cubature points isThe number of cubature points has a polynomial relationship with the dimension of state. If we set threshold value as , the remaining categories will become , , and . The corresponding number of the cubature points is

Remark 5. By setting the ratio threshold , most low weighted cubature points will be eliminated. Such a strategy can efficiently eliminate the problem of dimension explosion when dealing with high dimensional system. Bear in mind that since lots of low weighted cubature points are eliminated, the sum of remaining points’ weights does not equal to 1. We can deal with this problem by renormalizing the remaining weights and meanwhile maintaining the relative-weight-ratio. Unlike the Unscented Transform rules [29] or the higher order spherical radial rule cubature rule [28], our transformation keeps all weights positive.

Remark 6. When , considering and as selected cubature points, the total number is which equals the number of the UKF with parameter [29]. The difference lies in the determination of weights of the cubature points. In the context of sparse GHKF, the weight of is . However under the background of UKF, the weight becomes . Similarly, we have weights of as and for sparse GHKF and UKF, respectively. When dimension , the weight of becomes negative in the UKF context, which is a potential unstable factor for integral approximation. The sparse Gauss-Hermite cubature points for can also be obtained by repeating the above discussed process with a preset relative-weight-ratio. Comparing with , the weight of the former category is larger than the latter one.

5. Numerical Investigation

In this section, a Nearly Constant Turning (NTC) manoeuvring target model is settled to verify the tracking performance of our new sparse Gauss-Hermite Kalman filter. NCT model is commonly used in aircraft flying control. We consider the 2-dimensional movement. Suppose the unknown turning rate is . Since is unknown, the NCT model is a time-varying nonlinear model [10]. The discrete state model can be settled as follows:where . and represent the position and velocity of axis , respectively. and represent the position and velocity of axis , respectively. is the sampling time interval. is the turning rate at time epoch . The corresponding process noise , where can be rewritten as follows:

and   represent the Power Spectrum Density for positions and . is the Power Spectrum Density of the turning rate. Suppose that the sensor platform is settled at the origin points. Bearing-Ranging measurement is used for the target tracking. The measurement equation can be expressed as follows:where is the measurement noise, which satisfies the Gaussian distribution with zero mean. The corresponding covariance matrix can be expressed as follows:The corresponding parameters are settled by Table 2 [10].

We set the initial state of the target as Then the corresponding covariance matrix of the initial state isThe estimate of initial state of the filter is randomly generated by the distribution . Our new sparse Gauss-Hermite Kalman filter with the cubature sets is used in the experiment. In order to make a reliable comparison between different filters, we implement our experiment with the (5th) CKF [28], full tensor-product based Gauss-Hermite Kalman filter () [2], and Smolyak rule based sparse Gauss-Hermite Kalman filter [18] .

The above experiment is repeated 100 times independently. Root mean square errors , , and are used to evaluate the tracking performance of the position, velocity, and the turning rate. The detailed formulations are shown as follows: Similarly, CRMSE are used to evaluate the average tracking performance:

where represents the th estimate element of state at time epoch for the th experiment. represents the th theoretical element of state at time epoch for the th experiment. represents the Monte Carlo experiment times. represents the state number of each experiment. We set . in this experiment. For a single simulation experiment, the tracking performance is shown in Figures 2, 3, and 4. For repeated experiments, the tracking performance is shown in Figures 5, 6, and 7. The CRMSEs of different filters are shown in Table 3.

From Table 3, it can be seen that the full tensor-product based Gauss-Hermite filter and the (5th) CKF have almost exactly the same tracking performance, while the Smolyak-based sparse Gauss-Hermite filter has relatively lower tracking accuracy. The new sparse Gauss-Hermite filter has better tracking accuracy comparing with sparse Gauss-Hermite filter and has less tracking accuracy comparing with the full tensor-product based Gauss-Hermite filter and the (5th) CKF. Our new sparse Gauss-Hermite filter is a good choice to track this manoeuvring target problem with a relative sparse cubature points set where all corresponding weights are kept positive. Furthermore, our method burdens low computational costs and maintains stable numerical accuracy.

6. Conclusion and Discussion

Gauss-Hermite cubature rule is an effective way to approximate nonlinear Gaussian weighted type integral. However, the full tensor-product based Gauss-Hermite cubature rule may cause a dimension explosion and is rarely helpful for high dimensional case. Smolyak rule based sparse Gauss-Hermite cubature rule is a way to generate small cubature set by specific generation design, which has a potential drawback that some cubature points may have negative weights. This novel Gauss-Hermite rule is easily generated by using our notation in Definition 2 to classify the full tensor-product based Gauss-Hermite cubature points. Based on a proper relative-ratio-weight criterion, a sparse cubature set is regenerated. Simulations show that our sparse Gauss-Hermite rules will have comparable accuracy with the full tensor-product based Gauss-Hermite filter and higher precision comparing with Smolyak’s rule based Gauss-Hermite filter. Furthermore, our method can lead to a substantially reduced number of cubature points and a more stable high dimensional integration. Our method can maintain accuracy of integration at the same time and could be a good choice for practice problems in engineering.

Disclosure

The views and opinions expressed in this paper are those of the authors and do not necessarily reflect the official policy or position of the iGMAS.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this paper.

Acknowledgments

This work is supported by the iGMAS (international GNSS Monitoring and Assessment Service) and the Natural Science Foundation of China (no. 61573367).