Discrete Dynamics in Nature and Society

Volume 2013 (2013), Article ID 716915, 14 pages

http://dx.doi.org/10.1155/2013/716915

## Adaptive Kalman Estimation in Target Tracking Mixed with Random One-Step Delays, Stochastic-Bias Measurements, and Missing Measurements

School of Automation, Nanjing University of Science and Technology, Nanjing 210094, China

Received 5 November 2013; Accepted 21 November 2013

Academic Editor: Lifeng Ma

Copyright © 2013 Sujuan Chen et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

The objective of this paper is concerned with the estimation problem for linear discrete-time stochastic systems with mixed uncertainties involving random one-step sensor delay, stochastic-bias measurements, and missing measurements. Three Bernoulli distributed random variables are employed to describe the uncertainties. All the three uncertainties in the measurement have certain probability of occurrence in the target tracking system. And then, an adaptive Kalman estimation is proposed to deal with this problem. The adaptive filter gains can be obtained in terms of solutions to a set of recursive discrete-time Riccati equations. Examples in three scenarios of target tracking are exploited to show the effectiveness of the proposed design approach.

#### 1. Introduction

In practical target tracking, the missing phenomenon of the sensor measurement often occurs. For example, the measurement value may contain noise only due to the shelter of the obstacles, a high noise environment, a failure in the measurement, intermittent sensor failures, high maneuverability of tracked target, and so forth. Thus, the estimation for systems with missing measurements has received much attention during the few years. In general, there are two ways to describe the missing phenomenon. One way is to model the uncertainty by using a stochastic Bernoulli binary switching sequence taking on values of 0 and 1 (see, e.g., [1–18] and the references therein). The suboptimal filtering algorithm [2] in the minimum variance sense with only missing measurements has been proposed and the robust filter [14] is designed. In [3] Sinopoli et al. studied the statistical behavior of the Kalman filter error covariance with varying Kalman gain with missing measurements and the existence of a critical value has been shown for the arrival rate of the observations. The stochastic stability of the extended kalman filter with missing measurements is analyzed in [8], while stochastic stability of the unscented kalman filter with missing measurements is studied in [13]. For benchmarking the performance of any estimation algorithm with missing measurements in advance, the modified Cramer-Rao bound (CRLB) and modified Riccati equation have been studied in [1, 15–18]. Another way is to model the uncertainty as a Markovian jumping sequence (see [19–21] and the references therein). The convergence for semi-Markov chains has been studied in [20], where the exponential filter is designed in [21].

For the case of random delayed measurements, the delays will cause performance degradation or instability with traditional Kalman filters. Therefore, a large volume of literature has been published on the topic of filtering problem with delayed measurements; see, for example, [6, 7, 10–12, 22–27]. Most of the publications assume that the delayed measurements are always deterministic. However, it is not often the case in actual target tracking, where the time delays in the measurement may occur in a random way. A stochastic Bernoulli binary switching sequence taking on values of 0 and 1 has been employed to describe the randomly delayed measurements. In such case, the minimum variance suboptimal filter [22, 26] and the robust filter with only delayed measurements [25] are obtained.

For the case of stochastic-bias measurements, a two-stage kalman estimator for state estimation in the presence of random bias and for tracking maneuvering targets is given in [28], while an optimal two-stage kalman filter in the presence of random bias is obtained in [29]. Moreover, optimal and suboptimal separate-bias kalman estimators for a stochastic bias are studied in [30]. The biased bearing-only parameter estimation for bistatic system is studied in [31] and the Cramer-Rao lower bound for biased bearings-only maneuvering target tracking is obtained in [32], where the stochastic-bias phenomenon is described by a stochastic Bernoulli binary switching sequence taking on values of 0 and 1.

Based on the stochastic parameterized description, recently, some suboptimal and optimal filtering algorithms have been proposed for systems with both sensor delays and missing measurements [10–12, 21, 24, 33, 34]. Adaptive kalman filtering [10] is designed mixed with random sensor delays, multiple packet dropouts, and missing measurements. The problem of robust state estimation for two-dimensional stochastic time-delay systems [12] is studied with missing measurements and sensor saturation. An optimal linear filter for discrete-time systems with randomly delayed and lost measurements with/without time stamps is studied in [34]. Up to now, the state estimation problem for systems in target tracking mixed with random one-step delays, stochastic-bias measurements, and missing measurements is seldom reported, which almost exist simultaneously in target tracking. Motivated by the results above, a new mathematical model is developed to describe the random one-step delays, stochastic-bias measurements, and missing measurements using three Bernoulli distributed random variables taking on values of 0 and 1. By state augmentation, it is converted to a stochastic parameterized system. Based on the model, An adaptive kalman estimation is obtained in target tracking via projection theory. The rest of the paper is organized as follows. Section 2 establishes the new system model and introduces the augment state Kalman estimation to deal with the proposed problem. Section 3 presents an adaptive estimation algorithm. In Section 4, simulation results are analyzed and are used to evaluate the proposed algorithm. A summary of our conclusions is given in Section 5.

#### 2. System Model and Problem Formulation

Consider the following stochastic-biased discrete time linear time-varying state-space system with missing measurements: where is the state vector, is the measured output, and and are Gaussian random vectors with zero mean and covariance matrices and , respectively. The bias vector is treated as a zero mean Gaussian random vector with a priori known covariance . and are constant matrices with compatible dimensions. The is a scalar binary Bernoulli distributed random variable taking values which are defined as and . If , the measurement at time is available; otherwise, the measurement is missing; that is, the received observation is only the measurement noise at time . The is a scalar binary Bernoulli distributed random variable taking values which are defined as and . If and , the measurement at time is available and unbiased; else if and , the measurement at time is available but biased.

Assume that the initial state satisfies the mean and covariance conditions: where is the mathematical expectation operator and the superscript is the transpose. The initial state is uncorrelated with , , and .

Next, we will establish a unified model to describe the mixed uncertainties of missing measurements, one-step delay, and stochastic biased measurements by Bernoulli distributed random variables.

Define

A compact representation of the system (1) with mixed uncertainties of missing measurements, one-step delay, and stochastic-biased measurements can be given in an augmented form as follows: where

Further, we have the following statistical information about and :

Let denote the three models corresponding, respectively, to systems with no missing measurement, one-step sensor delay, and missing measurement. They are defined by the following system matrices:(a)current measurement case: (b)one-step random sensor delay case: (c)missing measurement case:

The systems can be represented as follows: where satisfies

Assume that we are able to model the real system at time by analyzing the system. The probability of the system at time is . Obviously, we have .

*Remark 1. *In this paper, the uncertain model subject to missing measurements, one-step delay, and stochastic-biased measurements is considered; that is, the probabilities of the stochastic uncertainties are known. Here the missing measurements are replaced by zeros; that is, the measurement containing only noise is not a valid value. We can examine the “error detection” bits before sending them to the estimator. The delay may be much longer and the receiver (estimator side) cannot know the values without time stamps. Therefore, we cannot have an exact model ; that is, the value of is unknown when the measurement arrives in an estimator. In this case, we need to know the probability of each model .

Define That is, is an estimator vector of .

We can construct an estimator of the following structure:

Define

From (12), we know that is an estimate vector for . Therefore, it is obvious that we can choose and as follows:

The state estimation error covariance is defined by where

In order to obtain the optimal , we can minimize .

#### 3. Estimation Algorithm Mixed with One-Step Sensor Delays, Missing Measurements, and Stochastic-Biased Measurements

In this section, based on the stochastic system models , we will derive the optimal before giving one-step predictions.

From (3) and (14), we can readily have that

Define Substituting (4) and (13) into (19) yields

Observing (7)–(10) and (14), we have the following results:

Furthermore, substituting (21) into (20), we can obtain the following equation:

Noting that , (22) can be rewritten as

Using the statistics of and in (6), the covariance matrix of can be computed by

From (17) and (19), we can easily have

Therefore, the problem of minimizing is equivalent to

Let and left- and right-multiply (24) by and , respectively. The estimation error covariance matrix can be computed by

Differentiate with respect to and set the derivative to zero. We can obtain the optimal as follows:

Therefore the covariance matrices of the estimation error for any (i.e., not necessarily optimal) can be computed by a set of recursive discrete-time Riccati-like equations. The corresponding optimal can be computed by

Let , , and . We may obtain the relevant formula for measurement update as follows: We may propose the following adaptive filtering scheme.

Consider the conceptual algorithm.

*Step 1. *The required input parameters are

*Step 2. *Initialization is as follows:
where we have assumed to derive the above initialization.

Perform the following equations:

*Step 3. *Consider the state prediction

and the prediction covariance computation

*Step 4. *Innovation update is as follows.

If , then . Else if , then

*Step 5. *Update :

Considering error covariance matrix update, perform the following equations:

*Remark 2. *We consider that the model is unknown when the measurement arrives in an estimator. In this case, we need to know the probability of each model. However, we can get an exact model when the measurement with time stamp arrives in an estimator, in which case, we may have an improved adaptive algorithm with time stamp.

#### 4. Simulation Results

In this section, Monte Carlo simulations were conducted to verify the performance of the algorithms in three scenarios of target tracking: uniform rectilinear motion scenario, uniform circular motion scenario, and uniformly accelerated motion scenario. A total of 100 runs were executed in each case.

*(A) Uniform Rectilinear Motion Scenario.* Consider the system (1) with parameters
where is the sampling period, is the Kronecker product, and denotes the unity matrix of 3 orders.

Assume that the initial state of target is , the sampling period is set to be , the probability of stochastic-bias measurement is . The simulation results are obtained by the proposed adaptive estimation algorithm in Section 4. The root mean square error (RMSE) for the states of position and velocity with different is given in Figures 1–4. Seen from Figures 1–4, the proposed adaptive estimation algorithm is effective. Besides, it can be seen from Figure 1 that the tracking performance is better with higher probability when the delay probability is constant, where the black curves denote position and velocity RMSEs, respectively, with detection probability , delay probability , and the probability of missing probability , the green curve with , , and , and the red curve with , , and . Figure 2 gives comparison curves of position RMSE and velocity RMSE, respectively, where the black curves denote position RMSE with , , and , the green curve with , , and , and the red curve with , , and . From Figure 3, it is obvious that the estimation performance is better with lower missing measurement when the detection probability is constant. From Figure 4, we can see that the estimation algorithm has worse performance with a higher delay probability when the probability of missing measurement is constant.

Next, we consider the tracking performances with stochastic-bias probability . Figure 4 gives comparison curves of position RMSE and velocity RMSE with , , and , respectively, where the black curves denote position RMSE and velocity RMSE with , the green curve with , and the red curve with . From Figure 4, we can obtain that the estimation performance is better with lower probability of stochastic-bias measurement.

To further demonstrate the effectiveness of our proposed algorithm, simulation scenarios of uniform rectilinear motion and uniform accelerated motion are given in the following.

*(B) Uniform Rectilinear Motion Scenario.* Consider the system (1) with parameters.
where is the sampling period, is the Kronecker product, and denotes the unity matrix of 3 orders.

Assume that the initial state of target is , the sampling period is set to be , the angular velocity is set to be , and the probability of stochastic-bias measurement is . The simulation results can be obtained as in Figures 5, 6, 7, and 8 in this scenario.

*(C) Uniform Accelerated Motion Scenario.* Consider the system (1) with parameters
where is the sampling period, is the Kronecker product, and denotes the unity matrix of 3 orders. Assume that the initial state of target is , the sampling period is set to be , and the probability of stochastic-bias measurement is . The simulation results can be obtained as in Figures 9, 10, 11, and 12 in this scenario.

From Figures 5–8 in scenario B and Figures 9–12 in scenario C, it is clear that the proposed algorithm is effective. On the other hand, the estimation performance can be influenced by detection probability, one-step delay probability, missing probability, and stochastic-bias probability. Moreover, we have the corresponding results in scenarios B and C as well as in scenario A.

#### 5. Conclusions

This paper presented an adaptive estimation algorithm in target tracking mixed with one-step delayed measurements, stochastic-bias measurements, and missing measurements. The contributions of this paper are as follows. First, the stochastic-bias measurement was incorporated into the proposed adaptive estimation algorithm. Second, the adaptive estimation algorithm mixed with one-step delayed measurements, stochastic-bias measurements, and missing measurements was implemented by augmenting the state vector. Examples and simulations are given to demonstrate the performances of the designed estimator. Through Monte Carlo simulations, the proposed algorithm was shown to be effective. Besides that, all the probabilities of missing measurements, stochastic-bias measurements, and one-step randomly delayed measurements have an influence on the estimation performance. Moreover, the estimation performance can be influenced by stochastic-bias probability. In this paper, we have only considered one-step sensor delays; furthermore, we can obtain the corresponding approach with multiple-step sensor delays by enlarging the state vectors.

#### Acknowledgments

This work was supported by the National Natural Science Foundations of China (nos. 61104186, and 61273076) and the Natural Science Foundation of Jiangsu Province (no. BK2012801) and sponsored by Research and Innovation Project for College Graduates of Jiangsu Province (2011) (no. CXLX11-0261).

#### References

- A. Farina, B. Ristic, and L. Timmoneri, “Cramér-Rao bound for nonlinear filtering with
*P*_{d}< 1 and its application to target tracking,”*IEEE Transactions on Signal Processing*, vol. 50, no. 8, pp. 1916–1924, 2002. View at Publisher · View at Google Scholar · View at MathSciNet - S. Nakamori, R. Caballero-Águila, A. Hermoso-Carazo, and J. Linares-Pérez, “New design of estimators using covariance information with uncertain observations in linear discrete-time systems,”
*Applied Mathematics and Computation*, vol. 135, no. 2-3, pp. 429–441, 2003. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - B. Sinopoli, L. Schenato, M. Franceschetti, K. Poolla, M. I. Jordan, and S. S. Sastry, “Kalman filtering with intermittent observations,”
*IEEE Transactions on Automatic Control*, vol. 49, no. 9, pp. 1453–1464, 2004. View at Publisher · View at Google Scholar · View at MathSciNet - Z. Wang, D. W. C. Ho, and X. Liu, “Variance-constrained control for uncertain stochastic systems with missing measurements,”
*IEEE Transactions on Systems, Man, and Cybernetics A*, vol. 35, no. 5, pp. 746–753, 2005. View at Publisher · View at Google Scholar · View at Scopus - Y. Yang, G. Feng, and J. Ren, “A combined backstepping and small-gain approach to robust adaptive fuzzy control for strict-feedback nonlinear systems,”
*IEEE Transactions on Systems, Man and Cybernetics A*, vol. 34, no. 3, pp. 406–420, 2004. View at Publisher · View at Google Scholar - S. Nakamori, R. Caballero-Águila, A. Hermoso-Carazo, and J. Linares-Pérez, “Recursive estimators of signals from measurements with stochastic delays using covariance information,”
*Applied Mathematics and Computation*, vol. 162, no. 1, pp. 65–79, 2005. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - H. Dong, Z. Wang, D. W. C. Ho, and H. Gao, “Variance-constrained ${H}_{\infty}$ filtering for a class of nonlinear time-varying systems with multiple missing measurements: the finite-horizon case,”
*IEEE Transactions on Signal Processing*, vol. 58, no. 5, pp. 2534–2543, 2010. View at Publisher · View at Google Scholar · View at MathSciNet - S. Kluge, K. Reif, and M. Brokate, “Stochastic stability of the extended Kalman filter with intermittent observations,”
*IEEE Transactions on Automatic Control*, vol. 55, no. 2, pp. 514–518, 2010. View at Publisher · View at Google Scholar · View at MathSciNet - Y. Mo and B. Sinopoli, “A characterization of the critical value for Kalman filtering with intermittent observations,” in
*Proceedings of the 47th IEEE Conference on Decision and Control (CDC '08)*, pp. 2692–2697, Cancun, Mexico, December 2008. View at Publisher · View at Google Scholar · View at Scopus - M. Moayedi, Y. K. Foo, and Y. C. Soh, “Adaptive Kalman filtering in networked systems with random sensor delays, multiple packet dropouts and missing measurements,”
*IEEE Transactions on Signal Processing*, vol. 58, no. 3, pp. 1577–1588, 2010. View at Publisher · View at Google Scholar · View at MathSciNet - Y. Che, H. Shu, and X. Kan, “Estimation for stochastic nonlinear systems with randomly distributed time-varying delays and missing measurements,”
*Mathematical Problems in Engineering*, vol. 2012, Article ID 890512, 15 pages, 2012. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - L. Jinling, W. Zidong, and L. Xiaohui, “Robust state estimation for two-dimensional stochastic time-delay systems with missing measurements and sensor saturation,”
*Multidimensional Systems and Signal Processing*, 2012. View at Publisher · View at Google Scholar - L. Li and Y. Xia, “Stochastic stability of the unscented Kalman filter with intermittent observations,”
*Automatica*, vol. 48, no. 5, pp. 978–981, 2012. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - H. Dong, Z. Wang, and H. Gao, “Distributed filtering for a class of time-varying systems over sensor networks with quantization errors and successive packet dropouts,”
*IEEE Transactions on Signal Processing*, vol. 60, no. 6, pp. 3164–3173, 2012. View at Publisher · View at Google Scholar · View at MathSciNet - R. Niu, P. Willett, and Y. Bar-Shalom, “Matrix CRLB scaling due to measurements of uncertain origin,”
*IEEE Transactions on Signal Processing*, vol. 49, no. 7, pp. 1325–1335, 2001. View at Publisher · View at Google Scholar · View at Scopus - A. Farina, L. Timmoneri, S. Immediata, and B. Ristic, “CRLB with
*P*_{d}< 1 fused tracks,” in*Proceedings of the 8th International Conference on Information Fusion (FUSION '05)*, pp. 191–196, July 2005. View at Publisher · View at Google Scholar · View at Scopus - Y. Boers and H. Driessen, “Results on the modified Riccati equation: target tracking applications,”
*IEEE Transactions on Aerospace and Electronic Systems*, vol. 42, no. 1, pp. 379–384, 2006. View at Publisher · View at Google Scholar · View at Scopus - Y. Boers and H. Driessen, “Modified Riccati equation and its application to target tracking,”
*IEE Proceedings: Radar, Sonar and Navigation*, vol. 153, no. 1, pp. 7–12, 2006. View at Publisher · View at Google Scholar · View at Scopus - H. Zhang, Q. Chen, H. Yan, and J. Liu, “Robust ${H}_{\infty}$ filtering for switched stochastic system with missing measurements,”
*IEEE Transactions on Signal Processing*, vol. 57, no. 9, pp. 3466–3474, 2009. View at Publisher · View at Google Scholar · View at MathSciNet - A. Censi, “Kalman filtering with intermittent observations: convergence for semi-Markov chains and an intrinsic performance measure,”
*IEEE Transactions on Automatic Control*, vol. 56, no. 2, pp. 376–381, 2011. View at Publisher · View at Google Scholar · View at MathSciNet - H. Dong, Z. Wang, and H. Gao, “Distributed ${H}_{\infty}$ filtering for a class of Markovian jump nonlinear time-delay systems over lossy sensor networks,”
*IEEE Transactions on Industrial Electronics*, vol. 60, no. 10, pp. 4665–4672, 2013. View at Publisher · View at Google Scholar - A. Ray, L. W. Liou, and J. H. Shen, “State estimation using randomly delayed measurements,”
*Journal of Dynamic Systems, Measurement and Control*, vol. 115, no. 1, pp. 19–26, 1993. View at Google Scholar · View at Scopus - J. Nilsson, B. Bernhardsson, and B. Wittenmark, “Stochastic analysis and control of real-time systems with random time delays,”
*Automatica*, vol. 34, no. 1, pp. 57–64, 1998. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - Z. Wang, F. Yang, D. W. C. Ho, and X. Liu, “Robust ${H}_{\infty}$ filtering for stochastic time-delay systems with missing measurements,”
*IEEE Transactions on Signal Processing*, vol. 54, no. 7, pp. 2579–2587, 2006. View at Publisher · View at Google Scholar · View at Scopus - F. Yang, Z. Wang, G. Feng, and X. Liu, “Robust filtering with randomly varying sensor delay: the finite-horizon case,”
*IEEE Transactions on Circuits and Systems I*, vol. 56, no. 3, pp. 664–672, 2009. View at Publisher · View at Google Scholar · View at MathSciNet - X. Wang, Q. Pan, Y. Liang, and F. Yang, “Gaussian smoothers for nonlinear systems with one-step randomly delayed measurements,”
*IEEE Transactions on Automatic Control*, vol. 58, no. 7, pp. 1828–1835, 2013. View at Publisher · View at Google Scholar · View at MathSciNet - S. Elmadssia, K. Saadaoui, and M. Benrejeb, “New delay-dependent stability conditions for linear systems with delay,”
*Systems Science and Control Engineering*, vol. 1, no. 1, pp. 2–11, 2013. View at Google Scholar - A. T. Alouani, P. Xia, T. R. Rice, and W. D. Blair, “A two-stage Kalman estimator for state estimation in the presence of random bias and for tracking maneuvering targets,” in
*Proceedings of the 30th IEEE Conference on Decision and Control*, pp. 2059–2062, December 1991. View at Scopus - J. Y. Keller and M. Darouach, “Optimal two-stage Kalman filter in the presence of random bias,”
*Automatica*, vol. 33, no. 9, pp. 1745–1748, 1997. View at Publisher · View at Google Scholar · View at MathSciNet - M. Ignagni, “Optimal and suboptimal separate-bias Kalman estimators for a stochastic bias,”
*IEEE Transactions on Automatic Control*, vol. 45, no. 3, pp. 547–551, 2000. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - B. Xu and Z. Wang, “Biased bearings-only parameter estimation for bistatic system,”
*Journal of Electronics*, vol. 24, no. 3, pp. 326–331, 2007. View at Publisher · View at Google Scholar · View at Scopus - B. Xu, Z. Wu, and Z. Wang, “On the Cramér-Rao lower bound for biased bearings-only maneuvering target tracking,”
*Signal Processing*, vol. 87, no. 12, pp. 3175–3189, 2007. View at Publisher · View at Google Scholar · View at Scopus - X. He and D. Zhou, “Robust $H$-infinity filtering for time-delay systems with missing measurements: a parameter-dependent approach,”
*Journal of Control Theory and Applications*, vol. 5, no. 4, pp. 336–344, 2007. View at Publisher · View at Google Scholar · View at MathSciNet - S. Sun, “Optimal linear filters for discrete-time systems with randomly delayed and lost measurements with/without time stamps,”
*IEEE Transactions on Automatic Control*, vol. 58, no. 6, pp. 1551–1556, 2013. View at Publisher · View at Google Scholar · View at MathSciNet