Recursive Estimation for Dynamical Systems with Different Delay Rates Sensor Network and Autocorrelated Process Noises

Feng, Jianxin

doi:https://doi.org/10.1155/2014/404907

Mathematical Problems in Engineering

On this page

Abstract Introduction Conclusions References Copyright Related Articles

Special Issue

Mathematical Modeling, Analysis, and Advanced Control of Complex Dynamical Systems

View this Special Issue

Research Article | Open Access

Volume 2014 | Article ID 404907 | https://doi.org/10.1155/2014/404907

Recursive Estimation for Dynamical Systems with Different Delay Rates Sensor Network and Autocorrelated Process Noises

Jianxin Feng¹

Academic Editor: Rongni Yang

Received11 Nov 2013

Revised17 Jan 2014

Accepted30 Jan 2014

Published19 Mar 2014

Abstract

The recursive estimation problem is studied for a class of uncertain dynamical systems with different delay rates sensor network and autocorrelated process noises. The process noises are assumed to be autocorrelated across time and the autocorrelation property is described by the covariances between different time instants. The system model under consideration is subject to multiplicative noises or stochastic uncertainties. The sensor delay phenomenon occurs in a random way and each sensor in the sensor network has an individual delay rate which is characterized by a binary switching sequence obeying a conditional probability distribution. By using the orthogonal projection theorem and an innovation analysis approach, the desired recursive robust estimators including recursive robust filter, predictor, and smoother are obtained. Simulation results are provided to demonstrate the effectiveness of the proposed approaches.

1. Introduction

The Kalman filter is very popular for estimating the system states of a class of linear systems which are characterized by state-space models. Since its inception in the early 1960s, it has played an important role in the research fields of target tracking, communication, control engineering, and signal processing. An implied assumption of traditional Kalman filter is that the system model and measurement model are exactly known. Unfortunately, this assumption does not always hold due to the constrained knowledge and the variation of the system and environment. When the system model and measurement model under consideration are not exactly known, the performance of traditional Kalman filter can deteriorate appreciably [1–3]. Therefore, in the past decades, the recursive robust state-space estimation problem has become a hot topic of the estimation theory. There are many different ways to describe the model uncertainty. Multiplicative noise is an important stochastic uncertainty which is commonly encountered in aerospace systems [4], communication systems [5], and image processing systems [6, 7]. Different from the additive noise, the second-order statistics of the multiplicative noise are usually unknown and this property leads to more difficulties in the research. Up to now, there are several solutions to treat with the estimation and control problems for systems with multiplicative noises, including linear matrix inequality approach [8], Riccati equation approach [9, 10], and game-theoretic method [11], to name just a few.

In traditional state estimation theory, the process noises are usually assumed to be Gaussian and uncorrelated with each other. However, this assumption is not always realistic, correlated noises are commonly encountered in practical applications. For example, in a target tracking system, the system state is usually consecutive (i.e., the system state at time is correlated with its neighbors); thus, when the process noises are dependent on the system state, the process noises are usually autocorrelated across time. So far, there have been several approaches to deal with the estimation problem for systems with correlated noises [12–16]. The optimal Kalman filtering fusion problem for dynamic systems with cross-correlated measurement noises has been dealt with in [13–15]. In [16], the state estimation for discrete-time systems with cross-correlated noises has been treated based on an optimal weighted matrix sequence, where the process noises and measurement noises are cross correlated. It should be pointed out that the estimators mentioned previously are only suited for the correlated noises at the same time instant. In [17, 18], a Kalman-type recursive filter has been proposed for dynamic systems with finite-step autocorrelated process noises, where the autocorrelation property is described by the covariances between different time instants. The filtering problem with finite-step cross-correlated process noises and measurement noises has been investigated in [19]. In [20], the optimal robust nonfragile Kalman-type recursive filter has been designed for a class of uncertain systems with finite-step autocorrelated noises.

On another research frontier, with the development of network technologies, the sensor network has attracted increasing attention from many researchers in different fields due to their wide scope applications in surveillance, environment monitoring, information collection, wireless networks, robotics, and so on. In the sensor network, the network-induced time-delay or/and packet dropouts cannot be avoided due to limited single-sensor energy and communication capability and these have brought us new challenges in the design of the desired state estimators. The binary switching sequence is a popular way to describe the network-induced time-delay or/and packet dropouts since the time-delay or/and packet dropouts in the sensor network are inherently random [21–24]. The least-mean-square filtering problem for one-step random sampling delay has been studied in [25, 26]. Unfortunately, the filters designed in [25, 26] are suboptimal since a colored noise due to augmentation has been treated as a white noise. The filtering problem for systems with random measurement delays and multiple packet dropouts has also been discussed in [24]. In [27], the problem of robust filtering for uncertain systems with missing measurements and finite-step correlated process noises has been investigated. It should be noted that, in all the aforementioned literature, sensors involved in the sensor network have the same delay characteristics. Recently, Hounkpevi and Yaz [28, 29] present minimum variance state estimators for multiple sensors with different delay or failure rates. The least-square filtering problem for systems with one- or two-step random delay has been studied in [30], where the algorithms are derived without requiring the knowledge of the state space model but only the means and covariance functions of the processes involved in the observation equations. The optimal unbiased filtering problem for uncertain systems with different delay rates sensor network and autocorrelated process noises has also been discussed in [31]. However, the estimator obtained in [31] is nonrecursive and a colored noise due to augmentation has been treated as white noise. Up to now, to the best of the authors' knowledge, the recursive robust estimation problem has not yet been addressed for uncertain systems with different delay rates sensor network and autocorrelated noises, and this situation motivates our current study.

Motivated by the above analysis, in this paper, we aim to investigate the recursive robust estimation problem for uncertain systems with different delay rates sensor network and autocorrelated noises. The system model and measurement model under consideration are both subject to stochastic uncertainties or multiplicative noises. Different sensors in the sensor network have different delay rates and different delay rates are described by different binary switching sequences. The process noises are assumed to be one-step autocorrelated across time and the autocorrelation property is described by the covariances between different time instants. Based on an innovation analysis approach (IAA) and the orthogonal projection theorem (OPT), recursive robust estimators including filter, predictor, and smoother are obtained. This paper extends the results in [31], in two directions: the autocorrelated measurement noise due to augmentation leads to more difficulties in the design of the recursive robust estimators; however, in [31], the measurement noise is treated as a white noise; and the filter obtained in [31] is actually a nonrecursive filter; however, in our current work, we do not only derive a recursive robust filter, but also derive a recursive robust predictor and a recursive robust smoother. Also, the current paper differs from [28, 30] for the model uncertainties considered and for the autocorrelated process noises considered to derive the desired recursive robust estimators.

The remainder of the paper is organized as follows. In Section 2, the recursive robust estimation problem is formulated for a class of uncertain systems with autocorrelated noises and different delay rates sensor network. The recursive robust estimators including filter, predictor, and smoother are derived in Section 3. In Section 4, a simulation example is provided to illustrate the usefulness of the theory developed in this paper. We end the paper with some concluding remarks in Section 5.

Notation. The notation used in the paper is fairly standard. The superscript “” stands for matrix transposition, the notation denotes the -dimensional Euclidean space, the notation is the set of all real matrices of dimension , and and represent the identity matrix and zero matrix, respectively. The notation means that is real symmetric and positive definite, and stands for block-diagonal matrix. The notation is the Kronecker delta function, which is equal to unity for and zero for . In addition, means mathematical expectation of and represents the occurrence probability of the event “”. Matrices, if their dimensions are not explicitly stated, are assumed to be compatible for algebraic operations.

2. Problem Formulation

Consider the following system model and measurement model: where is the state to be estimated, the vector is the actual output vector of the th sensor, the vector is the measured output vector of the th sensor, the vector is the process noise, the vectors and are multiplicative noises, the vector is the measurement noise of the th sensor, the matrices , , , , and are known real time-varying matrices of appropriate dimensions, and the variable is a mutually uncorrelated binary switching sequence (and uncorrelated with other random variables) taking values on 1 and 0 with

Remark 1. The measurement model (1) is a popular way to model the random sensor delay. It can be seen that if then which means that the measurement of the th sensor is delayed; if , then ; that is to say, the measurement of the th sensor is up to date.

The noise signals , , and are all zero-mean Gaussian white noises. They, together with the initial state and the process noise , have the following statistical properties: where , .

By defining where a compact representation of (1) can be expressed as follows: where is the measurement noise of the newly obtained auxiliary system (6) and (7). It follows readily from (4) that has the statistic properties as follows:

Remark 2. It can be seen from (3) and (8) that the process noise and the measurement noise are both one-step autocorrelated across time. For example, the process noise at time is correlated with the process noises at times and with covariances and , respectively. The measurement noise at time is correlated with the measurement noises at times and with covariances and , respectively.

Remark 3. Observe that the system model and measurement model of system (6) and (7) are both subject to stochastic uncertainties and , , and involve the stochastic variable . Thus, system (6) and (7) is actually a stochastic uncertain system. On the other hand, the process noise and the measurement noise are both one-step autocorrelated across time. Therefore, the traditional recursive robust estimation approaches may not satisfy the performance requirements here.

Remark 4. A seemingly natural way of handling the autocorrelated noises is the augmentation of the system states. However, such a state augmentation approach gives rise to significant increase in the system dimension, which would inevitably lead to computational burden. In addition, in the state augmentation method, the noises are treated as components of the auxiliary system state, generally, it is difficult for an estimator to track noise signals, and this will affect the estimation of other components of the auxiliary system state. Without resorting to state augmentation, in our current work, we treat system (6) and (7) directly by using an IAA and the OPT.

3. The Main Results

For convenience of later development, let us introduce the following lemmas, which are very useful in establishing our main results.

Lemma 5. For stochastic matrices , , , and , one has the following results:

Proof. Lemma 5 follows directly from (2), (4), and (5) and the fact that is zero mean.

Lemma 6. For system state and the process noise , one has the following result:

Proof. Lemma 6 follows directly from (3) and (6).

Lemma 7. The state covariance matrix has the following recursion:

Proof. Lemma 7 follows directly from (3), (6), and Lemma 6.

Furthermore, defining and , one has from (4) and Lemma 7 the following:

Lemma 8 (see [32]). If is a real matrix and is a diagonal stochastic matrix, then where is the Hadamard product (this product is defined as .

3.1. Recursive Robust Filter

Theorem 9. For the addressed system (6) and (7), one has the following recursive robust filter: where is the innovation with covariance , the matrix is the covariance between and , the vectors and are the filter and one-step predictor, and the matrices and are the filter error covariance and one-step prediction error covariance. The initial values are , , and .

Proof. Please see Appendix A.

Remark 10. In the traditional recursive estimation problem, the innovation is calculated as . However, due to possible sensor delay which occurs in a random way, this is not true for the problem at hand; thus, we have to recalculate the innovation as in (16). Furthermore, it can be seen that the second term on the right-hand side of (14), the last four terms on the right-hand side of (15), the second term of the right-hand side of (17), and the last ten terms on the right-hand side of (18) are caused by the random delays, the stochastic uncertainties, and autocorrelated noises. These terms constitute the main differences between our work and the traditional Kalman filter.

Next, we will derive the recursive robust predictor and recursive robust smoother based on Theorem 9.

3.2. Recursive Robust Predictor

Theorem 11. For the addressed system (6) and (7), one has the following -step recursive robust predictor: where the initial values and can be calculated as in Theorem 9.

Proof. Please see Appendix B.

3.3. Recursive Smoother

Theorem 12. For the addressed system (6) and (7), one has the following robust recursive -step () fixed-lag smoother: where the initial values , , and are supplied by Theorem 9.

Proof. Please see Appendix C.

4. An Illustrative Example

Consider the following uncertain system with different delay rates sensor network and autocorrelated process noises: where is the state to be estimated. The vectors , , , and are zero-mean Gaussian white noises with covariances , , , and , respectively. Without loss of generality, the process noise is chosen to be as defined in (23).

In the simulation, the initial value has mean and covariance . The variables are binary switching sequences taking values on with and , respectively, and the matrices are set as , , , and . The newly obtained recursive robust estimators and the filter of Zeng et al. [31] are compared in the simulation. Let MSE1 denotes the mean-square error for estimation of the first component of ; that is, , where is the number of the samples. Similarly, MSE2 denotes the mean-square error for estimation of the second component of ; that is, .

From Figures 1 and 2, we can see that the smoother has the best performance and the predictor has the worst performance. This is due to the fact that smoother uses the most measurement information and the predictor uses the least measurement information.

From Figures 3 and 4, we can see that the filter developed in this work has better performance than the filter of Zeng et al. [31]. This is due to the fact that the autocorrelated measurement noise was treated as zero-mean Gaussian white noise in the filter of Zeng et al. [31].

5. Conclusions

In this paper, we have studied the recursive robust estimation problem for a class of uncertain systems with autocorrelated process noises and different delay rates sensor network. The system model and measurement model are both subject to stochastic uncertainties. The process noises are one-step autocorrelated across time. Each sensor in the sensor network has a different delay rate and the delay rate has been described by an individual binary switching sequence obeying a conditional probability distributed. Based on an IAA and the OPT, recursive robust estimators including filter, predictor, and smoother have been obtained. Simulation results have indicated that the smoother has the best performance and the predictor has the worst performance, and the filter obtained in this work has better performance than the filter of Zeng et al. [31].

Appendices

A. The Proof of Theorem 9

Proof. Using the OPT, the one-step measurement prediction can be calculated as follows: Taking into account the fact that is one-step autocorrelated, we have from (4), (8), and (9) the following: Substituting (A.2) into (A.1), we have Therefore, the innovation can be calculated as follows: where .
Again, according to the OPT, the state prediction can be obtained as follows: Taking (3) into consideration, the expectation can be calculated as follows: Substituting (A.6) into (A.5), we have Therefore, the one-step prediction error can be calculated as follows: where is the filter error at time instant . Taking into account the fact that is one-step autocorrelated across time and is uncorrelated with other signals, the one-step prediction error covariance can be calculated as follows: where the expectation can be calculated as in (A.6) and expectation can be obtained as follows: where the third equality in (A.10) holds since is one-step autocorrelated across time. Substituting (A.10) into (A.9) yields (15).
Noting the fact that is orthogonal to , we have from (9) and (A.4) the following:
It implies from (9), (A.4), and Lemmas 5 and 8 that the expectation can be obtained as follows: where the remaining expectations can be obtained as follows: where Lemmas 5–8 have been used. Substituting (A.13) into (A.12) yields to (18).
Again, by using the OPT, the state estimation can be calculated as follows: Therefore, the estimation error can be obtained as follows: From (A.15), the estimation error covariance can be calculated as follows: where the remaining expectation can be calculated as follows: Substituting (A.17) into (A.16), we have which completes the proof of Theorem 9.

B. The Proof of Theorem 11

Proof. Taking into account the fact that the process noise is one-step autocorrelated across time, the -step prediction can be calculated as follows: Therefore, the -step prediction error can be obtained as follows: Thus, the -step prediction error covariance can be calculated as follows: which completes the proof of Theorem 11.

C. The Proof of Theorem 12

Proof. According to the OPT, the -step fixed-lag smoother can be calculated as follows: where can be calculated as follows: where the third equality holds since , , and are zero-mean stochastic matrices and they are all uncorrelated with . From (A.8) the expectation can be obtained as follows: Similarly, when , the expectation can be calculated as follows: From (6) and (C.1), the smoother error can be obtained as follows: Therefore, the smoother error covariance can be obtained as follows: which completes the proof of Theorem 12.

Conflict of Interests

The author declares that there is no conflict of interests regarding the publication of this paper.

Acknowledgment

This work was supported by the National 973 Program of China (Grant no. 973-61334).

References

A. H. Sayed, “A framework for state-space estimation with uncertain models,” IEEE Transactions on Automatic Control, vol. 46, no. 7, pp. 998–1013, 2001.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
H. Gao, X. Meng, and T. Chen, “A new design of robust $H_{2}$ filters for uncertain systems,” Systems & Control Letters, vol. 57, no. 7, pp. 585–593, 2008.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
T. Miyata and N. Aikawa, “A design of FIR filters with variable notches considering reduction method of polynomial coefficients for real-time signal processing,” International Journal of Innovative Computing, Information and Control, vol. 9, no. 9, pp. 3527–3536, 2013.
View at: Google Scholar
V. S. Kouikoglou and Y. A. Phillis, “Trace bounds on the covariances of continuous-time systems with multiplicative noise,” IEEE Transactions on Automatic Control, vol. 38, no. 1, pp. 138–142, 1993.
View at: Publisher Site | Google Scholar | MathSciNet
J. Y. Tourneret, M. Doisy, and M. Mazzei, “Bayesian estimation of abrupt changes contaminated by multiplicative noise using MCMC,” in Proceedings of the IEEE Workshop Higher Order Statistics, pp. 1148–1152, 1999.
View at: Google Scholar
Y. S. Hung and H. T. Ho, “A Kalman filter approach to direct depth estimation incorporating surface structure,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 21, no. 6, pp. 570–575, 1999.
View at: Publisher Site | Google Scholar
A. M. Tekalp and G. Pavlovic, “Image restoration with multiplicative noise: Incorporating the sensor nonlinearity,” IEEE Transactions on Signal Processing, vol. 39, no. 9, pp. 2132–2136, 1991.
View at: Publisher Site | Google Scholar
L. El Ghaoui, “State-feedback control of systems with multiplicative noise via linear matrix inequalities,” Systems & Control Letters, vol. 24, no. 3, pp. 223–228, 1995.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
E. Gershon, U. Shaked, and I. Yaesh, “ $H_{\infty}$ control and filtering of discrete-time stochastic systems with multiplicative noise,” Automatica, vol. 37, no. 3, pp. 409–417, 2001.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
F. Yang, Z. Wang, and Y. S. Hung, “Robust Kalman filtering for discrete time-varying uncertain systems with multiplicative noises,” IEEE Transactions on Automatic Control, vol. 47, no. 7, pp. 1179–1183, 2002.
View at: Publisher Site | Google Scholar | MathSciNet
Y. L. Chen and B. S. Chen, “Minimax robust deconvolution filters under stochastic parametric and noise uncertainties,” IEEE Transactions on Signal Processing, vol. 42, no. 1, pp. 32–45, 1994.
View at: Publisher Site | Google Scholar
Y. Sawada and A. Tanikawa, “An improved recursive algorithm of optimal filter for discrete-time linear systems subject to colored observation noise,” International Journal of Innovative Computing, Information and Control, vol. 8, no. 3, pp. 2389–2397, 2012.
View at: Google Scholar
H. R. Hashemipour, S. Roy, and A. J. Laub, “Decentralized structures for parallel Kalman filtering,” IEEE Transactions on Automatic Control, vol. 33, no. 1, pp. 89–93, 1988.
View at: Publisher Site | Google Scholar
J. Feng and M. Zeng, “Optimal distributed Kalman filtering fusion for a linear dynamic system with cross-correlated noises,” International Journal of Systems Science, vol. 43, no. 2, pp. 385–398, 2012.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
E. Song, Y. Zhu, J. Zhou, and Z. You, “Optimal Kalman filtering fusion with cross-correlated sensor noises,” Automatica, vol. 43, no. 8, pp. 1450–1456, 2007.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
S. Sun and Z. Deng, “Multi-sensor optimal information fusion Kalman filter,” Automatica, vol. 40, no. 6, pp. 1017–1023, 2004.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
D. Simon, Optimal State Estimation, John Wiley and Sons, New York, NY, USA, 2006.
E. Song, Y. Zhu, and Z. You, “The Kalman type recursive state estimator with a finite-step correlated process noises,” in Proceedings of the IEEE International Conference on Automation and Logistics (ICAL '08), pp. 196–200, Qingdao, China, September 2008.
View at: Publisher Site | Google Scholar
A. Fu, Y. Zhu, and E. Song, “The optimal Kalman type state estimator with multi-step correlated process and measurement noises,” in Proceedings of the International Conference on Embedded Software and Systems (ICESS '08), pp. 215–220, Chengdu, China, July 2008.
View at: Publisher Site | Google Scholar
J. Feng, Z. Wang, and M. Zeng, “Optimal robust non-fragile Kalman-type recursive filtering with finite-step autocorrelated noises and multiple packet dropouts,” Aerospace Science and Technology, vol. 15, no. 6, pp. 486–494, 2011.
View at: Publisher Site | Google Scholar
H. Gao, Y. Zhao, J. Lam, and K. Chen, “H∞ fuzzy filtering of nonlinear systems with intermittent measurements,” IEEE Transactions on Fuzzy Systems, vol. 17, no. 2, pp. 291–300, 2009.
View at: Publisher Site | Google Scholar
Z. Wang, D. W. C. Ho, and X. Liu, “Variance-constrained filtering for uncertain stochastic systems with missing measurements,” IEEE Transactions on Automatic Control, vol. 48, no. 7, pp. 1254–1258, 2003.
View at: Publisher Site | Google Scholar | MathSciNet
Z. Wang, F. Yang, D. W. C. Ho, and X. Liu, “Robust finite-horizon filtering for stochastic systems with missing measurements,” IEEE Signal Processing Letters, vol. 12, no. 6, pp. 437–440, 2005.
View at: Publisher Site | Google Scholar
M. Sahebsara, T. Chen, and S. L. Shah, “Optimal $H_{2}$ filtering with random sensor delay, multiple packet dropout and uncertain observations,” International Journal of Control, vol. 80, no. 2, pp. 292–301, 2007.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
E. Yaz and A. Ray, “Linear unbiased state estimation for random models with sensor delay,” in Proceedings of the 35th IEEE Conference on Decision and Control, pp. 47–52, Kobe, Japan, December 1996.
View at: Google Scholar
E. Yaz and A. Ray, “Linear unbiased state estimation under randomly varying bounded sensor delay,” Applied Mathematics Letters, vol. 11, no. 4, pp. 27–32, 1998.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
J. Feng, Z. Wang, and M. Zeng, “Recursive robust filtering with finite-step correlated process noises and missing measurements,” Circuits, Systems, and Signal Processing, vol. 30, no. 6, pp. 1355–1368, 2011.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
F. O. Hounkpevi and E. E. Yaz, “Minimum variance generalized state estimators for multiple sensors with different delay rates,” Signal Processing, vol. 87, no. 4, pp. 602–613, 2007.
View at: Publisher Site | Google Scholar
F. O. Hounkpevi and E. E. Yaz, “Robust minimum variance linear state estimators for multiple sensors with different failure rates,” Automatica, vol. 43, no. 7, pp. 1274–1280, 2007.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
J. Linares-Pérez, A. Hermoso-Carazo, R. Caballero-Águila, and J. D. Jiménez-López, “Least-squares linear filtering using observations coming from multiple sensors with one- or two-step random delay,” Signal Processing, vol. 89, no. 10, pp. 2045–2052, 2009.
View at: Publisher Site | Google Scholar
M. Zeng, J. Feng, and Z. Yu, “Optimal unbiased estimation for uncertain systems with different delay rates sensor network and autocorrelated process noises,” in Proceedings of the Chinese Control and Decision Conference (CCDC '11), pp. 3014–3018, Mianyang, China, May 2011.
View at: Publisher Site | Google Scholar
R. A. Horn and C. R. Johnson, Topics in Matrix Analysis, Cambridge University Press, New York, NY, USA, 1991.
View at: MathSciNet

Copyright

Copyright © 2014 Jianxin Feng. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

1012

Downloads

701

Citations