Convergent Properties of Riccati Equation with Application to Stability Analysis of State Estimation

Cai, X.; Ding, Y. S.; Li, S. Y.

doi:https://doi.org/10.1155/2017/2367042

Mathematical Problems in Engineering

On this page

Abstract Introduction Preliminaries Conclusions Conflicts of Interest Acknowledgments References Copyright Related Articles

Special Issue

Stochastic Systems and Control: Theory and Applications

View this Special Issue

Research Article | Open Access

Volume 2017 | Article ID 2367042 | https://doi.org/10.1155/2017/2367042

Convergent Properties of Riccati Equation with Application to Stability Analysis of State Estimation

X. Cai,¹Y. S. Ding,¹and S. Y. Li²

Academic Editor: Weihai Zhang

Received07 Apr 2017

Accepted18 May 2017

Published12 Jun 2017

Abstract

Since the recursive nature of Kalman filtering always results in a growing size of the optimization problem, state estimation is usually realized by use of finite-memory, receding horizon, sliding window, or “frozen” techniques, which causes difficulties on stability analysis. This paper proposes a novel method on selection of an initial covariance matrix and a horizon for the Kalman filter to make sure that a sequence of the closed-loop Kalman filters are stable as time-invariant filters at subsequent time instant. Convergent properties of Riccati Difference Equation (RDE) are first exploited. Based on these properties, sufficient conditions for stability of a sequence of Kalman filters are obtained. Compared with the existent literature, the convergent properties and the stability conditions are less conservative since they provide analytic results and are applicable to more common cases where the RDEs are not monotonic.

1. Introduction

In most industrial control applications, the state variables cannot be directly measured, which necessitates state estimation based on the output measurements during the process of state feedback controller design [1, 2]. Among many different kinds of filters, Kalman filter has been widely used in numerous applications to estimate state for systems with noisy measurements and unmeasured process disturbances including signal processing [3], power electronics [4], and navigation [5]. Essentially it provides an optimal recursive solution for the least square state estimation problem and its theoretical properties including stability and performance have been well addressed in many papers.

In the standard Kalman filter, however, the optimal state estimate at current time is determined recursively from the optimal state estimate and output measurement of the previous time instants. This immediately results in a problem of complexity. Since more measurements become available as time goes on, the estimator has to process more data, which leads to a growing size of the problem. In many applications for embedded implementations where memory limitations have to be considered, alternative methods are proposed by use of finite-memory, receding horizon, or sliding window techniques to overcome this shortage. The basic idea is to maintain a constant length of time window and update the information by discarding the oldest sample as the new measurement comes, which keeps the problem size bounded when more measurements are available. In such case, performance and stability issues have to be restudied; see [6, 7].

The Riccati equation, as a fundamental tool in linear optimal control [8] and filtering theory, performs important role during the performance and stability analysis of different variations of the Kalman filter. Starting from 1970s, [9] solves the optimal control problem of linear systems with respect to quadratic performance criteria analytically by use of the algebraic Riccati equation. Reference [10] establishes minimality convergence, uniqueness, and stability concerning the discrete-time matrix Riccati equation and proves the policy space approximation. And [11] addresses the convergence properties of the solution of RDE with a special attention to systems that are not stabilizable in the filtering sense. The results are applicable to many filtering or control problems of systems with deterministic disturbances. Motivated by filtering problems in short-time Fourier analysis, [12, 13] provide a method to guarantee the exponential asymptotical stability of a sequence of the Kalman filters generated from RDE by selecting appropriate initial covariance matrix through the monotonic properties. The results are later extended to the nonmonotonic case in [14]. And [15] summarizes connections between various Riccati equations and the closed-loop stability of linear quadratic optimal control and estimation. Till recently, the Riccati equation has also been applied into addressing distributed estimation problems [16]. By studying the convergence of the estimation error process, distributed Kalman filter is proposed for potentially unstable and large linear dynamic systems.

The current paper is concerned with convergent properties of RDE and its application to closed-loop stability analysis of Kalman filters as time-invariant filters. Different from most of the previous stability results that rely on the monotonic properties of RDE, a novel convergent property of RDE is first presented for an arbitrary initial positive definite matrix. Further convergent properties of RDE are exploited. Based on these properties, detailed stability analysis is performed. The results provide insights on how to select an initial covariance matrix and a horizon such that the sequence of Kalman filters generated by RDE is stable as long as the filter has a longer horizon than . The results have potential application in solving the stability of other types of state estimators.

Compared with the existent literature, the main contributions of the paper are as follows: (1) novel convergent properties of RDE are exploited. (2) As an application, sufficient conditions on stability of a sequence of closed-loop Kalman filters are provided. (3) The results are less conservative since they are analytic and do not rely on the monotonic properties of solutions of RDE.

This paper is organized as follows. Section 2 provides the preliminaries. General convergent properties of the RDE are discussed in Section 3. Stability analysis of Kalman filters is addressed in Section 4. Section 5 concludes this paper.

2. Preliminaries

Consider a linear discrete-time stochastic system described as follows:where is the state and is the measured output. We make the following assumption concerning system (1).

Assumption 1. and are zero mean, white, mutually independent Gaussian noise processes with covariance , where and are positive definite matrices .

The aim of an estimator is to predict the optimal state on the basis of the measured output variables , , and the initial knowledge that is a Gaussian random variable with mean and covariance .

The standard Kalman predictor is described aswhere Kalman gain is given byand is the solution of the discrete filtering RDEsolved forwards in time with initial conditions , . The closed-loop state transition matrix of the Kalman filter isNote that if , then the solution of (4) is nonnegative definite for all . This follows easily by rewriting (4) as

The following assumption is made to make sure that the corresponding algebraic Riccati equation (ARE) has the unique nonnegative definite solution.

Assumption 2. is detectable, is stabilizable, and has full rank.

Remark 3. According to [15], if Assumptions 1 and 2 hold for system (1), then the solution of the RDE (4) satisfieswhere is the positive definite solution of the following algebraic Riccati equation (ARE):whereThis indicates that the sequences and are bounded.

The following lemma characterizes the monotonic property of RDE, which plays important role in stability analysis of optimal filters.

Lemma 4 (see [13]). For the dynamic system (1) satisfying Assumptions 1 and 2 and coming from RDE (4), if () holds for any , then we have () for all .

The results above only show the monotonic behavior of the sequence . However, the more common case is that might be an arbitrary nonnegative definite matrix, in which case these results may no longer hold.

In the following section, novel convergent properties of RDE are exploited, which is applicable to an arbitrary positive definite matrix . The properties are quantitative and analytic compared with the previous results and can include them as special cases.

3. Convergent Properties of RDE

More general convergent properties of will be introduced in this section, some of which have been mentioned in [17]. The following lemma shows that, for any two of the positive definite matrices, upper and lower bounds of the ratio between the two matrices can be analytically expressed in terms of a constant and two nonnegative constants and . The detailed proof is provided in [17]. In the following, we just provide a brief proof in order to keep the completeness and continuity of this paper.

Lemma 5 (see [17]). Let be arbitrary. For any positive definite matrices and , there are two nonnegative constants and such that the following inequality holds:

Proof. Denote , which is also a positive definite matrix. The following inequality holds:LetA simple calculation shows thatThis completes the proof.

According to the RDE (6), it is obvious that holds for all . By use of inequality techniques, the following proposition proves the existence of a constant , which will be used to quantify the convergent speed of the sequence .

Proposition 6. For a dynamic system (1) satisfying Assumptions 1 and 2, there exists a constant such that for any fixed and coming from the RDE (4), the following inequality holds for all :where is defined in (3).

Proof. For any , the RDE equation (6) yields the following inequality:As mentioned in Remark 3 that is bounded, there exists a constant such that holds for all . LetIt can be seen thatwhich leads toby substituting (17) into inequality (15). The proof is completed by selecting and verifying .

With the help of Proposition 6, the next proposition provides convergent properties of in terms of constants , , and . It is assumed that . Similar results can be obtained for the case that .

Proposition 7. Consider system (1) satisfying Assumptions 1 and 2 and and from RDE (4), and there exist a constant and two nonnegative constants and such that for any given fixed the following inequality holds:where

Proof. Since the proofs of both sides are similar, we only prove the right side of the inequality. According to Proposition 6, it follows thatThe rest of this part is proved through induction.
The choice of parameters shows that inequality (19) holds for .
Assume that, for any fixed , holds for (). In the following part, we prove that the inequality also holds when . By using inequality techniques, RDE can be transformed into the following inequality:Since inequality (19) holds at , we haveSubstituting into inequality (22) yieldsAccording to the Principle of Optimality, it follows thatThus, we havewhich implies the inequality holds when .
The proof of the left side of inequality (19) is similar and has been omitted here.

Remark 8. Proposition 7 proposes a quantitative convergent property of the RDE (4) which has included monotonicity as a special case. For example, (1)if holds, we have by Lemma 5. Substituting into Proposition 7 immediately yields that ;(2)if holds, we have by Lemma 5. Substituting into Proposition 7 immediately yields that . Moreover, the results are able to deal with arbitrary positive definite matrices of , which is more applicable than the previous literature.

In the remaining part of this section, more convergent properties of RDE are exploited. A lemma on comparison of RDE solutions is introduced, which shows that the difference between two sequences of RDE solutions also satisfies a new RDE.

Lemma 9 (see [15]). Consider two RDEs with the same , , and matrices but possibly different ’s, , and , respectively. Denote their solution matrices and , respectively. Then, the difference between the two solutions satisfies the following RDE:orwhere

In order to investigate the further properties, the following assumption is made. Novel convergent properties of the difference between two solutions of RDE are addressed on the basis of Lemma 9.

Assumption 10. is detectable, is stabilizable, and has full rank.

Proposition 11. Consider two RDEs with the same , , and matrices. Denote their solution matrices and and the difference between the two solutions . For system (1) satisfying Assumptions 1 and 2, if and hold, then there exist a constant and two nonnegative constants and such that for any fixed the following inequality holds for all :where

Proof. According to Lemma 9, satisfies the RDEwhereSince and hold, we have and . RDE (32) can be rewritten aswhich implies that . The rest of the proof is similar to Proposition 7 and has been omitted here.

Remark 12. Based on the statement in Lemma 9 that the difference between the two solutions of RDE also satisfies a new type of RDE, further convergent properties of the differences between the two solutions are addressed in Proposition 11. Let us also take some special cases as examples.(1)If holds, we have . Substituting into Proposition 11 immediately yields that .(2)If holds, we have . Substituting into Proposition 11 immediately yields that .Actually, the results above have also included some of the existent results. Select and , and then we have and . According to statement 1, if holds, which implies that , then it follows that , yielding . This is consistent with results in [14, 15].
In addition, the results are able to deal with arbitrary positive definite matrices of , which is more applicable than the previous literature.

As an application, convergent properties of RDE are utilized to investigate stability of a sequence of Kalman filters in the next section.

4. Application to Stability Analysis of Kalman Filters

The following result provides a sufficient condition such that a sequence of Kalman filters is stable for all horizons larger than a certain value.

Theorem 13. Let be a fixed integer. Consider the dynamic system (1) satisfying Assumptions 1 and 2, , from Proposition 6, from RDE (4), and from Lemma 5, and if for the given , the following inequality holds:then the closed-loop matrix from (5) is Hurwitz for all .

Proof. We first prove that is Hurwitz.
If holds, by using Proposition 7 this yieldsOn the other hand, it has been proved in Proposition 6 thatCombining the above two inequalities yieldsThis indicates that is Hurwitz.
Note that the function is monotonically increasing with respect to given that and and . Under condition (35), it is easy to verify that holds for all .
Thus, by a similar proof, is Hurwitz for all .

Remark 14. Theorem 13 provides a sufficient condition on closed-loop stability of a sequence of Kalman filters. Actually, some existent results can be deemed as a special case for condition (35). For example, if , we have according to Lemma 5. It can be verified that condition (35) holds for all , which implies that all the closed-loop filters are Hurwitz. This is consistent with results in [13] which proves stability of Kalman filters based on monotonicity of .

Remark 15. The function is monotonically increasing with respect to for the given and and . This implies that there always exists a positive integer such that, for any , condition (35) holds. From this point of view, stability can be guaranteed for the closed-loop system as long as the horizon is larger than a certain value.

Remark 16. The advantage of the proposed method is that stability conditions can be analytically expressed by use of the parameters such as , , and . From the proof of Proposition 6, it is shown that is determined by (a constant as long as the system model and , had been fixed) and it stands for the convergent speed of the RDE solutions to the ARE solution .

In the next part, a corollary is provided based on Proposition 11.

Corollary 17. Let be a fixed integer and and come from Proposition 11. For the dynamic system (1) satisfying Assumptions 1 and 10 and the given , if the following inequality holds:then the closed-loop matrix is Hurwitz for all .

Proof. The proof is similar to that of Theorem 13. If holds, applying Proposition 11 leads toOn the other hand, the following inequality holds:Combining two inequalities yieldsThis indicates that is Hurwitz.
Note that is monotonically increasing with respect to for any and and . Under condition (39), it is easy to verify that holds for all .
Thus, by a similar proof, is Hurwitz for all .

Remark 18. There exist essential differences between Theorem 13 and Corollary 17 although the proof seems similar, since, by appropriate selection of different sequence of and , more details can be obtained.
Also, Corollary 17 can be a supplement to Theorem 13 during the proof on stability of a sequence of Kalman filters. For example, select and and then and . If holds, we have . Combined with other conditions, it can be proved that the closed-loop matrix is stable, which is consistent with Theorem 3.1 in [14].

5. Conclusions and Future Work

By exploiting convergent properties of RDE in optimal filtering problems, this paper presents novel convergent properties and applies them to study stability analysis of a sequence of Kalman filters. These results have fewer requirements on the initial covariance matrix and thus are applicable to a wider case. Future work includes applying the convergent properties to stability analysis of other kinds of estimators.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this paper.

Acknowledgments

This work was supported in part by the Key Project of the National Natural Science Foundation of China (no. 61134009), the National Natural Science Foundation of China (nos. 61473077, 61473078, 61503075, 61603090, and 61603089), Program for Changjiang Scholars from the Ministry of Education, and International Collaborative Project of the Shanghai Committee of Science and Technology (no. 16510711100).

References

B. D. O. Anderson and J. B. Moore, Optimal Filtering, Prentice Hall, Englewood Cliffs, NJ, 1979.
G. C. Goodwin, M. M. Seron, and J. A. De Doná, “Constrained Control and Estimation: An Optimisation Approach,” Springer Science and Business Media, 2006.
View at: Publisher Site | Google Scholar | MathSciNet
R. Dehghannasiri, M. S. Esfahani, and E. R. Dougherty, “Intrinsically bayesian robust kalman filter: an innovation process approach,” IEEE Transactions on Signal Processing, vol. 65, no. 10, pp. 2531–2546, 2017.
View at: Publisher Site | Google Scholar
M. Ahmeid, M. Armstrong, S. Gadoue, M. Algreer, and P. Missailidis, “Real-Time Parameter Estimation of DC-DC Converters using a Self-Tuned Kalman Filter,” IEEE Transactions on Power Electronics, vol. PP, no. 99, 2016.
View at: Publisher Site | Google Scholar
N. Davari and A. Gholami, “An asynchronous adaptive direct kalman filter algorithm to improve underwater navigation system performance,” IEEE Sensors Journal, vol. 17, no. 4, pp. 1061–1068, 2017.
View at: Publisher Site | Google Scholar
C. V. Rao, J. B. Rawlings, and J. H. Lee, “Constrained linear state estimation - A moving horizon approach,” Automatica, vol. 37, no. 10, pp. 1619–1628, 2001.
View at: Publisher Site | Google Scholar
C. V. Rao, J. B. Rawlings, and D. . Mayne, “Constrained state estimation for nonlinear discrete-time systems: stability and moving horizon approximations,” Institute of Electrical and Electronics Engineers. Transactions on Automatic Control, vol. 48, no. 2, pp. 246–258, 2003.
View at: Publisher Site | Google Scholar | MathSciNet
B.-S. Chen and W. Zhang, “Stochastic H₂/H_∞ control with state-dependent noise,” IEEE Transactions on Automatic Control, vol. 49, no. 1, pp. 45–57, 2014.
View at: Publisher Site | Google Scholar | MathSciNet
J. C. Willems, “Least Squares Stationary Optimal Control and the Algebraic Riccati Equation,” IEEE Transactions on Automatic Control, vol. 16, no. 6, pp. 621–634, 1971.
View at: Publisher Site | Google Scholar
P. E. Caines and D. Q. Mayne, “On the discrete time matrix Riccati equation of optimal control,” International Journal of Control, vol. 12, pp. 785–794, 1970.
View at: Publisher Site | Google Scholar | MathSciNet
S. W. Chan, G. C. Goodwin, and K. . Sin, “Convergence properties of the Riccati difference equation in optimal filtering of nonstabilizable systems,” Institute of Electrical and Electronics Engineers. Transactions on Automatic Control, vol. 29, no. 2, pp. 110–118, 1984.
View at: Publisher Site | Google Scholar | MathSciNet
R. R. Bitmead, A. C. Tsoi, and P. J. Parker, “A kalman filtering approach to short-time fourier analysis,” IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. 34, no. 6, pp. 1493–1501, 1987.
View at: Publisher Site | Google Scholar
R. R. Bitmead, M. R. Gevers, I. R. Petersen, and R. J. Kaye, “Monotonicity and stabilizability–properties of solutions of the riccati difference equation: propositions, lemmas, theorems, fallacious conjectures and counterexamples,” Systems and Control Letters, vol. 5, no. 5, pp. 309–315, 1985.
View at: Publisher Site | Google Scholar
C. E. de Souza, “On stabilizing properties of solutions of the Riccati difference equation,” Institute of Electrical and Electronics Engineers. Transactions on Automatic Control, vol. 34, no. 12, pp. 1313–1316, 1989.
View at: Publisher Site | Google Scholar | MathSciNet
R. R. Bitmead and M. Gevers, “Riccati difference and differential equations: convergence, monotonicity and stability,” in The Riccati equation, Comm. Control Engrg. Ser., pp. 263–291, Springer, Berlin, 1991.
View at: Google Scholar | MathSciNet
D. Li, S. Kar, J. M. Moura, H. . Poor, and S. Cui, “Distributed Kalman filtering over massive data sets: analysis through large deviations of random Riccati equations,” Institute of Electrical and Electronics Engineers. Transactions on Information Theory, vol. 61, no. 3, pp. 1351–1372, 2015.
View at: Publisher Site | Google Scholar | MathSciNet
X. Cai, Y. Tan, S. Y. Li, and I. Mareels, “On the finite time performance of model predictive control,” Systems and Control Letters, vol. 70, pp. 60–68, 2014.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2017 X. Cai et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

2074

Downloads

863

Citations