Abstract and Applied Analysis

Volume 2012, Article ID 176419, 11 pages

http://dx.doi.org/10.1155/2012/176419

## Adaptive Observer-Based Fault Estimation for Stochastic Markovian Jumping Systems

^{1}College of Electrical Engineering and Automation, Anhui University, Hefei 230601, China^{2}Key Laboratory of Advanced Process Control for Light Industry (Ministry of Education), Institute of Automation, Jiangnan University, Wuxi 214122, China

Received 15 March 2012; Accepted 4 June 2012

Academic Editor: Miroslava Růžičková

Copyright © 2012 Shuping He and Fei Liu. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

This paper studies the adaptive fault estimation problems for stochastic Markovian jump systems (MJSs) with time delays. With the aid of the selected Lyapunov-Krasovskii functional, the adaptive fault estimation algorithm based on adaptive observer is proposed to enhance the rapidity and accuracy performance of fault estimation. A sufficient condition on the existence of adaptive observer is presented and proved by means of linear matrix inequalities techniques. The presented results are extended to multiple time-delayed MJSs. Simulation results illustrate that the validity of the proposed adaptive faults estimation algorithms.

#### 1. Introduction

Fault detection and isolation (FDI) [1, 2] has been the subject of extensive research since the 1970s and becomes one of the hotspots in control theory presently. With the rising demands of product quality, effectiveness, and safety in modern industries, people expect that they can get the failure information before the fault damages the system. Many techniques have been proposed especially for sensor and actuator failures with application to a wide range of engineering fields. Among these, the most commonly used schemes for fault detection relate to observer-based approaches [2–5]. It should be pointed out that the observer-based approach, which uses a parametric design technique to perform both detection and diagnosis, only works for a small number of sensor faults. In some cases, fault estimation strategies [6–8] are needed to carry on controlling the faulty system. Compared with FDI, fault estimation is a more challenging task because it requires an estimation of the location after the alarm has been set, and the size of the fault should be made. Recently, some results based on adaptive or robust observers [2–8] for fault estimation have been obtained. However, very few results in the literature consider the fault detection and estimation problem for stochastic systems.

In fact, as a special class of stochastic systems [9, 10] that involves both time-evolving and event-driven mechanisms, Markovian jump systems (MJSs) [11] have received considerable attention. This class of systems includes two components which are the mode and the state and the dynamics of jumping modes and continuous states, which are, respectively, modeled by finite-state Markov chains and differential equations. It can be used to model a variety of physical systems, which may experience abrupt changes in structures and parameters due to, for example, sudden environment changes, subsystem switching, system noises, and failures occurred in components or interconnections and executor faults. Some illustrative applications of MJSs can be found for examples in [3, 4, 6, 12–18] and the references therein. In recent years, the FDI problems for MJSs have regained increasing interest, and some results are also available [3, 4, 16–18]. However, very little is known on the problem of fault estimation for time-delay nonlinear MJSs. This problem forms the main purpose of this paper, where an adaptive technique [1, 19–21] is proposed and modified for the estimation of actuator faults.

In this paper, we studied the problem of fault estimation for a class of time-delay MJSs. By comparing with the presented results of time-delay and linear dynamic systems, it can be shown that a derivative term is added on the basis of fault estimation equation in our design, which renders that the conventional adaptive fault estimation algorithm [21] can be treated as a special case of the fast adaptive fault estimation algorithm. The introduction of the derivative term plays a major role in improving the rapidity of fault estimation. The augmented dynamic system is firstly constructed based on the adaptive fault estimation observer, and the observer parameters are designed on the system modes. Sufficient conditions are subsequently established on the existence of the mode-dependent adaptive fault estimation observer. The design criterions are presented in the form of linear matrix inequalities (LMIs) [22], which can be easily checked. The presented results are then extended to multiple time-delayed MJSs case. Finally, a numerical example is included to illustrate the effectiveness of the developed techniques.

Let us introduce some notations. The symbols and stand for an -dimensional Euclidean space and the set of all real matrices, respectively, and denote the matrix transpose and matrix inverse, represents the block-diagonal matrix of and , denote the maximal eigenvalue of a positive-define matrix , denotes, for example, for , , denotes the Euclidean norm of vectors, denotes the mathematics statistical expectation of the stochastic process or vector, is the space of dimensional square integrable function vector over , (or ) stands for a positive-definite (or nonnegative-definite) matrix, is the unit matrix with appropriate dimensions, is the zero matrix with appropriate dimensions, means that the symmetric terms in a symmetric matrix.

#### 2. Problem Formulation

Given a probability space , where is the sample space, is the algebra of events, and is the probability measure defined on . Let the random form process be the continuous-time discrete-state Markov stochastic process taking values in a finite set with transition probabilities given by where and . are the transition probability rates from mode at time to mode at time , and .

Consider the following linear MJSs over the probability space : where is the state, is the measured output, is the controlled input, is the unknown actuator fault, and we assume that its derivative is the norm bounded with , wherein . is the time delay constant, is a continuous vector-valued initial function assumed to be continuously differentiable on , and is the initial mode. , , , , and are known mode-dependent matrices with appropriate dimensions, is of full column rank with , and represents a continuous-time discrete state Markov stochastic process with values in the finite set .

For presentation convenience, we denote , , , , , and as , , , , , and, respectively.

*Definition 2.1 (see Mao [23]). * Let be the positive stochastic functional and define its weak infinitesimal operator as
Refer to observer design [2–4, 7] and consider the following systems:
where is the observer state vector, is the observer output vector, and is an estimate of actuator fault of . Denote

Then, we can present the error dynamics (2.4) as where , .

In this paper, by comparison with the conventional adaptive fault estimation algorithm [21], we consider the following fast adaptive fault estimation algorithm. In this algorithm, we add a derivative term in estimation equation, that is, which can realize where is a given mode-dependent matrix and is a prespecified matrix which defines the learning rate for (2.6).

*Remark 2.2. *In the conventional adaptive fault estimation algorithm , it is only an integral term in essence. It fails to deal with time-varying faults, that is, though it assumes that the constant fault () estimation is unbiased. In this paper, we add a derivative term in estimation equation and improve the conventional adaptive fault estimation algorithm such that the time-varying faults can be considered. For the stochastic modes jumping case, we select the given matrix as a mode-dependent one.

#### 3. Adaptive Fault Estimation Observer Design

Theorem 3.1. *If there exist a set of positive definite symmetric matrices , , and mode-dependent matrices , , and , such that the following matrix equations hold for all :
**
where . Then the fast adaptive fault estimation algorithm of (2.7) can be realized. And in the estimated time-interval, it can estimate errors with the uniformly boundedness of the states and faults. Moreover, the observer gains are respectively as
*

*Proof. * Let the mode at time be , that is, . Take the stochastic Lyapunov-Krasovskii function as
where , , , in which , are the given mode-dependent symmetric positive-definite matrix for each modes .

According to Definition 2.1 and along the trajectories of the error dynamics MJSs (2.6), we can derive the following:

Given a symmetric positive definite matrix , we can use the following relation:

Then, we can get

By letting and , the derivative of with respect to time follows that
where , .

Thus, it concludes that , wherein . Obviously, we can get if . According to stochastic Lyapunov-Krasovskii stability theory, the trajectory of will converge to the small set , though it is outside set . Therefore, is ultimately bounded. This completes the proof.

*Remark 3.2. *It is necessary to point out that if the presented faults are constant, that is, , then the designed adaptive algorithm can achieve asymptotical convergence from (3.8). Then we can get that , which proves the stability of the origin , and the uniformly boundedness of and with . Then, holds by Barbalat’s Lemma.

#### 4. Extension to Multiple Time-Delayed MJSs

Consider the following multiple time-delayed MJSs over the probability space : where , are multiple time delays with , and other notations are the same as in Section 2.

Similar to Section 3, the following observer can be constructed: where is the observer state vector, is the observer output vector, and is an estimate of actuator fault of .

Then, we can obtain the error dynamics by using the same notations of , , and as follows: where , .

Prior to the design of an adaptive diagnostic law, we can get the following results for multiple time-delayed MJSs (4.1).

Theorem 4.1. *If there exist a set of positive definite symmetric matrices , , and mode-dependent matrices , , and , , such that the following matrix equations hold for all :
**
Then, the fast adaptive fault estimation algorithm of (2.7) can be realized. And in the estimated time interval, it can estimate errors with the uniformly boundedness of the states and faults. Moreover, the observer gains are respectively as follows:
*

When there are difficulties in solving (3.1) or (4.4), we can transform them into the following SDP problems via disciplined convex programming [24]: In order to make approximate to with a satisfactory precision, we can firstly select a sufficiently small scalar to meet (4.7).

*Remark 4.2. *The solutions of Theorems 3.1 and 4.1 can be obtained by solving an optimization problem with (4.7). By using the Matlab LMI Toolbox, it is straightforward to check the feasibility of LMIs. In order to illustrate the effectiveness of the developed techniques, we will give several numerical examples about fuzzy jump system with time delays in Section 5.

#### 5. Numeral Example

We consider the following time-delayed stochastic MJSs with parameters given by The transition rate matrix that relates the two operation modes is given as . By solving the LMIs in (3.1), (3.2), and (4.7) with , we can get the following solutions:

To show the effectiveness of the designed methods, the time-delay is assumed to be 0.2 s, and we consider two kinds of actuator faults and in the simulation over the finite-time interval :

Let and , the jumping modes are shown in Figure 1. The estimated faults and estimation errors of and are shown in Figures 2 and 3, respectively. From the simulation results and design algorithm, it can be concluded that the adaptive fault diagnosis observer can enhance the performance of fault estimation for slow and fast time-varying faults.

#### 6. Conclusions

In this paper, we have studied the design of adaptive fault estimation observer for time-delayed MJSs. It ensures the rapidity and accuracy performance of fault estimation of the designed observer. By selecting the appropriate Lyapunov-Krasovskii function and applying matrix transformation and variable substitution, the main results are provided in terms of LMIs form and then extended to multiple time-delayed MJSs case. Simulation example demonstrates the effectiveness of the developed techniques.

#### Acknowledgments

This work was supported in part by the State Key Program of National Natural Science Foundation of China (Grant no. 61134007), the Key Program of Natural Science Foundation of Education Department of Anhui Province (Grant no. KJ2012A014), and Doctor Research Project of Anhui University (Grant no. 32030017).

#### References

- J. Gertler, “Fault detection and isolation using parity relations,”
*Control Engineering Practice*, vol. 5, no. 5, pp. 653–661, 1997. View at Publisher · View at Google Scholar · View at Scopus - H. Hammouri, M. Kinnaert, and E. H. El Yaagoubi, “Observer-based approach to fault detection and isolation for nonlinear systems,”
*IEEE Transactions on Automatic Control*, vol. 44, no. 10, pp. 1879–1884, 1999. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - S. He and F. Liu, “Fuzzy model-based fault detection for Markov jump systems,”
*International Journal of Robust and Nonlinear Control*, vol. 19, no. 11, pp. 1248–1266, 2009. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - S. He and F. Liu, “Filtering-based robust fault detection of fuzzy jump systems,”
*Fuzzy Sets and Systems*, vol. 185, pp. 95–110, 2011. View at Publisher · View at Google Scholar - B. Jiang, K. Zhang, and P. Shi, “Integrated fault estimation and accommodation design for discrete-time takagiSugeno fuzzy systems with actuator faults,”
*IEEE Transactions on Fuzzy Systems*, vol. 19, no. 2, Article ID 5648342, pp. 291–304, 2011. View at Publisher · View at Google Scholar · View at Scopus - Z. Mao, B. Jiang, and P. Shi, “Fault detection for a class of nonlinear networked control systems,”
*International Journal of Adaptive Control and Signal Processing*, vol. 24, no. 7, pp. 610–622, 2010. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - K. Zhang, B. Jiang, and A. Shumsky, “A new criterion of fault estimation for neutral delay systems using adaptive observer,”
*Acta Automatica Sinica*, vol. 35, no. 1, pp. 85–91, 2009. View at Publisher · View at Google Scholar - M. Zhong, S. X. Ding, Q.-L. Han, and Q. Ding, “Parity space-based fault estimation for linear discrete time-varying systems,”
*IEEE Transactions on Automatic Control*, vol. 55, no. 7, pp. 1726–1731, 2010. View at Publisher · View at Google Scholar - I. A. Dzhalladova, J. Baštinec, J. Diblík, and D. Y. Khusainov, “Estimates of exponential stability for solutions of stochastic control systems with delay,”
*Abstract and Applied Analysis*, vol. 2011, Article ID 920412, 14 pages, 2011. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - J. Baštinec, J. Diblík, D. Ya. Khusainov, and A. Ryvolová, “Exponential stability and estimation of solutions of linear differential systems of neutral type with constant coefficients,”
*Boundary Value Problems*, vol. 2010, Article ID 956121, 20 pages, 2010. View at Google Scholar · View at Zentralblatt MATH - N. M. Krasovskii and E. A. Lidskii, “Anaytical design of controllers in systems with random attributes,”
*Automation and Remote Control*, vol. 22, no. 1–3, pp. 1021–1025, 1141–1146, 1289–1294, 1961. View at Google Scholar - Z. Fei, H. Gao, and P. Shi, “New results on stabilization of Markovian jump systems with time delay,”
*Automatica*, vol. 45, no. 10, pp. 2300–2306, 2009. View at Google Scholar - N. S. D. Arrifano and V. A. Oliveira, “Robust ${H}_{\infty}$ fuzzy control approach for a class of Markovian jump nonlinear systems,”
*IEEE Transactions on Fuzzy Systems*, vol. 14, no. 6, pp. 738–754, 2006. View at Publisher · View at Google Scholar · View at Scopus - Z. Xiang, R. Wang, and Q. Chen, “Robust reliable stabilization of stochastic switched nonlinear systems under asynchronous switching,”
*Applied Mathematics and Computation*, vol. 217, no. 19, pp. 7725–7736, 2011. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - S. He and F. Liu, “Robust finite-time stabilization of uncertain fuzzy jump systems,”
*International Journal of Innovative Computing, Information and Control*, vol. 6, no. 9, pp. 3853–3862, 2010. View at Google Scholar · View at Scopus - Q. Ding and M. Zhong, “On designing ${H}_{\infty}$ fault detection filter for Markovian jump linear systems with polytopic uncertainties,”
*International Journal of Innovative Computing, Information and Control*, vol. 6, no. 3, pp. 995–1004, 2010. View at Google Scholar · View at Scopus - Z. Mao, B. Jiang, and P. Shi, “Fault detection for a class of nonlinear networked control systems,”
*International Journal of Adaptive Control and Signal Processing*, vol. 24, no. 7, pp. 610–622, 2010. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - N. Meskin and K. Khorasani, “Fault Detection and Isolation of discrete-time Markovian jump linear systems with application to a network of multi-agent systems having imperfect communication channels,”
*Automatica*, vol. 45, no. 9, pp. 2032–2040, 2009. View at Publisher · View at Google Scholar · View at Scopus - Z. Ding, “Adaptive estimation and rejection of unknown sinusoidal disturbances in a class of non-minimum-phase nonlinear systems,”
*IEE Proceedings-Control Theory and Applications*, vol. 153, no. 4, pp. 379–386, 2006. View at Publisher · View at Google Scholar - G. Feng, S. G. Cao, and N. W. Rees, “Stable adaptive control for fuzzy dynamic systems,”
*Fuzzy Sets and Systems*, vol. 131, no. 2, pp. 217–224, 2002. View at Publisher · View at Google Scholar - H. Wang and S. Daley, “Actuator fault diagnosis: an adaptive observer-based technique,”
*IEEE Transactions on Automatic Control*, vol. 41, no. 7, pp. 1073–1078, 1996. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - S. Boyd, L. El Ghaoui, E. Feron, and V. Balakrishnan,
*Linear Matrix Inequalities in System and Control Theory*, vol. 15 of*SIAM Studies in Applied Mathematics*, SIAM, Philadelphia, Pa, USA, 1994. View at Publisher · View at Google Scholar - X. Mao, “Stability of stochastic differential equations with Markovian switching,”
*Stochastic Processes and Their Applications*, vol. 79, no. 1, pp. 45–67, 1999. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - M. Grant, S. Boyd, and Y. Ye, “Disciplined convex programming,” in
*Global Optimization*, vol. 84 of*Nonconvex Optimization and Its Applications*, pp. 155–210, Springer, New York, NY, USA, 2006. View at Publisher · View at Google Scholar · View at Zentralblatt MATH