Journal of Control Science and Engineering

Volume 2010, Article ID 497925, 11 pages

http://dx.doi.org/10.1155/2010/497925

## A New Adaptive Kalman Estimator for Detection and Isolation of Multiple Faults Integrated in a Fault Tolerant Control

^{1}Ecole Nationale des Sciences Appliquées Université Ibn Zohr, Agadir, Morocco^{2}Centre de Recherche en Automatique de Nancy, Université Henri Poincaré Nancy1, CNRS UMR 7039, BP 239, 54506 Vandoeuvre Cedex, France

Received 17 March 2010; Revised 4 July 2010; Accepted 27 October 2010

Academic Editor: Edwin Chong

Copyright © 2010 H. Jamouli and D. Sauter. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

For sequential jumps detection, isolation, and estimation in discrete-time stochastic linear systems, Willsky and Jones (1976) have developed the Generalized Likelihood Ratio (GLR) test. After each detection and isolation of one jump, the treatment of another possible jump is obtained by a direct state estimate and covariance incrementation of the Kalman filter originally designed on the jump-free system. This paper proposes to extend this approach from a state estimator designed on a reference model directly sensitive to system changes. We will show that the obtained passive GLR test can be easily integrated in a Fault Tolerant Control System (FTCS) via a control law designed in order to asymptotically reject the effect of sequential jumps.

#### 1. Introduction

First derived in a completely recursive form by Willsky and Jones [1], the GLR test has been used in a wide variety of applications including the detection of sensor and actuator failures [1–3], electrocardiogram analysis [4], geophysical signal processing [5], and freeways supervision [6]. For sequential jumps detection in discrete-time stochastic linear systems, the GLR test is made of the following steps:

(1)detection and isolation of one possible jump by applying a GLR detector on the innovation sequence of the Kalman filter designed on the jump-free system,(2)updating of the Kalman filter using the jump magnitude estimate given by the GLR detector,(3)go to the step 1 to detect, isolate, and estimate another possible jump from measurements immediately available after the detection time of the last jump.The first part of this paper revisits the standard GLR test of Willsky and Jones [1] with respect to the fault detectability indexes [7] describing the time delay between the occurrence of a jump and its effect on measurements.

The second part presents a new GLR test based on the augmented state Kalman estimator designed on the least favorable reference model including all the states of hypothetical jumps. This is not a new approach in the area of an FDI in dynamic systems-based observer. The well-known fault detection filter originally developed by Beard [8] is also designed from a fixed reference model including all the possible faults. The sequential multiple decision theory is not complete and this paper has not the pretention to give a unique solution of this general problem but only a usefull solution focussed on the integration of the obtained FDI scheme in an FTCS.

Over the last two decades, growing demand for reliability, maintainability in dynamic systems has drawn significant research in the area of Fault detection and isolation (FDI) (see [9, 10] and references therein). A fault tolerant control system (FTCS) is a control system which possesses the ability to accommodate system component failures automatically. The existing methods for reconfigurable controller design can be classified as linear quadratic regulator [11, 12], eigenstructure assignment [13], multiple model [14], adaptive control [15], pseudoinverse [16], and model following [17] and recently, [18–20] have proposed a kind of controllers stabilizing for fault tolerant control. For fuzzy system [21] a new approach of FTC is developed taking into account uncertainties of system model. In this context, the last part of the paper proposes to integrate our passive GLR test in an FTCS via a control law of form , where the nominal control law will be corrected online by the additional input signal depending on the jump magnitude prediction . This control law will be designed from the two-stage Kalman filter of Friedland [22] allowing the state prediction of the jump-free system to be available at each step of the processing. The additional input signals superimposed to the nominal control inputs will be computed so that the influence of the jumps on the regulated variables is asymptotically rejected.

#### 2. The A Priori Assumptions

The model of the jump-free system, noted , is given by where is the state vector, the measurement vector, the input vector. The zero mean white Gaussian noises and satisfy where and and the Gaussian initial state , and , is the Kronecker operator. The jump hypotheses for are modelized by where is the fault distribution vector, the scalar fault magnitude, and the unknown time of failure occurrence. Without lost of generality, the fault magnitude is assumed to follow a constant bias model , with step profile: and , . Based on the results of Tanaka [23] and Caglyan [24] (not developed in this paper), the detectability and distinguishability conditions of multiple jumps are assumed to be satisfied Let for .

The jump detectability indexes [7], and assume that signifying that the first information about the jump , appearing at time , will be present on measurement .

In the case where the jumps may occur relatively infrequently, the most likelihood reference model at the beginning of the processing is the model of . So, under the stability and convergence conditions

The jumps may occur relatively infrequently, and we assume that the nominal control law satisfying the nominal system performances has been designed on the jump-free system (1) via for example LQG approach on infinite horizon [25]. No a priori information is available concerning the jump's scenario: after the detection of one or several jumps, no information is available to focus our attention on another particular jump. The only assumption is that two jumps cannot appear simultaneously but only sequentially with a sufficient time delay to allow their real-time recursive treatment on a sliding window of size . In other words window may include occurrence time of one jump only. So, will be chosen in accordance with the maximum available computational time and with the minimum time delay between the occurrence of two jumps depending to the practical application of our works.

#### 3. The -Order Adaptive Kalman Estimator of Willsky and Jones

This chapter revisits the GLR test developed by Willsky and Jones [1] in relation with multihypotheses GLR test described in Willsky [26]. The a priori reference model at the beginning of the processing is the model . Under the stability and convergence conditions (6), (7), the Kalman filter which gives the maximum likelihood state prediction of the system is given by The additive effect of jump on the state prediction error and on the innovation sequence can be expressed as where and represent the state prediction error and the innovation sequence on the jump-free system and where and describe the additive effect of the jump satisfying

In Willsky [26] or Basseville and Nikiforov [27], , where and describe the additive effect of the jump on the state vector of the system and on the state vector of the Kalman filter, respectively. Our formulation shows that the jump signatures (14) only depend to the state prediction error of the Kalman filter and thus are decoupled from (this property will be used in the design of the FTCS). The jump hypothesis can be confronted to the “no-jump” hypothesis as Since , the likelihood ratio between (15) and (16) gives From (14), we have leading to and the likelihood ratio (17) can be rewritten as

Based on , the maximum likelihood prediction of conditioned on a particular assumed value of is given by and the log-likelihood ratio can be written as So, the decision rule of the GLR detector is as follows: where is the decision threshold. For a practical implementation of the GLR detector (22), the translated jump occurrence time must be constrained to belong to the sliding windows ] of size . In this case, (22) can be rewritten If , then one jump is detected at time , isolated from , where is the estimation of the jump occurrence time and where represent the maximum likelihood prediction of the jump magnitude based on measurements until time under the assumption that has an infinite a priori covariance.

The second step of the standard GLR test, intuitively obtained from relation (12), consists in updating the Kalman filter (8) by prediction and covariance incrementation of the Kalman filter (8) as follows: where the new state prediction is substituted in the Kalman filter (13) (see Figure 1 in Willsky and Jones [1]). In the original version of the GLR test, the state variables of the matched filters for are reinitialized to zero immediately following the filter incrementation leading to consider as a new initialization of the Kalman filter more appropriate than the initial value given at the beginning of the processing [27]. With this implementation, (24) cannot be used to improve the jump estimation from measurements available after its detection leading to choose the threshold level by reaching a compromise between fast detection and accurate estimation.

To avoid this tradeoff, we can modify this implementation in such a way that is not substituted in the Kalman filter but used to generate the auxiliary innovation sequence and its covariance matrix expressed where and represent the innovation sequence of the Kalman filter (8) and its covariance matrix. Now decoupled to the updating strategy, the Kalman filter, ((8), (24), and (14)) can be used to improve the jump estimation from measurements available after its detection time, and another possible jump can then be treated by the following GLR detector: with where the jump signatures are computed from (14) after having reinitialized for to zero immediately after the detection time of the first jump.

#### 4. The Order Adaptive Kalman Estimator

Our passive GLR test will not be designed from the jump-free system but on a reference model including all the hypothetical states of jumps that we wish to detect and isolate. This model will not be considered as the true model of the faulty system since the jump hypotheses ((4), (5)) are always assumed to occur relatively infrequently. Let with , , , , the augmented state model including all jump's states that we wish to detect and isolate. From (30), the jump hypothesis described by (2) can be viewed as an impulsive abrupt change on the hypothetical jump's state, modelized as where is the unknown occurrence time of impulsive abrupt change, the jump's state increment, and is the Kronecker operator.

Substituting (32) in (30), we obtain the impulsive jump hypotheses, noted , described by with , , and where has one at the th position and zero elsewhere. Based on an approach very similar to the modified GLR test of part 3, let the augmented state Kalman filter designed on the reference model (30), (31). The additive effect of the impulsive jump hypothese on the state prediction error and on the innovation sequence of the augmented state Kalman filter propagates as where and represent the state prediction error and the innovation sequence on the jump-free system and where and propagate as Based on the part 3, the following GLR detector is then derived with If then , and the impulsive jump is declared to be occurred at time, where where represent the maximum likelihood prediction of the jump increment (under the assumption that has an infinite a priori covariance). At the detection time of the first jump, the tracking ability of the augmented state Kalman filter (34) can be improved from the updating strategy of Willsky and Jones [1] as

In our case, the state of the matched filters given by is spanned in the trajectory space of the augmented state Kalman filter's prediction errors. So, (45) and (46) substituted in the augmented state Kalman filter (34) improve its tracking ability without producing a possible instability on the resulting filter (under the stability and convergence conditions of the augmented state Kalman filter given by (6) and (7)). The treatment of another impulsive jump is then obtained by applying GLR detector (41) on the resulting filter after having reinitialized , for all immediately after the filter incrementation. The new initialization (14) allows to reach the true state of the system very quickly (and to reach zero for jump compensation, consequently) avoiding the detection of the same jump several times. From an inductive reasoning, the passive GLR test is then derived and consists of the following steps:(1)detection, isolation, and estimation of one impulsive jump with the GLR detector (41),(2)updating of the augmented state Kalman filter (34) with (45) to improve its tracking, (3)going to the step 1.

The sequential multiple decision theory is not complete, and the choice of the threshold level is not studied in this paper. However, some simulation results not presented in this paper show that only statistical tuning parameter can be fixed at the beginning of the processing (this is not the threshold level which is adaptive but the augmented Kalman filter).

To show that the passive GLR test is less powerful than the GLR test of Willsky and Jones [1] (for a same fixed decision threshold) a very simple proof can be given on the treatment of the first jump. The reader can easily show that where is the signal to noise ratio of the Willsky and Jones GLR test and where is derived from (41) with .

However, our passive GLR test is more robust with respect to the nondetections and false alarms rates: on the least favorable model (30), the good postmodel of the faulty system has no any sense. Do not confuse the adaptation of the filter on its least favorable model (passive GLR test) and the adaptation of the most favorable model on the true system (not studied here).

#### 5. Results

To illustrate the proposed approach we considered the following system described by the matrix

The faults isolability is satisfied with and .

The statistical variables describing the performances of the reconfigurable FTCS coincide with the statistical variables describing the performances of the statistical test. So, to simplify the Monte Carlo simulation, the proposed example will be realized in open loop.

In the field of dynamic systems, the signal-to-noise ratio is generally more greater than the signal to noise ratio treated in the fields of electrocardiogram analysis or geophysical signal processing, and the size of the sliding window can be generally chosen small. In our example, we take (we donnot optimize at all, and we fix the following rate of false alarms: from a table of Chi-Squared distribution).

First, we suppose one that fault occurred at 350 with magnitude 2; we obtain the following results (Figures 1–20).

In the first case, the results show that the proposed state estimation given by our filter (Figures 6–9) is more adaptive to the fault occurrence than the Willsky algorithm (Figures 1–4).

In second case, we suppose two sequential faults occurred at 350 and 400 with magnitudes 2; we obtain the following results (Figures 11–20).

In case of two sequential faults, the GLR detector applied on the passive augmented model allows to detect the first faults at 350 s and the second at 400 s (see Figure 20). The Willsky GLR detect just the first fault at 350 and cannot detect the second (see Figure 15).

##### 5.1. Remarks and Discussion

We have also computed the rate of false alarms and the rate of good detections with Monte Carlo trials. We have obtained , for the modified GLR test and , for the passive GLR test clearly much power. We conclude that the passive GLR test is very power when quick detections lead to bad jump estimations and thus very usefull for FTCS to maximize the rate of good decisions specially in regard to the occurrence of a big jump which may greatly affect nominal performance of the system.

We can improve this approach of detection and isolation with an active GLR based on free model which it will be augmented after each detection and isolation. The faults already detected and isolated will be considered as perturbation, and the we will update the new GLR in order to detect another fault.

The sequential multiple decision theory is not complete, and the choice of the threshold level is not studied in this paper. However, some simulation results not presented in this paper show that only statistical tuning parameter can be fixed at the beginning of the processing (this is not the threshold level which is adaptive but the augmented Kalman filter).

#### 6. A Reconfigurable Fault Tolerant Control System

The purpose of the chapter is to show how the passive GLR test can be used in an FTCS. Our FTCS is only designed to reach the unique goal in order words to asymptotically reject the effect of jumps on the output of the system (the reference input will be maintained equal to zero avoiding the need of a reconfigurable feedforward control law). The proposed FTCS is based on the passive GLR test integrated via a reconfigurable control law designed on the model where the main problem to reach our goal is that the pair has uncontrollable modes (under controllable). The reconfigurable control law of the form will be designed in such a way that the nominal control of the jump-free system (1) (obtained by a LQG approach on an infinite horizon) is reconfigured online after each detection and isolation of one impulsive jump by the additive term . In order to design in relation with the available nominal control law, we assume that the implementation of the passive GLR test is based on the two-stage Kalman filter, the only optimal filter which gives the state prediction of the jump-free system . So, let be the control law that we wish to design for a physical rejection of jumps . Under the state transformation the system (49) with (51) can be expressed as and the physical rejection of jumps will be obtained if and only if and satisfy the algebraic equations Under the existence condition of a solution of (55), (56) given by the gain of the control law (51), solution of (55) gives and is not used. Under (55), (53) gives where the jump-free state of the system is decoupled to the jump's states and where can then be considered as the nominal control law assumed to be designed on the jump-free system (1). From the well-known separation principle, the reconfigurable control law, which reject the jump's uncontrollable modes, is then derived where is the state prediction of the jump-free system and the bias magnitude prediction given by the two-stage Kalman filter of Friedland [22] which optimally implement (34) (see Figure 21), (see the Appendix).

The last scheme resumes the control strategy to compensated automatically fault effects. The reference model used for the design of the control law GLR test coincides with the reference model used by the GLR Test. After each detection and isolation of one jump, the reference model is updated with the new state of jump and the three parts of the FTCS, that is, the GLR detector, the Kalman filter, and the control law.

#### 7. Conclusion

Derived from the works of Willsky and Jones [1], this paper has presented the passive GLR test for sequential jumps detection in stochastic discrete-time linear systems. Based on a new adaptive augmented state filtering designed on the least favorable faulty model of the system, the passive GLR test gives a good results on detection and isolation of multiple faults, and it can be integrated very easily in a fault tolerant control System.

#### Appendix

The predictive form of the Freidland's two-stage Kalman filter which optimally implement the augmented state Kalman filter (34) is given by where and are given by the bias-free filter (1) and where and are given by the bias filter From the coupling equation the initial conditions of the two-stage Kalman filter must be fixed as follows: with .

#### References

- A. S. Willsky and H. L. Jones, “A generalized likelihood ratio approach to the detection and estimation of jumps in linear systems,”
*IEEE Transactions on Automatic Control*, vol. 21, no. 1, pp. 108–112, 1976. View at Publisher · View at Google Scholar - A. S. Willsky, “A survey of design methods for failure detection in dynamic systems,”
*Automatica*, vol. 12, no. 6, pp. 601–611, 1976. View at Publisher · View at Google Scholar - J. C. Deckert, M. N. Desai, J. J. Deyst, and A. S. Willsky, “F-8 DFBW sensor failure identification using analytical redundancy,”
*IEEE Transactions on Automatic Control*, vol. 22, no. 5, pp. 795–804, 1977. View at Publisher · View at Google Scholar · View at Scopus - D. E. Gustafson, A. S. Willsky, and J.-Y. Wang, “ECG/VCG rhythm diagnosis using statistical signal analysis. I. Identification of persistent rhythms,”
*IEEE Transactions on Biomedical Engineering*, vol. 25, no. 4, pp. 344–353, 1978. View at Publisher · View at Google Scholar · View at Scopus - M. Basseville and A. Benveniste, “Design and comparative study of some sequential jump detection algorithms for digital signal,”
*IEEE Transactions on Acoustics, Speech, and Signal Processing*, vol. 31, no. 3, pp. 521–535, 1983. View at Publisher · View at Google Scholar · View at Scopus - A. S. Willsky, E. Y. Chow, S. B. Gershwin, C. S. Greene, A. L. Kurkjian, and P. K. Houpt, “Dynamic model-based techniques for the detection of incidents on freeways,”
*IEEE Transactions on Automatic Control*, vol. 25, no. 3, pp. 347–360, 1980. View at Google Scholar - J.-Y. Keller, “Fault isolation filter design for linear stochastic systems,”
*Automatica*, vol. 35, no. 10, pp. 1701–1706, 1999. View at Publisher · View at Google Scholar · View at Scopus - R. V. Beard,
*Failure accommodation in linear systems through self-reorganisation*, Ph.D. thesis, MIT Man Vehicle Laboratory, Cambridge, Mass, USA, 1971. - R. J. Patton, “Fault-tolerant control: the 1997 situation,” in
*Proceedings of the IFAC Symposium on Fault Detection, Supervision and Safety for Technical Processes (SAFEPROCESS '97)*, pp. 1033–1055, Hull, UK, 1997. - J. Chen and R. J. Patton,
*Robust Model-Based Fault Diagnosis for Dynamic Systems*, Kluwer Academic Publishers, Norwell, Mass, USA, 1999. - D. P. Looze, J. L. Weiss, J. S. Eterno, and N. M. Barrett, “An automatic redesign approach for control methods,”
*IEEE Control Systems Magazine*, vol. 5, no. 2, pp. 16–22, 1985. View at Google Scholar · View at Scopus - N. E. Wu, Y. Zhang, and K. Zhou, “Control effectiveness estimation using an adaptive Kalman estimator,” in
*Proceedings of the IEEE International Symposium on Intelligent Control (ISIC '98)*, pp. 181–186, September 1998. View at Scopus - J. Jiang, “Design of reconfigurable control systems using eigenstructure assignments,”
*International Journal of Control*, vol. 59, no. 2, pp. 395–410, 1994. View at Publisher · View at Google Scholar - P. S. Maybeck and R. D. Stevens, “Reconfigurable flight control via multiple model adaptive control methods,”
*IEEE Transactions on Aerospace and Electronic Systems*, vol. 27, no. 3, pp. 470–480, 1991. View at Publisher · View at Google Scholar · View at Scopus - M. Bodson and J. E. Groszkiewicz, “Multivariable adaptive algorithms for reconfigurable flight control,”
*IEEE Transactions on Control Systems Technology*, vol. 5, no. 2, pp. 217–229, 1997. View at Publisher · View at Google Scholar · View at Scopus - A. K. Caglayan, S. M. Allen, and K. Wehmuller, “Evaluation of second generation reconfiguration strategy for aircraft flight control systems subject to actuator failure/surface damage,” in
*Proceeding of the IEEE National Aerospace and Electronics Conference (NAECON '88)*, pp. 520–529, New York, NY, USA. View at Scopus - C. Y. Huang and R. F. Stengel, “Restructurable control using proportional-integral implicit model following,”
*Journal of Guidance, Control, and Dynamics*, vol. 13, no. 2, pp. 303–309, 1990. View at Publisher · View at Google Scholar · View at Scopus - M. Mahmoud, “Stabilizing controllers for a class of discrete time fault tolerant control systems,”
*ICIC Express Letters*, vol. 2, no. 3, pp. 213–218, 2008. View at Google Scholar - M. Mahmoud, “Sufficient conditions for the stabilization of feedback delayed discrete time fault tolerant control systems,”
*International Journal of Innovative Computing, Information and Control*, vol. 5, no. 5, pp. 1137–1145, 2009. View at Google Scholar · View at Scopus - R. Youssef and P. Hui, “Piecewise sliding mode decoupling fault tolerant control system,”
*ICIC Express Letters*, vol. 4, no. 4, pp. 1215–1222, 2010. View at Google Scholar - S. Tong, T. Wang, and W. Zhang, “Fault tolerant control for uncertain fuzzy systems with actuator failures,”
*International Journal of Innovative Computing, Information and Control*, vol. 4, no. 10, pp. 2461–2474, 2008. View at Google Scholar · View at Scopus - B. Friedland, “Treatment of bias in recursive filtering,”
*IEEE Transactions on Automatic Control*, vol. 14, pp. 359–367, 1969. View at Publisher · View at Google Scholar - S. Tanaka,
*Diagnosability of Systems and Optimal Sensor Location*, International Series in Systems and Control Engineering, Prentice Hall, London, UK, 1990. - A. K. Caglayan, “Necessary and sufficient conditions for detectability of jumps in linear systems,”
*IEEE Transactions on Automatic Control*, vol. 25, no. 4, pp. 833–834, 1980. View at Publisher · View at Google Scholar - B. D. O. Anderson and J. B. Moore,
*Optimal Control: Linear Quadratic Methods*, Prentice Hall, Englewood Cliffs, NJ, USA, 1990. - A. S. Willsky, “Detection of abrupt changes in dynamic systems,” in
*Detection of Abrupt Changes in Signals and Dynamical Systems*, Lecture Notes in Control and Information Sciences, pp. 27–49, Springer, New York, NY, USA, 1986. View at Google Scholar - M. Basseville and I. V. Nikiforov,
*Detection of Abrupt Changes Theory and Application*, Prentice Hall, Thomas Kailath, Englewood Cliffs, NJ, USA, 1994.