## Recent Developments on the Stability and Control of Stochastic Systems

View this Special IssueResearch Article | Open Access

# Study on Index of Stochastic Linear Continuous-Time Systems

**Academic Editor:**Ruihua Liu

#### Abstract

This paper studies the index problem. We obtain a necessary and sufficient condition of index larger than . A generalized differential equation is introduced and it is proved that its solvability and the feasibility of the index are equivalent. We extend the deterministic cases to the stochastic models. Our results can be used to fault detection filter analysis. Finally, the effectiveness of the proposed results is illustrated by an example.

#### 1. Introduction

It is well known that many control and filtering problems have been discussed based on a certain performance index of a system, such as norm, norm, and index; see [1–9]. norm is the measure of the worst-case disturbance inputs on the controlled outputs [1–4]. The index is a measure of the minimum sensitivity of system outputs to system inputs. norm and index with specific application to fault detection filter have been carried out in [10–17]. To ensure robustness, index should be maximized and norm should be minimized. Using performance can make certain that the residual signal is maximally sensitive to faults and highly robust to disturbance inputs; see [16, 17].

In [12], index was defined as the minimum nonzero singular value in zero frequency. In [10], the authors extended the results of [12] to all frequency range. By means of LMIs, a necessary and sufficient condition was given for the infinite frequency range. The case for finite frequency range was concluded through frequency weighting. In recent decades, a great deal of attention has been attracted to index in time domain. A fault residual generator was designed to maximize the fault sensitivity in the finite time domain [16–20]. Based on index, results on optimal fault detection can be found in [17, 18] and the references. The lower bound of index for linear time-varying systems was proposed in [19, 20]. A sliding mode observer was designed for sensor fault diagnosis of nonlinear time-delay systems; see [21]. In [22], a fault-tolerant controller was projected to compensate nonlinear faults by using a fuzzy adaptive fault observer.

Although there is much work on the index problem, to the best of our knowledge, very little work was concerned with the index in stochastic systems. In this paper, the index for stochastic linear continuous-time systems is discussed. The definition of the index is extended to the stochastic case. We present a necessary and sufficient condition of the index. A generalized differential equation is introduced and it is proved that its solvability and the feasibility of the index are equivalent. Comparing our results with the bounded real lemma [2, 9], it shows that the index is not completely dual to norm. The index discussed in this paper is only for* tall* or* square* systems. The reason for this is that index is zero for* wide* systems. But bounded real lemma for is applicable to any systems. Finally, the effectiveness of the given methods is illustrated by numerical example.

The outline of the paper is organized as follows. In Section 2, some efficient criteria are given for the index of stochastic linear systems in finite horizon. Section 3 contains an example provided to show the efficiency of the proposed results. Finally, we conclude this paper in Section 4.

*Notations. * is the field of real numbers. is the vector space of all matrices with entries in . is the set of all real symmetric matrices . is the transpose of matrix . is the inverse of . Given positive semidefinite (positive definite) matrix , we denote it by (). is the mathematical expectation. is identity matrix. is zero matrix. is the space of nonanticipative stochastic process with respect to increasing -algebras () satisfying , where . A* square* (*wide* or* tall*) system denotes a system when the number of inputs equals (is more than or less than) the outputs number.

#### 2. Finite Horizon Stochastic Index

In this section, we will discuss the index problem of stochastic linear continuous-time systems. We give a necessary and sufficient condition of the index larger than in finite horizon.

Consider the following stochastic linear time-varying system :In the above, is the one-dimensional standard Wiener process defined on the complete probability space , with the natural filter generated by up to time . Consider , , and are the system state, control input, and regulated output, respectively. , , , , , and are coefficients with appropriate dimensions. For any and , there exists unique solution of (1).

The finite horizon stochastic index of system (1) can be stated as follows.

*Definition 1. *For stochastic system (1), given , its index in is defined aswhere .

*Remark 2. *If is fault signal and is the residual, then the index describes the smallest fault sensitivity of system (1). In this paper, we suppose that system (1) is* tall* or* square* because the index is zero for* wide* system.

Given and , letWe will study the following optimal problem:

*Remark 3. *It can be shown that is equivalent to the following inequality, .

*Remark 4. *When , (2) corresponds to the infinite horizon case.

Lemma 5. *Suppose is continuously differentiable, . Then, for every , ,**where ,*

*Proof. *Let , , and denote the corresponding solution of (1). Applying Ito’s formula to and taking expectations, we have that, for any ,whereSowhich ends the proof.

Below, we prove the following theorem which is necessary in this paper.

Theorem 6. *For (1) and some given , if the following differential Riccati equation**admits solution on , then .*

*Proof. *By Lemma 5, for every , , , we conclude thatBy using completion of squares argument and the first equality in (11), we havewhere .

From , , to show , we define the operator : with its realization:Then exists, which is determined bywhere .

We assume that , , so there exists constant , such thatThat is, .

Now, we consider the following equation:where and this equation has unique solution , .

It is easy to see that (17) satisfies the following equation:

Lemma 7. *Suppose and is the solution of (18). Then if , one obtains**where is the solution of**with and**As , then*

*Proof. *In terms of Lemma 5 with and for ,This means that (19) holds. Let in (19); we obtain (22).

Now we are in a position to prove that is invertible for .

Lemma 8. *For system (1), if for some given , , , and satisfies (18). Then,*

*Proof. *Let us first prove that . Suppose this is false; then there exists , , such that for some . Then, for sufficiently small ,DefineUsing Lemma 7 with this and , we can derive that for andSince is continuous and , (27) is negative. Moreover, the condition implies . As a result, this is a contradiction. If , we can replace by and use a similar proof.

Next, let for any and . Replacing with in (18), we obtain the corresponding solution . Applying the previous step, we can deduce that . For any , set , . Let be the solution of (18) with replaced by and replaced by on . Then, , . By (22), for any , ,and so . By continuity, for all . As this holds for arbitrary , it follows that . This completes the proof.

*Remark 9. *When , (24) becomes . If system (1) is time-invariant, then

*Remark 10. *By the equality , we have that . If system (1) is time-invariant and square, by (29),

Now, we present the following theorem which is important in this paper.

Theorem 11. *Suppose system (1) is time-invariant and square and satisfies for given . Then (11) has a unique solution on for every . Moreover, is minimized by the feedback control:**where satisfies **and the optimal cost is*

*Proof. *We prove that implies the existence of solution of (11) on . Using a contradiction argument, we suppose that (11) does not admit a solution. By the standard theory of differential equations, there exists unique solution backward in time on maximal interval (), and as , becomes unbounded.

Let , , , , by completing the squares; thenObviously,where .

Furthermore, we can see thatFrom Remark 10,where . Considering (35), we getwhich implies thatBy linearity, the solution of (1) with initial state satisfiesSuppose is the solution ofand we haveTake ,and it is easy to show thatIt follows thatIt is obvious that there exists constant such thatSo, there is constant such thatIn addition,From (45), we haveIn view of (35) and (39), it yieldsSo, can not become unbounded as , which means that (11) has unique solution on .

Setting , , in (17), from (31), we obtainHence satisfies (17), or equivalently (18). So By (31), and, in terms of Lemma 7, But by Lemma 8, Hence, minimizes and .

According to Theorems 6 and 11, we get the following theorem.

Theorem 12. *If system (1) is time-invariant and square, for given , the following are equivalent:*(i)*Consider .*(ii)*The following equation**has unique solution on . Moreover, .*

*Remark 13. *For given , if we replace , , , and with , , , and , respectively, and with in (1), we deduce the corresponding index andWhen , then . Using Theorem 12 to the modified data, it is easy to see that the following equationhas unique solution on . Moreover, .

Now, we are to show what happens as increases.

Theorem 14. *If system (1) is time-invariant and square, for some . Then in (56) decreases as increases for every .*

*Proof. *Suppose , , and . Let be optimal for on , and setBy the time invariance of , . Then,This means that decreases as increases for every .

#### 3. A Numerical Example

Below, we give a numerical example to illustrate the rightness of Theorems 12 and 14.

*Example 1. *In system (1), we consider a two-dimensional linear stochastic system with the following parameters:Set , ; by solving (56), we can obtain the solutions of for which their trajectories are shown in Figure 1. If we set , then it yieldsIt is easy to see that , which verifies the rightness of Theorem 14.

#### 4. Conclusion

In this paper, we have solved the index problem where both stochastic and deterministic perturbations are present. Necessary and sufficient condition for the lower bound of index is given by means of the solvability of a generalized differential equation. The proposed results are not completely dual to norm, and the effectiveness of the given methods is illustrated by numerical example.

#### Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

#### Acknowledgments

This work is supported by National Natural Science Foundation of China (Grants nos. 61174078, 61170054, and 61402265) and the Research Fund for the Taishan Scholar Project of Shandong Province of China.

#### References

- K. Zhou, J. C. Doyle, and K. Clover,
*Robust and Optimal Control*, Prentice Hall, Upper Saddle River, NJ, USA, 1996. - B.-S. Chen and W. Zhang, “Stochastic ${\mathcal{H}}_{2}/{\mathcal{H}}_{\infty}$ control with state-dependent noise,”
*IEEE Transactions on Automatic Control*, vol. 49, no. 1, pp. 45–57, 2004. View at: Publisher Site | Google Scholar - W. H. Zhang and B.-S. Chen, “State feedback ${\mathcal{H}}_{\infty}$ control for a class of nonlinear stochastic systems,”
*SIAM Journal on Control and Optimization*, vol. 44, no. 6, pp. 1973–1991, 2006. View at: Publisher Site | Google Scholar - W. Zhang, H. Zhang, and B.-S. Chen, “Generalized Lyapunov equation approach to state-dependent stochastic stabilization/detectability criterion,”
*IEEE Transactions on Automatic Control*, vol. 53, no. 7, pp. 1630–1642, 2008. View at: Publisher Site | Google Scholar - Q. X. Zhu, “Asymptotic stability in the
*p*th moment for stochastic differential equations with Lévy noise,”*Journal of Mathematical Analysis and Applications*, vol. 416, no. 1, pp. 126–142, 2014. View at: Publisher Site | Google Scholar | MathSciNet - Q. Zhu and J. Cao, “Stability of Markovian jump neural networks with impulse control and time varying delays,”
*Nonlinear Analysis: Real World Applications*, vol. 13, no. 5, pp. 2259–2270, 2012. View at: Publisher Site | Google Scholar - Q. X. Zhu, J. D. Cao, and R. Rakkiyappan, “Exponential input-to-state stability of stochastic Cohen-Grossberg neural networks with mixed delays,”
*Nonlinear Dynamics*, vol. 79, no. 2, pp. 1085–1098, 2015. View at: Google Scholar - Q. X. Zhu and J. D. Cao, “Mean-square exponential input-to-state stability of stochastic delayed neural networks,”
*Neurocomputing*, vol. 131, pp. 157–163, 2014. View at: Publisher Site | Google Scholar - D. Hinrichsen and A. J. Pritchard, “Stochastic ${\mathcal{H}}_{\infty}$,”
*SIAM Journal on Control and Optimization*, vol. 36, no. 5, pp. 1504–1538, 1998. View at: Publisher Site | Google Scholar - J. Liu, J. L. Wang, and G.-H. Yang, “An LMI approach to minimum sensitivity analysis with application to fault detection,”
*Automatica*, vol. 41, no. 11, pp. 1995–2004, 2005. View at: Publisher Site | Google Scholar - J. L. Wang, G. H. Yang, and J. Liu, “An LMI approach to ${\mathcal{H}}_{-}$ index and mixed ${\mathcal{H}}_{-}/{\mathcal{H}}_{\infty}$ fault detection observer design,”
*Automatica*, vol. 43, pp. 1656–1665, 2007. View at: Google Scholar - J. Chen and R. J. Pattor,
*Robust Model-Based Fault Diagnosis for Dynamic Systems*, Kluwer Academic Publishers, Boston, Mass, USA, 1999. - I. Hwang, S. Kim, Y. Kim, and C. E. Seah, “A survey of fault detection, isolation, and reconfiguration methods,”
*IEEE Transactions on Control Systems Technology*, vol. 18, no. 3, pp. 636–653, 2010. View at: Publisher Site | Google Scholar - S. Yin, S. X. Ding, A. Haghani, H. Hao, and P. Zhang, “A comparison study of basic data-driven fault diagnosis and process monitoring methods on the benchmark Tennessee Eastman process,”
*Journal of Process Control*, vol. 22, no. 9, pp. 1567–1581, 2012. View at: Publisher Site | Google Scholar - D. Wang, P. Shi, and W. Wang, “Robust fault detection for continuous-time switched delay systems: an linear matrix inequality approach,”
*IET Control Theory and Applications*, vol. 4, no. 1, pp. 100–108, 2010. View at: Publisher Site | Google Scholar - S. Yin, H. Luo, and S. X. Ding, “Real-time implementation of fault-tolerant control systems with performance optimization,”
*IEEE Transactions on Industrial Electronics*, vol. 61, no. 5, pp. 2402–2411, 2014. View at: Publisher Site | Google Scholar - K. Iftikha, P. Q. Khan, and M. Abid, “Optimal fault detection filter design for switched linear systems,”
*Nonlinear Analysis*, vol. 15, pp. 132–144, 2015. View at: Google Scholar - M. Zhong, S. X. Ding, and E. L. Ding, “Optimal fault detection for linear discrete time-varying systems,”
*Automatica*, vol. 46, no. 8, pp. 1395–1400, 2010. View at: Publisher Site | Google Scholar - X. B. Li and H. H. T. Liu, “Characterization of ${\mathcal{H}}_{-}$ index for linear time-varying systems,”
*Automatica*, vol. 49, no. 3, pp. 1449–1457, 2013. View at: Publisher Site | Google Scholar - X. Li and H. H. T. Liu, “Minimum system sensitivity study of linear discrete time systems for fault detection,”
*Mathematical Problems in Engineering*, vol. 2013, Article ID 276987, 13 pages, 2013. View at: Publisher Site | Google Scholar - M. Chen, C.-S. Jiang, and Q.-X. Wu, “Sensor fault diagnosis for a class of time delay uncertain nonlinear systems using neural network,”
*International Journal of Automation and Computing*, vol. 5, no. 4, pp. 401–405, 2008. View at: Publisher Site | Google Scholar - K. Zhang, B. Jiang, and P. Shi, “A new approach to observer-based fault-tolerant controller design for Takagi-Sugeno fuzzy systems with state delay,”
*Circuits, Systems, and Signal Processing*, vol. 28, no. 5, pp. 679–697, 2009. View at: Publisher Site | Google Scholar | Zentralblatt MATH

#### Copyright

Copyright © 2015 Yan Li et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.