Mathematical Problems in Engineering

Volume 2012 (2012), Article ID 696742, 15 pages

http://dx.doi.org/10.1155/2012/696742

## Probability-Dependent Static Output Feedback Control for Discrete-Time Nonlinear Stochastic Systems with Missing Measurements

Department of Control Science and Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China

Received 21 June 2012; Accepted 2 August 2012

Academic Editor: Zidong Wang

Copyright © 2012 Wangyan Li et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

This paper is devoted to the problems of gain-scheduled control for a class of discrete-time stochastic systems with infinite-distributed delays and missing measurements by utilizing probability-dependent Lyapunov functional. The missing-measurement phenomenon is assumed to occur in a random way, and the missing probability is time varying with securable upper and lower bounds that can be measured in real time. The purpose is to design a static output feedback controller with scheduled gains such that, for the admissible random missing measurements, time delays, and noises, the closed-loop system is exponentially mean-square stable. At last, a simulation example is exploited to illustrate the effectiveness of the proposed design procedures.

#### 1. Introduction

Gain-scheduling is one of the most popular methods of controller design and has been extensively applied in engineering, such as rotation speed control of engine, aircraft control and process control. Over the past decades, the gain-scheduled control problem has been extensively studied both from theoretical and practical viewpoint, see, for example, [1–6]. For the controller design problems for parameter-varying systems, the gain-scheduling approach has been found to be one of the most effective ones, whose main idea is to design controller gains as functions of the scheduling parameters, which are supposed to be available in real time and, therefore, have much less conservatism than the conventional ones.

On the other hand, instead of using the information of system states, static output feedback (SOF) control directly makes use of system outputs to design controllers, which has also attracted attentions of many researchers over the past two decades, see, for example, [7–12]. It is obvious that the structure of SOF controllers is simple and easy to implement. However, to the best of the authors’ knowledge, there has been little research attention on the control problem for discrete-time nonlinear stochastic systems with a missing phenomenon based on the time-varying occurring probability by a gain-scheduling method.

The missing-measurement phenomenon, due to various reasons such as probabilistic network congestion and intermittent mechanical failures, usually occurs in many real-world systems, which has attracted considerable attention during the past few years, see, for example, [13–15]. The Bernoulli distribution has been successfully applied to model this phenomenon, in which 0 is used to stand for an entire signal missing and 1 denotes the intactness (i.e., there is no signal missing at all), and all sensors have the same missing probability, which is simple and effective and has become very popular during the past years, see, for example, [5, 13, 14, 16]. However, in the practical systems, the occurring probability of the missing-measurement phenomenon might be time varying; consequently, a time-varying Bernoulli distribution model is more suitable for such parameter-varying systems.

In another aspect, considering the signal propagation often distributed during a certain time period, then, a new kind of delays, namely, distributed time-delays, has drawn many researchers’ attention, see, for example, [17–22], but most of the existing works on distributed delays have focused on continuous-time systems which are described either in the form of finite or infinite integral. As we all know, when it comes to implementing the control laws in a digital way, the discrete-time system is much better than continuous-time one. Naturally, it turns out to be meaningful to investigate the issue of how distributed delays influence the dynamical behavior of a discrete-time system. However, as far as authors know, based on gain-scheduled control methods, the SOF control problem for nonlinear stochastic systems with infinite-distributed delays and missing measurements with time-varying occurring probability has not been addressed yet and is still a very interesting and challenging problem.

The main contributions of this paper are summarized as follows: a new SOF control problem is addressed for a class of discrete-time nonlinear stochastic systems with missing measurements and infinite-distributed delays via a gain-scheduling approach; a sequence of stochastic variables satisfying Bernoulli distributions is introduced to describe the time-varying features of the missing measurements in the sensor; a time-varying Lyapunov functional dependent on the missing probability is proposed and then applied to improve the performance of the gain-scheduled controller; and a gain-scheduled controller is designed, in which the controller parameters can be adjusted online according to the missing probabilities estimated through statistical tests.

*Notation 1. * In this paper, , , and denote, respectively, the -dimensional Euclidean space, and the set of all real matrices, the set of all positive integers. refers to the Euclidean norm in . denotes the identity matrix of compatible dimension. The notation (resp., ), where and are symmetric matrices, means that is positive semidefinite (resp., positive definite). For a matrix , and represent its transpose and inverse, respectively. The shorthand denotes a block diagonal matrix with diagonal blocks being the matrices . In symmetric block matrices, the symbol is used as an ellipsis for terms induced by symmetry. Matrices, if they are not explicitly stated, are assumed to have compatible dimensions. In addition, and will, respectively, mean expectation of and probability of .

#### 2. Problem Formulation

Consider the following discrete-time nonlinear stochastic systems with infinite-distributed delays: where is the state, . is a one-dimensional Gaussian white noise sequence satisfying and , is the initial state of the system. , , , , , , and are constant real matrices of appropriate dimensions and is of full-column rank.

The nonlinear function with is assumed as nonlinear disturbances and satisfies the following sector-bounded condition: where is called to belong to the sector and and are given constant real matrices.

For the technique convenience, the nonlinear function can be decomposed into a linear and a nonlinear part as then, from (2.3), we have where .

On the other hand, is the convergence constant that satisfies the following condition:

*Remark 2.1. *The distributed delay is one important type of time delays and has been widely recognized and intensively studied, see, for example, [17–22]. The delay term in the resulted stochastic system (2.1) called infinitely distributed delay. However, almost all existing references concerning distributed delays are concerned with the continuous-time systems, where the distributed delays are described in the form of a finite or infinite integral. In this paper, the constants are assumed to satisfy the convergence conditions (2.6), which can guarantee the convergence of the terms of infinite delays as well as the Lyapunov-Krasovskii functional defined later.

The measurement output with missing sensor data is described as
where is a constant real matrix of appropriate dimensions and is a random white sequence characterizing the probabilistic sensor-data missing, which obeys the following time-varying Bernoulli distribution:
where is a time-varying positive scalar sequence and belongs to with and being the lower and upper bounds of , respectively. In this paper, for simplicity, we assume that , and are uncorrelated.

*Remark 2.2. *In (2.7), a random white sequence satisfying the time-varying Bernoulli distribution is introduced to reflect the missing-measurement phenomenon that has attracted considerable attention in the past few years, see, for example, [13–15]. However, the missing probability in most relevant literatures has always been assumed to be a constant. Such an assumption, unfortunately, tends to be conservative in handling time-varying missing measurements. In this paper, the missing probability is allowed to be time-varying with known lower and upper bounds, which will then be used to schedule controller gains, thereby reducing the possible conservatism.

In this paper, we are interested in designing the following gain-scheduled controller:
where is the controller gain sequence to be designed and assumed as the following structure:
for every time step , is the time-varying parameter of the controller gain, which takes value in and are the constant parameters of the controller gain to be designed.

The closed-loop system of the static output feedback gain-scheduled controller is as follows:

Before formulating the problem to be investigated, we first introduce the following stability concepts.

*Definition 2.3. *The closed-loop system (2.11) is said to be exponentially mean-square stable if, with , there exist constants and such that

In this paper, our purpose is to design a probability-dependent gain-scheduled controller of the form (2.9) for the system (2.1) by exploiting a probability-dependent Lyapunov functional and LMI method such that, for all admissible infinite-distributed delays, missing measurements with time-varying probability, and exogenous stochastic noises, the closed-loop system (2.11) is exponentially mean-square stable.

#### 3. Main Results

The following lemmas will be used in the proofs of our main results in this paper.

Lemma 3.1 ([Schur complement] see[23]). *Given constant matrices where and , then if and only if
*

Lemma 3.2 (see [24]). *Let M be a positive semidefinite matrix, and constant . If the series concerned is convergent, then one has
*

Lemma 3.3 (see [25]). *Let the matrix be of full-column rank. There always exist two orthogonal matrices and such that
**
If matrix has the following structure:
**
where , , , then there exists a nonsingular matrix such that . *

In the following theorem, a probability-dependent gain-scheduled static output feedback control problem is dealt with for a class of discrete-time nonlinear stochastic systems (2.1) by exploiting Lyapunov theory and LMI method. A sufficient condition is derived to guarantee the solvability of the desired gain-scheduled control problem and, simultaneously, the parameters of the gain-scheduled controller can be obtained by solving the LMIs and the measured time-varying probability.

Theorem 3.4. *Consider the discrete-time nonlinear stochastic systems (2.11). If there exist positive-definite matrices and , slack matrix and nonsingular matrices and , such that the following LMIs hold:
**
where
**
in this case, the constant gains of the desired controller can be obtained as follows:
**
and the closed-system (2.11) is then exponentially mean-square stable for all . *

*Proof. *Define the Lyapunov functional:
Then, noting , and , we can get that
From Lemma 3.2, it is obvious that
Denote the following matrix variables
Combining (3.9), (3.10), and (3.11), we can get
If , we can conclude the following matrix inequalities by Schur complement:
with .

At this time, preforming the congruence transformation to (3.13), we can have
then from inequality
we can get
and from lemma 3, we have denoting , and . Then (3.16) can be written as
Furthermore, by Lemma 3.1, we can know from that and, subsequently,
where is the minimum eigenvalue of . Finally, we can confirm from Lemma 1 of [13] that the closed-loop system is exponentially mean-square stable, then the proof of this theorem is complete.

*Remark 3.5. *In the above theorem, a static output feedback controller has been designed based on a set of LMIs. However, the LMIs are actually infinite owing to the time-varying parameter . In this case, the desired controller cannot be obtained directly from Theorem 3.4 due to the infinite number of LMIs. To handle such a problem, in the next theorem, we have to convert this problem to a computationally accessible one by assigning a specific form to . Let us set .

Theorem 3.6. *Consider the discrete-time nonlinear stochastic system with infinite-distributed delays and missing measurements (2.11). If there exist positive-difinite matrices , and , slack matrix and nonsingular matrices and , such that the following LMIs hold:
**
where
**
the constant gains of the desired controller can be obtained as follows:
**
and the closed-system (2.11) is then exponentially mean-square stable for all .*

*Proof. *Firstly, set
then, we have
with and . Similarly, let
then we have
with , . From the above transformation, we can easily get
On the other hand, it is easy to find that
From (3.22)–(3.27), we can have that (3.5) in Theorem 3.4 is true, then the proof is now complete.

*Remark 3.7. *The above conclusions can be extended to multiple sensor case of measurement output. In this paper, to make the main idea and the proof more clear and concise, we choose the single sensor.

#### 4. An Illustrative Example

In this section, the gain-scheduled static output feedback controller is designed for the discrete-time nonlinear stochastic systems with infinite-distributed delays and missing measurements.

The system parameters are given as follows:

Set the time-varying Bernoulli distribution sequences as and the sector nonlinear function is taken as which satisfies (2.3). Also, select the initial state as follows: .

According to Theorem 3.6, the constant controller parameters , can be obtained as follows:

Then, according to the measured time-varying probability parameters , the gain-scheduled controller gain and parameter-dependent Lyapunov matrix can be calculated at every time step as in Table 1.

Figure 1 gives the response curves of state of uncontrolled systems. Figure 2 depicts the simulation results of state of the controlled systems. The simulation results have illustrated our theoretical analysis.

#### 5. Conclusions

In this paper, the problem of gain-scheduled control for a class of discrete stochastic systems with infinite-distributed delays and missing measurements has been studied, the missing-measurement phenomenon is assumed to occur in a random way, the missing probability is governed by an individual random variable satisfying a certain probabilistic distribution in the interval , and distributed delays are described in a discrete way. By employing probability-dependent Lyapunov functional, we have designed a gain-scheduled controller with the gain including both constant parameters and time-varying parameters such that, for the admissible missing measurements with time-varying probability, infinite-distributed delays, and noise disturbances, the closed-loop system is exponentially mean-square stable. Moreover, we can extend the main results to more complex and realistic systems, for instance, system with norm-bounded or polytopic uncertainties. Meanwhile, we can also consider dynamic output feedback control problem for discrete stochastic systems with missing measurements by gain-scheduling approach as well as the relevant applications in networked control system or robotic manipulator.

#### Acknowledgments

This work was supported in part by the National Natural Science Foundation of China under Grant 61074016, the Program for Professor of Special Appointment (Eastern Scholar) at Shanghai Institutions of Higher Learning, the Program for New Century Excellent Talents in University under Grant NCET-11-1051, the Shanghai Natural Science Foundation of China under Grant 10ZR1421200, the Leverhulme Trust of the UK, the Alexander von Humboldt Foundation of Germany, and the Innovation Fund Project for Graduate Student of Shanghai under Grant JWCXSL1202.

#### References

- P. Apkarian and R. J. Adams, “Advanced gain-scheduling techniques for uncertain systems,”
*IEEE Transactions On Control Systems Technology*, vol. 6, no. 1, pp. 21–32, 1998. View at Google Scholar - Y. Y. Cao, Z. Lin, and Y. Shamash, “Set invariance analysis and gain-scheduling control for LPV systems subject to actuator saturation,”
*Systems & Control Letters*, vol. 46, no. 2, pp. 137–151, 2002. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - W. H. Chen, Z. H. Guan, and X. Lu, “Delay-dependent exponential stability of uncertain stochastic systems with multiple delays: an LMI approach,”
*Systems & Control Letters*, vol. 54, no. 6, pp. 547–555, 2005. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - W. J. Rugh and J. S. Shamma, “Research on gain scheduling,”
*Automatica*, vol. 36, no. 10, pp. 1401–1425, 2000. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - G. Wei, Z. Wang, and B. Shen, “Probability-dependent gain-scheduled filtering for stochastic systems with missing measure-
ments,”
*IEEE Transactions on Circuits and Systems II: Express Briefs*, vol. 58, no. 11, pp. 753–757, 2011. View at Google Scholar - G. Wei, Z. Wang, and B. Shen, “Probability-dependent gain-scheduled control for discrete stochastic delayed systems with
randomly occurring nonlinearities,”
*International Journal of Robust and Nonlinear Control*, 2012. View at Publisher · View at Google Scholar - Y. Y. Cao, J. Lam, and Y. X. Sun, “Static output feedback stabiliztion: an LMI approach,”
*Automatica*, vol. 34, no. 12, pp. 1641–1645, 1998. View at Google Scholar - J. C. Geromel, C. C. de Souza, and R. E. Skelton, “Static output feedback controllers: stability and convexity,”
*IEEE Transactions on Automatic Control*, vol. 43, no. 1, pp. 120–125, 1998. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - I. N. Kar, “Design of static output feedback controller for uncertain systems,”
*Automatica*, vol. 35, no. 1, pp. 169–175, 1999. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - R. E. Benton, Jr. and D. Smith, “Static output feedback stabilization with prescribed degree of stability,”
*IEEE Transactions on Automatic Control*, vol. 43, no. 10, pp. 1493–1496, 1998. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - E. Prempain and I. Postlethwaite, “Static output feedback stabilisation with ${H}_{\infty}$ performance for a class of plants,”
*Systems & Control Letters*, vol. 43, no. 3, pp. 159–166, 2001. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - V. L. Syrmos, C. T. Abdallah, P. Dorato, and K. Grigoriadis, “Static output feedback—a survey,”
*Automatica*, vol. 33, no. 2, pp. 125–137, 1997. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - Z. Wang F, Yang, D. W. C. Ho, and X. Liu, “Robust ${H}_{\infty}$ filtering for stochastic time-delay systems with missing measurements,”
*IEEE Transactions on Signal Processing*, vol. 54, no. 7, pp. 2579–2587, 2006. View at Google Scholar - H. Gao and T. Chen, “${H}_{\infty}$ estimation for uncertain systems with limited communication capacity,”
*Institute of Electrical and Electronics Engineers. Transactions on Automatic Control*, vol. 52, no. 11, pp. 2070–2084, 2007. View at Publisher · View at Google Scholar - G. Wei, Z. Wang, X. He, and H. Shu, “Filtering for networked stochastic time-delay systems with sector nonlinearity,” vol. 56, no. 1, pp. 71–75, 2009. View at Google Scholar
- G. Wei, Z. Wang, and H. Shu, “Robust filtering with stochastic nonlinearities and multiple missing measurements,”
*Automatica*, vol. 45, no. 3, pp. 836–841, 2009. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - Y. Kuang, H. L. Smith, and R. H. Martin, “Global stability for infinite-delay, dispersive Lotka-Volterra systems: weakly interacting populations in nearly identical patches,”
*Journal of Dynamics and Differential Equations*, vol. 3, no. 3, pp. 339–360, 1991. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - Y. Liu, Z. Wang, and X. Liu, “Robust ${H}_{\infty}$ control for a class of nonlinear stochastic systems with mixed time delay,”
*International Journal of Robust and Nonlinear Control*, vol. 17, no. 16, pp. 1525–1551, 2007. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - L. Xie, E. Fridman, and U. Shaked, “Robust ${H}_{\infty}$ control of distributed delay systems with application to combustion control,”
*Institute of Electrical and Electronics Engineers. Transactions on Automatic Control*, vol. 46, no. 12, pp. 1930–1935, 2001. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - Z. Wang, G. Wei, and G. Feng, “Reliable ${H}_{\infty}$ control for discrete-time piecewise linear systems with infinite distributed delays,”
*Automatica*, vol. 45, no. 12, pp. 2991–2994, 2009. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - Z. Wang, Y. Liu, G. Wei, and X. Liu, “A note on control of a class of discrete-time stochastic systems with distributed delays and nonlinear disturbances,”
*Automatica*, vol. 46, no. 3, pp. 543–548, 2010. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - G. Wei, G. Feng, and Z. Wang, “Robust ${H}_{\infty}$ control for discrete-time fuzzy systems with infinite-distributed delays,”
*IEEE Transactions on Fuzzy Systems*, vol. 17, no. 1, pp. 224–232, 2009. View at Google Scholar - S. Boyd, L. El Ghaoui, E. Feron, and V. Balakrishnan,
*Linear Matrix Inequalities in System and Control Theory*, vol. 15, Society for Industrial and Applied Mathematics (SIAM), Philadelphia, Pa, USA, 1994. View at Publisher · View at Google Scholar - Y. Liu, Z. Wang, J. Liang, and X. Liu, “Synchronization and state estimation for discrete-time complex networks with distributed delays,”
*Transactions on Systems, Man and Cybernetics B*, vol. 38, no. 5, pp. 1314–1325, 2008. View at Google Scholar - F. Yang, Z. Wang, Y. S. Hung, and M. Gani, “${H}_{\infty}$ control for networked systems with random communication delays,”
*IEEE Transactions on Automatic Control*, vol. 51, no. 3, pp. 511–518, 2006. View at Publisher · View at Google Scholar