Research Article | Open Access

# Observer-Based Stabilization of Stochastic Systems with Limited Communication

**Academic Editor:**Zidong Wang

#### Abstract

This paper studies the problem of observer-based stabilization of stochastic nonlinear systems with limited communication. A communication channel exists between the output of the plant and the input of the dynamic controller, which is considered network-induced delays, data packet dropouts, and measurement quantization. A new stability criterion is derived for the stochastic nonlinear system by using the Lyapunov functional approach. Based on this, the design procedure of observer-based controller is presented, which ensures asymptotic stability in the meansquare of the closed-loop system. Finally, an illustrative example is given to illustrate the effectiveness of the proposed design techniques.

#### 1. Introduction

Stochastic variables frequently exist in practical systems such as aircraft systems, biology systems, and electronic circuits. Without taking them into account in the system design, the stochastic variables can bring negative effects on the performance of control systems and even make the systems unstable. According to the way stochastic variable occurs, stochastic system mode can be classified as Itô stochastic differential equation [1, 2], Markov switched systems [3–5], and other systems with stochastic variables [6–9]. Since the introduction of the concept of stochastic differential equation by Itô [10] in 1951, Itô stochastic system model has been used successfully in numerous applications, such as the analysis of stock systems and prediction for ecosystem. In automatic control of stochastic systems, a great number of important results have been reported in the literature [11, 12].

In the past two decades, network-based control technology has been developed to combine a communication network with conventional control systems to form the Network Control Systems (NCSs), which have wide applications due to their advantages, such as reduced weight, power requirements, low installation cost, and easy maintenance [13]. Since the capacity of the communication channel is limited [14–16], signal transmission delay and data packet dropout are two fundamental problems in NCSs. To deal with these issues, considerable research results on this topic have been reported, see for example [17–20] and the references therein. In [21], the robust control problem was considered for a class of networked systems with random communication packet losses.

Among the reported results, most NCSs are mainly based on deterministic physical plant. However, stochastic systems models also have wide applications in the dynamical systems. This has motivated the researches on networked control for stochastic systems and many results have been reported in the literature. In [22], the problem of network-based control for stochastic plants was studied, and a new model of stochastic time-delay systems was presented including both network-induced delays and packet dropouts. In [23], the problem of sampled-data control for networked control systems was considered. In recent years, much attention is paid to the problem of the observer-based controller design for NCSs [24–27]. In [28], the problem of the NCS design for continuous-time systems with random measurement was investigated, where the measurement channel is assumed to be subjected to random sensor delay. To the authors' knowledge, the problem of observer-based controller design for stochastic nonlinear systems with limited communication has not been fully investigated and still remains challenging, which motivates us for the present study.

In this paper, we investigate the problem of observer-based stabilization of stochastic nonlinear systems with limited communication. A new model is proposed to describe the stochastic nonlinear systems with a communication channel, which exists between the output of the stochastic plant and the input of the observer-based controller. Based on this, the design procedure of observer-based controller is proposed, which ensures the asymptotic stability of the resulting closed-loop system. Finally, a mechanical system example consisted of two cars, a spring and a damper, is given to illustrate the effectiveness of the proposed controller design method.

*Notation*. The notation used throughout the paper is fairly standard. denotes the *n*-dimensional Euclidean space and the notation (≥0 means that is real symmetric and positive definite (semidefinite). In symmetric block matrices or complex matrix expressions, we use an asterisk () to represent a term that is induced by symmetry and standing for a block-diagonal matrix. is defined as . Matrices, if their dimensions are not explicitly stated, are assumed to be compatible for algebraic operations. means the expectation of . The space of square-integrable vector functions over is denoted by , and for , its norm is given by: .

#### 2. Problem Formulation

Consider the following stochastic nonlinear system: where is the state vector; is the control input; is the control output; is unknown nonlinear function; and are constant matrices with an appropriate dimension; is the maximum delay; is a zero-mean real scalar Wiener process, which satisfies and .

For system (2.1), it is assumed that the states are not fully measured. Thus, we consider the following observer-based controller: where is the estimation of the state vector ; denotes the output of the zero-order hold (ZOH); and are the controller and observer gains.

Under control law (2.2), the closed-loop system in (2.1) is given by

The structure of the stochastic systems with limited communication is shown in Figure 1. In this system, for convenience of analysis, it is assumed that communication delay occurs only in the sampler-to-controller side. The stochastic plant continuously sends the output signal to the controller by a network. is firstly sampled by the sampler, which is assumed to be clock-driven. Then, , where denotes the sampling instant for , is encoded and decoded by the quantizer and sent to ZOH, which are assumed to be event-driven. and are the input of the observer-based controller and is the output of the observer-based controller.

In this paper, the quantizer is chosen as the logarithmic quantizer. The set of quantized levels is described by: Each of the quantization level corresponds to a segment such that the quantizer maps the whole segment to this quantization level. In addition, these segments form a partition of , that is, they are disjoint and their union for equals to . For the logarithmic quantizer, the associated quantizer is defined as where .

When taking into account signal transmission delays from sampler to ZOH, the quantized output signal takes the following form: Considering the behavior of the ZOH, we have with being the next updating instant of the ZOH after .

A natural assumption on the network induced delays can be made as where denotes the maximum delay. In addition, at the updating instant the number of accumulated data packet dropouts since the last updating instant is denoted as . We assume that the maximum number of data packet dropouts is , that is, Then, it can be seen from (2.8) and (2.9) that where denotes the sampling period.

As the time sequence depends on both the network-induced delays and data packet dropouts, the period for the sampled-data system in (2.3) is variable and uncertain. Now let us represent in (2.7) as where Then, from (2.10) we have where

Considering the quantization shown in (2.5) and by substituting (2.11) into (2.7), (2.2) can be expressed as where with Defining the estimation error , we obtain

Before proceeding further, we introduce the following assumption and lemma, which will be used in subsequent developments.

*Assumption 2.1. *For a stochastic system mode, there exists known real constant matrices , such that the unknown nonlinear vector function satisfies the following boundedness condition:

Lemma 2.2 (see [29]). *Given appropriately dimensioned matrices and , with , then,
**
holds for all satisfying if and only if for some ,
*

#### 3. Main Results

In this section, the problem of asymptotical stabilization of stochastic system with limited communication is studied. We are first concerned with the asymptotical stability analysis problem. The following theorem develops a sufficient condition for system (2.18) to be asymptotically stable in the meansquare.

Theorem 3.1. *The nominal stochastic system (2.18) is asymptotically stable in the mean square if there exist scalars , (, , ) and matrices , , , , () satisfying
**
where
*

*Proof. *For technical convenience, we rewrite (2.18) as
where
Now, choose the following Lyapunov-Krasovskii functional:
where , , are matrices to be determined. Then, by Itô's formula and from (3.5), we obtain the stochastic differential as
and
where
From (2.19), we obtain
where and are positive constants. Then, taking expectation on both sides of (3.7), we have
where
Note that and , thus and are nonpositive. Therefore, from (3.10) we know that if
which by Schur complements, is equivalent to
where . Now, rewrite (3.13) in the form (2.20) with
By Lemma 2.2 together with a Schur complement operation, (3.13) holds if for some , (3.1) holds. Thus, we have
which ensures that the closed-loop system in (2.18) is asymptotically stable by [30]. Theorem 3.1 is proved.

Since our main objective is to design and to stabilize the system (2.18), (3.1) is actually a nonlinear matrix inequality. We will transform them into tractable conditions to solve the control synthesis problem.

Theorem 3.2. *There exists an observer-based controller such that the closed-loop system in (2.18) is asymptotically stable in the mean square if there exist scalars (, , ) and matrices , , , , , and , , , , satisfying
**
where
**Moreover, if the above conditions are satisfied, a desired controller gain and observer gain are given as follows:
*

*Proof. *Define the following matrix:
Perform a congruence transformation to (3.1) by , which are to exchange the first row and the forth row with the third row and the sixth row, then exchange the first column and the forth column with the third column and the sixth column.

Then, by using Lemma 1 in [25] and Theorem 3.2, we have
where
Perform a congruence transformation to (3.22) by with . Defining , we have (3.16). Performing a congruence transformation to (3.23) by with and defining , , , , and we have (3.17). We can solve the inequalities (3.18) by using of the cone complementarity linearization (CCL) algorithm in [31]. The proof is completed.

#### 4. Illustrative Example

In this section, we use a mechanical example to illustrate the applicability of the theoretical results developed in this paper.

The controlled plant is a mechanical system consisted of two cars, a spring, and a damper, as shown in Figure 2. The objective is to design controllers such that the system will maintain the zero position ( and ) when the disturbance disappears. and denote the two car mass, respectively; is the elastic coefficient of the spring; is the viscous damping coefficient of the damper; denotes control input; and are the displacements of the two cars, respectively. The right is the positive direction of the force and the displacement. When , the balance positions are the zero place of the two cars and .

Choose the following set of state variables:

The equations of the mechanical system are in the following: The parameters of the mechanical system are kg, kg, N/m, and Ns/m. Then the state-space matrices are given by The eigenvalues of are , and thus this system is unstable. Our objective is to design an observer-based controller in the form of (2.2) such that the closed-loop system (2.1) is asymptotically stable in mean square. The network-related parameters are assumed: the sampling period ms, the maximum delay ms, the maximum number of data packet dropouts , the quantizer parameters , and . By Theorem 3.2, we obtain the following matrices (other associated matrices are omitted here): According to (3.20), the gain matrices for the observer-based controller is given by: In the following, we provide simulation results. The initial condition is assumed to be . The state responses are depicted in Figure 3, from which we can see that all the four state components of the closed-loop system converge to zero. In the simulation, the network-induced delays and the data packet dropouts are generated randomly (uniformly distributed within their ranges) according to the above assumptions, and shown in Figures 4 and 5. The output signals and the successfully transmitted signal arriving at the ZOH (denotes as in figure) are shown in Figure 6, where we can see the discontinuous behavior of the transmitted measurements.

**(a)**

**(b)**

**(c)**

**(d)**

**(a)**

**(b)**

#### 5. Conclusion

In this paper, the problem of observer-based stabilization of the stochastic nonlinear systems with limited communication has been studied. A new model has been proposed to describe the stochastic nonlinear systems with a communication channel, which exists between the output of the physical plant and the input of the dynamic controller. Based on this, the design procedure of observer-based controller has been proposed, which guarantees the asymptotic stability of the closed-loop systems. Finally, a mechanical system example is given to show the effectiveness of the proposed controller design method.

#### Acknowledgments

This work was partly supported by the Postdoctoral Science Foundation of China (2011M501076), the Research Foundation of Education Bureau of Heilongjiang province (11551492), the National Key Basic Research Program of China (2012CB215202), the 111 Project (B12018), and the National Natural Science Foundation of China (61174058).

#### References

- X. X. Liao and X. Mao, “Exponential stability of stochastic delay interval systems,”
*Systems & Control Letters*, vol. 40, no. 3, pp. 171–181, 2000. View at: Publisher Site | Google Scholar | Zentralblatt MATH - Z. Mao, B. Jiang, and P. Shi, “Fault-tolerant control for a class of nonlinear sampled-data systems via a Euler approximate observer,”
*Automatica*, vol. 46, no. 11, pp. 1852–1859, 2010. View at: Publisher Site | Google Scholar | Zentralblatt MATH - Z. Wang, Y. Liu, and X. Liu, “Exponential stabilization of a class of stochastic system with Markovian jump parameters and mode-dependent mixed time-delays,”
*IEEE Transactions on Automatic Control*, vol. 55, no. 7, pp. 1656–1662, 2010. View at: Publisher Site | Google Scholar - H. R. Karimi, “Robust delay-dependent ${H}_{\infty}$ control of uncertain time-delay systems with mixed neutral, discrete, and distributed time-delays and Markovian switching parameters,”
*IEEE Transactions on Circuits and Systems. I. Regular Papers*, vol. 58, no. 8, pp. 1910–1923, 2011. View at: Publisher Site | Google Scholar - A. P. C. Gonçalves, A. R. Fioravanti, and J. C. Geromel, “${H}_{\infty}$ filtering of discrete-time Markov jump linear systems through linear matrix inequalities,”
*IEEE Transactions on Automatic Control*, vol. 54, no. 6, pp. 1347–1351, 2009. View at: Publisher Site | Google Scholar - H. Gao, J. Wu, and P. Shi, “Robust sampled-data ${H}_{\infty}$ control with stochastic sampling,”
*Automatica*, vol. 45, no. 7, pp. 1729–1736, 2009. View at: Publisher Site | Google Scholar | Zentralblatt MATH - Z. Wang, D. W. C. Ho, Y. Liu, and X. Liu, “Robust ${H}_{\infty}$ control for a class of nonlinear discrete time-delay stochastic systems with missing measurements,”
*Automatica*, vol. 45, no. 3, pp. 684–691, 2009. View at: Publisher Site | Google Scholar | Zentralblatt MATH - R. Yang, P. Shi, G. Liu, and H. Gao, “Network-based feedback control for systems with mixed delays based on quantization and dropout compensation,”
*Automatica*, vol. 47, no. 12, pp. 2805–2809, 2011. View at: Publisher Site | Google Scholar - X. Luan, P. Shi, and F. Liu, “Stabilization of networked control systems with random delays,”
*IEEE Transactions on Industrial Electronics*, vol. 45, no. 3, pp. 4323–4330, 2011. View at: Google Scholar - K. Itô, “On stochastic differential equations,”
*Memoirs of the American Mathematical Society*, no. 4, pp. 1–51, 1951. View at: Google Scholar | Zentralblatt MATH - X. Mao, “Robustness of exponential stability of stochastic differential delay equations,”
*IEEE Transactions on Automatic Control*, vol. 41, no. 3, pp. 442–447, 1996. View at: Publisher Site | Google Scholar | Zentralblatt MATH - S. Xu and T. Chen, “${H}_{\infty}$ output feedback control for uncertain stochastic systems with time-varying delays,”
*Automatica*, vol. 40, no. 12, pp. 2091–2098, 2004. View at: Publisher Site | Google Scholar | Zentralblatt MATH - P. Antsaklis and J. Baillieul, “Guest editorial. Special issue on networked control systems,”
*IEEE Transactions on Automatic Control*, vol. 49, no. 9, pp. 1421–1423, 2004. View at: Publisher Site | Google Scholar - N. Elia and S. K. Mitter, “Stabilization of linear systems with limited information,”
*IEEE Transactions on Automatic Control*, vol. 46, no. 9, pp. 1384–1400, 2001. View at: Publisher Site | Google Scholar | Zentralblatt MATH - G. N. Nair and R. J. Evans, “Exponential stabilisability of finite-dimensional linear systems with limited data rates,”
*Automatica*, vol. 39, no. 4, pp. 585–593, 2003. View at: Publisher Site | Google Scholar | Zentralblatt MATH - S. Tatikonda and S. Mitter, “Control under communication constraints,”
*IEEE Transactions on Automatic Control*, vol. 49, no. 7, pp. 1056–1068, 2004. View at: Publisher Site | Google Scholar - H. Gao and T. Chen, “${H}_{\infty}$ estimation for uncertain systems with limited communication capacity,”
*IEEE Transactions on Automatic Control*, vol. 52, no. 11, pp. 2070–2084, 2007. View at: Publisher Site | Google Scholar - D. Xie, D. Zhang, and Z. Wang, “Robust ${H}_{\infty}$ faulttolerant control for uncertain networked control system with two additive random delays,”
*International Journal of Innovative Computing, Information and Control*, vol. 7, no. 1, pp. 315–326, 2011. View at: Google Scholar - H. Yang, Y. Xia, and P. Shi, “Stabilization of networked control systems with nonuniform random sampling periods,”
*International Journal of Robust and Nonlinear Control*, vol. 21, no. 5, pp. 501–526, 2011. View at: Publisher Site | Google Scholar | Zentralblatt MATH - Y. Zhao, J. Lam, and H. Gao, “Fault detection for fuzzy systems with intermittent measurements,”
*IEEE Transactions on Fuzzy Systems*, vol. 17, no. 2, pp. 398–410, 2009. View at: Publisher Site | Google Scholar - Z. Wang, F. Yang, D. W. C. Ho, and X. Liu, “Robust H∞ control for networked systems with random packet losses,”
*IEEE Transactions on Systems, Man, and Cybernetics, Part B*, vol. 37, no. 4, pp. 916–924, 2007. View at: Publisher Site | Google Scholar - X. Meng, J. Lam, and H. Gao, “Network-based ${H}_{\infty}$ control for stochastic systems,”
*International Journal of Robust and Nonlinear Control*, vol. 19, no. 3, pp. 295–312, 2009. View at: Publisher Site | Google Scholar | Zentralblatt MATH - L.-S. Hu, T. Bai, P. Shi, and Z. Wu, “Sampled-data control of networked linear control systems,”
*Automatica*, vol. 43, no. 5, pp. 903–911, 2007. View at: Publisher Site | Google Scholar | Zentralblatt MATH - H. R. Karimi, “Observer-based mixed H
_{2}/H∞ control design of linear systems with time-varying delays: an LMI approach,”*International Journal of Control, Automation and Systems*, vol. 6, no. 1, pp. 1–14, 2008. View at: Google Scholar - E. Tian, D. Yue, and C. Peng, “Quantized output feedback control for networked control systems,”
*Information Sciences*, vol. 178, no. 12, pp. 2734–2749, 2008. View at: Publisher Site | Google Scholar | Zentralblatt MATH - Y. Cheng, B. Jiang, Y. Fu, and Z. Gao, “Robust observer based reliable control for satellite attitude control systems with sensor faults,”
*International Journal of Innovative Computing, Information and Control*, vol. 7, no. 7 B, pp. 4149–4160, 2011. View at: Google Scholar - I. Saboori, M. B. Menhaj, and B. Karimi, “A nonlinear adaptive observer based on neural networks for nonlinear systems including secure communication problems,”
*International Journal of Innovative Computing, Information and Control*, vol. 6, no. 11, pp. 4771–4782, 2010. View at: Google Scholar - C. Lin, Z. Wang, and F. Yang, “Observer-based networked control for continuous-time systems with random sensor delays,”
*Automatica*, vol. 45, no. 2, pp. 578–584, 2009. View at: Publisher Site | Google Scholar | Zentralblatt MATH - L. Xie, M. Fu, and C. E. de Souza, “${H}_{\infty}$-control and quadratic stabilization of systems with parameter uncertainty via output feedback,”
*IEEE Transactions on Automatic Control*, vol. 37, no. 8, pp. 1253–1256, 1992. View at: Publisher Site | Google Scholar | Zentralblatt MATH - V. B. Kolmanovskii and A. D. Myshkis,
*Applied Theory of Functional Differential Equations*, Kluwer Academic Publishers, Dordrecht, The Netherlands, 1992. - L. El Ghaoui, F. Oustry, and M. AitRami, “A cone complementarity linearization algorithm for static output-feedback and related problems,”
*IEEE Transactions on Automatic Control*, vol. 42, no. 8, pp. 1171–1176, 1997. View at: Publisher Site | Google Scholar | Zentralblatt MATH

#### Copyright

Copyright © 2012 Junli Wu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.