Abstract and Applied Analysis

Volume 2013 (2013), Article ID 604249, 9 pages

http://dx.doi.org/10.1155/2013/604249

## Observer-Based Control Design for Nonlinear Networked Control Systems with Limited Information

^{1}School of Automation, Nanjing University of Science and Technology, Nanjing 210094, China^{2}Department of Engineering, Faculty of Engineering and Science, University of Agder, 4898 Grimstad, Norway

Received 13 May 2013; Accepted 21 July 2013

Academic Editor: Ferenc Hartung

Copyright © 2013 Yilin Wang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

This paper is concerned with the problem of designing a robust observer-based controller for discrete-time networked systems with limited information. An improved networked control system model is proposed and the effects of random packet dropout, time-varying delay, and quantization are considered simultaneously. Based on the obtained model, a stability criterion is developed by constructing an appropriate Lyapunov-Krasovskii functional and sufficient conditions for the existence of a dynamic quantized output feedback controller which are given in terms of linear matrix inequalities (LMIs) such that the augmented error system is stochastically stable with an performance level. An example is presented to illustrate the effectiveness of the proposed method.

#### 1. Introduction

Networked control systems (NCSs) are distributed systems in which communication between sensors, actuators and controllers is supported by a shared real-time network. Compared with conventional point-to-point system connection, this new network-based control scheme reduces system wiring and has low cost, high reliability, information sharing, and remote control [1, 2]. However, NCSs also introduce many new challenges in control system design such as packet dropout, networked-induced delay and signal quantization variable transmission intervals, network security and other communication constraints [3–9]. The authors in [10] proposed different levels of network-induced imperfections and presented the main survey of the methodologies in the analysis and design of NCSs.

The time-delay and packet dropouts occur in various physical, industrial, and engineering systems, which is a source of poor performance and instability of systems. Therefore, the issues of network-induced time-delays and packet dropouts have been considered by many researchers. Markov chain has been used to model the randomness of the network-induced delays (packet dropouts) [11–15]. The Markov chain takes values, which correspond to network-induced delays (packet dropouts), in a finite set based on known probabilities. In addition, the transition probabilities of Markovian jump systems (MJSs) are partly unknown due to the complexity of network [16, 17]. The authors in [16] introduced a nonlinear delayed MJSs model with partially unknown transition probabilities established by multiple channels data transmission framework. An iterative method was proposed in [17] to model NCSs with bounded packet dropout as Markovian jump linear systems with partly unknown transition probabilities. On the other hand, much attention has been devoted to the time-delayed jump linear systems with Markovian jumping parameters [18–20], which applied a less-conservative delay-range-dependent method. The stability analysis and stabilization problems for a class of discrete-time Markov jump linear systems with partially known transition probabilities, and time-varying delays are investigated in [18].

Quantization process cannot be neglected in NCSs. Real communication networks only send finite precision data due to limited bandwidth. Quantizers with coarser quantization densities help in reducing the network congestion. Consequently, network-induced delays can be reduced because less information is transmitted. In [21, 22], the quantizing effects were transformed into sector-bounded uncertainties and the quantization density was given in the control synthesis. For a logarithmic quantizer, the quantization error was modeled as a norm-bounded uncertainty [23]. However, the quantization density in most studies is just neglected or given as sector bounded uncertainties, and the relationship between the quantization density and the network load has not been fully investigated in the aforementioned papers.

Motivated by the above discussion, in this paper, we are aiming at investigating the study of observer-based controller design for nonlinear discrete-time networked systems subject to sensor-controller packet losses, time-varying delays, and output quantization. In this work, the quantization density is designed to be a function of the network load condition which is modeled by a Markov chain [24]. Furthermore, by applying the Lyapunov-Krasovskii functional method, a mode-dependent observer is constructed and the bounded real lemma (BRL) for the resulting error system is derived in terms of LMIs. Also, an improved version of the BRL is given by introducing additional slack matrix variables to eliminate the cross-coupling between system matrices and Lyapunov matrices among different operation modes, which can reduce the computational complexity as far as possible.

The paper is organized as follows. In Section 2, the NCS description, quantization error modeling, packet dropout and time-varying delay formulation are presented. Main results for stability criterion and observer-based controller synthesis are given in Section 3. A numerical example is provided in Section 4. Finally, Section 5 concludes this paper.

*Notation*. Throughout the paper, the superscripts “” and “” stand for the inverse and transpose of a matrix, respectively; denotes an -dimensional Euclidean space and the notation means that is a real symmetric positive definite matrix. is the expectation of a stochastic variable . and represent an identity matrix and a zero matrix with appropriate dimensions in different place, respectively. In symmetric block matrices or complex matrix expressions, we use an asterisk * to represent a term that is induced by symmetry and stands for a block diagonal matrix. refers to the Euclidean norm for vectors and induced 2-norm for matrices. stands for the space of square summable infinite sequence on .

#### 2. Problem Formulation

A simple-networked control system is shown in Figure 1. A class of discrete-time nonlinear systems under consideration is described by the following equations: where , , , and are the state vector, control input vector, controlled output vector, and measured output, respectively. is the exogenous disturbance signal belonging to . , , , , and are known real matrices with appropriate dimensions. The nonlinear function satisfies and the following sector-bounded condition [25]: where , are known real constant matrices, and is a symmetric positive definite matrix.

The network load condition is related to the network-induced delay. In [26], a Markov chain has been used to model the network load condition. Varying network load can be modeled by making the Markov chain do a transition and transfer every time over the communication network. Modes 1, 2, and 3 are, respectively, corresponded to light load, medium load, and heavy load.

Then, a discrete homogeneous Markov chain with a finite number of states is used to model a network load. The transition probability from mode at to mode at time is governed by where is the transition probability element and satisfies (for all ).

In addition, the transition probability considered in this paper is partly accessed, and some elements are unknown. For notation clarity, we denote (for all with and .

Also, we can obtain where .

In this paper, the quantization density is designed to be a function of the network load condition. Hence, the quantization density function is described as a finite state Markov chain. On the basis of this technique, a networked load dependent on the logarithmic quantizer [23, 24] is proposed as follows: where is the quantization density of , and is related to by

This means that the smaller results in the smaller . For this reason, we will call the quantization density in the rest of this paper.

The associated quantized set is given by

Now define the quantization error as where is the signal to be quantized and is the quantized signal. The uncertainty matrix satisfies , .

The measured output which is used as feedback information for controller may not be available all the time due to packet dropouts. To describe these packet dropouts, a stochastic variable following Bernoulli sequence is used. In this paper, the measured output received in the controller side is involved with the effects of quantization, packet losses, and time-varying delay, and it is described by where and are the lower and upper bounds of the delay, respectively. Stochastic variable is a Bernoulli distributed white sequence with a probability distribution as follows: where is a known positive constant which is used to denote the probability that the packet will be transmitted successfully from sensor to controller, and we have

*Remark 1. *For NCSs, network-induced delay, packet dropout, and quantization error often occur simultaneously due to limited channel capacity and noise. Actually, pattern (9) describes a class of NCSs with data loss, time-varying delay and the quantization error simultaneously, so it is more comprehensive than separate consideration of delay pattern [27] or data loss pattern [28].

In this work, the following dynamic observer-based control scheme is employed for system (1): where and represent the state estimation and output estimation vectors of system (1), respectively. and are the observer gain and controller feedback gain to be designed, respectively.

We define the following error variable as

Combining (12) with (1) and considering (9) and (11), the error system is derived as follows:

On the other hand, system (1) can be rewritten as

By setting , the augmented system can be obtained as follows: where with

Lemma 2 (see [29]). *Let , , and be matrices with appropriate dimensions. Suppose , and then for any scalar , we have
*

*Definition 3 (see [30]). *System (16) with is said to be stochastically stable if, for every finite , the following inequality holds:

*Definition 4 ([31]). *For a given scalar , system (16) is stochastically stable and has an noise attenuation performance index if the following conditions are satisfied. (a)System (16) with is stochastically stable.(b)Under the zero-initial condition, it holds that

In this paper, the main objective is to design controller (12) for system (1) in the presence of output quantization, sensor-controller packet losses, and time-varying delays such that system (16) is stochastically stable with a prescribed performance index .

#### 3. Main Results

Theorem 5. *For a given scalar , quantization densities and a packet loss rate , system (16) with partly unknown transition probabilities is stochastically stable with a prescribed performance index , if there exist matrices and such that
**
where
*

*Proof. *Choose a Lyapunov-Krasovskii functional of the form:
with
where and are symmetric positive definite matrices.

Let the mode at times and be and , respectively. That is, and for any . Taking the difference of above functional along the solution of system (16), we have
with

Therefore,
From inequality (2), we know
where

Denoting and combining (28) and (29) lead to
where

By Schur complement, (22) implies and , and then we obtain from (31) that
where and . From (33), if we do mathematical expectations in both sides, we obtain that for any
which yields

Thus, from Definition 3, the closed-loop system (16) with is stochastically stable.

Now, to establish an performance, consider the following performance index:
Under zero-initial condition, we have
where
Similarly, by Schur complement, it can be obtained from (22) that , which means that .

Then,
This completes the proof.

*Remark 6. *Note that will be reduced to only (resp., ) if all the transition probabilities are known (resp., unknown).

*Remark 7. *The considered systems are more general than these systems with completely known or completely unknown transition probabilities, which can be viewed as two special cases of the ones tackled here; that is, when all the transition probabilities are known or unknown, the underlying systems are the traditional MJSs (, ) or the switched systems under arbitrary switching (, ), respectively. Therefore, observer-based controller with partly unknown transition probabilities of this paper is a more natural assumption to the Markovian jump systems and hence covers the existing ones.

Corollary 8. *For a given scalar , quantization densities and a packet losses rate , the closed-loop system (16) with completely known transition probabilities is stochastically stable with an attenuation level if there exist matrices and such that
**
where with and .*

*Proof. *Similar to the proof line of Theorem 5, the result can be obtained. The detailed proof is omitted here.

Theorem 5 provides Markov-chain-element-dependent sufficient conditions which guarantee the performance as well as the stochastic stability of the augmented error system (16). The following theorem gives sufficient conditions on the existence of a mode-dependent observer-based controller.

Theorem 9. *For a given scalar , quantization densities and a packet loss rate , if there exist matrices , , , , and scalar such that
**
where
**
then, there exists a mode-dependent observer-based controller as (12) such that the augmented system (16) is stochastically stable with a prescribed performance index . Moreover, if LMIs (41) have a feasible solution, the desired controller gains and observer gains are given by
*

*Proof. *From Theorem 9, inequalities (22) can be rewritten as
where
Performing a congruence transformation to (44) by , one has
For an arbitrary matrix , for all , we have the following fact:
Then, we obtain , so (46) holds if the following condition is satisfied:
Then, using the condition (8), we have
where and satisfies .

Substituting (49) into (48) and using Lemma 2, we get that (48) is equivalent to
where

Applying Schur complement and substituting and into (50), we have that (50) is equivalent to (41). Therefore, we obtain that system (16) is stochastically stable with a prescribed performance index . The proof is completed.

#### 4. Numerical Example

Consider the following state-space representation of a nonlinear networked system in (1) with the following parameters: It is easy to verify that

For the given system with data loss and time-varying delay, delay bounds are given as and , and the packet losses parameters are selected as . The network load is modeled by a Markov chain which takes values from a finite set and the transition probability matrix is where stands for the unknown elements.

The quantization density for each mode is assumed as , , and . Then the corresponding augmented system (16) can be obtained.

Taking , then solving (41) in Theorem 9, we obtain the observer gain as and controller gains can be computed as Thus according to Theorem 9, we can conclude that, under the designed controller, the corresponding augmented system (16) is stochastically stable with a given performance level .

The initial condition is selected as , , and the noise signal . The switching sequence and the trajectories of plant state and error are shown in Figures 2, 3, 4, and 5.

It is clearly observed from the simulation results that the corresponding augmented system (16) is stochastically stable. This demonstrates the effectiveness of the proposed results.

#### 5. Conclusions

In this work, the problem of robust observer-based control for discrete-time nonlinear networked systems with limited information is proposed. The quantization density is designed to be a function of the network load condition which is modeled by a Markov chain with partly unknown transition probability. Bernoulli random sequences are used to model packet dropouts in the network. An estimation technique is then developed to obtain the estimation of system state and the observer-based controller is proposed to stabilize the networked controlled systems by using the Lyapunov-Krasovskii functional approach. An example is presented to illustrate the effectiveness of the proposed method.

#### Acknowledgments

This work was supported by the National Natural Science Foundation of China under Grant no. 61273120 and the Alexander von Humboldt Foundation in Germany.

#### References

- G.-P. Liu, Y. Q. Xia, J. Chen, D. Rees, and W. S. Hu, “Networked predictive control of systems with random network delays in both forward and feedback channels,”
*IEEE Transactions on Industrial Electronics*, vol. 54, no. 3, pp. 1282–1297, 2007. View at Publisher · View at Google Scholar · View at Scopus - W. Zhang, M. S. Branicky, and S. M. Phillips, “Stability of networked control systems,”
*IEEE Control Systems Magazine*, vol. 21, no. 1, pp. 84–97, 2001. View at Publisher · View at Google Scholar · View at Scopus - H. Song, L. Yu, and W.-A. Zhang, “Stabilisation of networked control systems with communication constraints and multiple distributed transmission delays,”
*IET Control Theory & Applications*, vol. 3, no. 10, pp. 1307–1316, 2009. View at Publisher · View at Google Scholar · View at MathSciNet - W.-A. Zhang and L. Yu, “Output feedback stabilization of networked control systems with packet dropouts,”
*IEEE Transactions on Automatic Control*, vol. 52, no. 9, pp. 1705–1710, 2007. View at Publisher · View at Google Scholar · View at MathSciNet - W.-A. Zhang and L. Yu, “A robust control approach to stabilization of networked control systems with time-varying delays,”
*Automatica*, vol. 45, no. 10, pp. 2440–2445, 2009. View at Publisher · View at Google Scholar · View at Scopus - L. Zhang, Y. Shi, T. Chen, and B. Huang, “A new method for stabilization of networked control systems with random delays,”
*IEEE Transactions on Automatic Control*, vol. 50, no. 8, pp. 1177–1181, 2005. View at Publisher · View at Google Scholar · View at MathSciNet - P. Seiler and R. Sengupta, “An ${H}_{\infty}$ approach to networked control,”
*IEEE Transactions on Automatic Control*, vol. 50, no. 3, pp. 356–364, 2005. View at Publisher · View at Google Scholar · View at MathSciNet - M. E. M. Ben Gaid and A. Çela, “Trading quantization precision for update rates for systems with limited communication in the uplink channel,”
*Automatica*, vol. 46, no. 7, pp. 1210–1214, 2010. View at Publisher · View at Google Scholar · View at MathSciNet - J. Wu, H. R. Karimi, and P. Shi, “Network-based ${H}_{\infty}$ output feedback control for uncertain stochastic systems,”
*Information Sciences*, vol. 232, pp. 397–410, 2013. View at Publisher · View at Google Scholar · View at MathSciNet - L. Zhang, H. Gao, and O. Kaynak, “Network-induced constraints in networked control systems—a survey,”
*IEEE Transactions on Industrial Informatics*, vol. 9, no. 1, pp. 403–416, 2013. View at Google Scholar - D. Wang, J. Wang, and W. Wang, “Output feedback control of networked control systems with packet dropouts in both channels,”
*Information Sciences*, vol. 221, pp. 544–554, 2013. View at Publisher · View at Google Scholar · View at MathSciNet - J. Xiong and J. Lam, “Stabilization of linear systems over networks with bounded packet loss,”
*Automatica*, vol. 43, no. 1, pp. 80–87, 2007. View at Publisher · View at Google Scholar · View at MathSciNet - S. Jiang and H. Fang, “${H}_{\infty}$ static output feedback control for nonlinear networked control systems with time delays and packet dropouts,”
*ISA Transactions*, vol. 52, no. 2, pp. 215–222, 2013. View at Google Scholar - J. Wang, C. Liu, and H. Yang, “Stability of a class of networked control systems with Markovian characterization,”
*Applied Mathematical Modelling*, vol. 36, no. 7, pp. 3168–3175, 2012. View at Publisher · View at Google Scholar · View at MathSciNet - Y. Shi and B. Yu, “Robust mixed ${H}_{2}$/${H}_{\infty}$ control of networked control systems with random time delays in both forward and backward communication links,”
*Automatica*, vol. 47, no. 4, pp. 754–760, 2011. View at Publisher · View at Google Scholar · View at MathSciNet - Y. Zhang, Z. Liu, H. Fang, and H. Chen, “${H}_{\infty}$ fault detection for nonlinear networked systems with multiple channels data transmission pattern,”
*Information Sciences*, vol. 221, pp. 534–543, 2013. View at Publisher · View at Google Scholar · View at MathSciNet - Y.-G. Sun and S.-Y. Qin, “Stability and stabilization of networked control systems with bounded packet dropout,”
*Acta Automatica Sinica*, vol. 37, no. 1, pp. 113–117, 2011. View at Publisher · View at Google Scholar · View at MathSciNet - L. Zhang, E.-K. Boukas, and J. Lam, “Analysis and synthesis of Markov jump linear systems with time-varying delays and partially known transition probabilities,”
*IEEE Transactions on Automatic Control*, vol. 53, no. 10, pp. 2458–2464, 2008. View at Publisher · View at Google Scholar · View at MathSciNet - X. Zhao and Q. Zeng, “New robust delay-dependent stability and ${H}_{\infty}$ analysis for uncertain Markovian jump systems with time-varying delays,”
*Journal of the Franklin Institute*, vol. 347, no. 5, pp. 863–874, 2010. View at Publisher · View at Google Scholar · View at MathSciNet - X. Zhao and Q. Zeng, “Delay-dependent ${H}_{\infty}$ performance analysis and filtering for Markovian jump systems with interval time-varying delays,”
*International Journal of Adaptive Control and Signal Processing*, vol. 24, no. 8, pp. 633–642, 2010. View at Google Scholar · View at MathSciNet - R. Yang, P. Shi, G.-P. Liu, and H. Gao, “Network-based feedback control for systems with mixed delays based on quantization and dropout compensation,”
*Automatica*, vol. 47, no. 12, pp. 2805–2809, 2011. View at Publisher · View at Google Scholar · View at MathSciNet - J. Dai, “A delay system approach to networked control systems with limited communication capacity,”
*Journal of the Franklin Institute*, vol. 347, no. 7, pp. 1334–1352, 2010. View at Publisher · View at Google Scholar · View at MathSciNet - M. Fu and L. Xie, “The sector bound approach to quantized feedback control,”
*IEEE Transactions on Automatic Control*, vol. 50, no. 11, pp. 1698–1711, 2005. View at Publisher · View at Google Scholar · View at MathSciNet - F. Rasool, D. Huang, and S. K. Nguang, “Robust ${H}_{\infty}$ output feedback control of discrete-time networked systems with limited information,”
*Systems & Control Letters*, vol. 60, no. 10, pp. 845–853, 2011. View at Publisher · View at Google Scholar · View at MathSciNet - H. K. Khalil,
*Nonlinear Systems*, Prentice-Hall, Upper Saddle River, NJ, USA, 1996. - J. Nilsson and B. Bernhardsson, “Analysis of real-time control systems with time delays,” in
*Proceedings of the 35th IEEE Conference on Decision and Control*, pp. 3173–3178, December 1996. View at Scopus - D.-S. Kim, D.-H. Choi, and P. Mohapatra, “Real-time scheduling method for networked discrete control systems,”
*Control Engineering Practice*, vol. 17, no. 5, pp. 564–570, 2009. View at Publisher · View at Google Scholar · View at Scopus - S. Hu and W.-Y. Yan, “Stability of networked control systems under a multiple-packet transmission policy,”
*IEEE Transactions on Automatic Control*, vol. 53, no. 7, pp. 1706–1711, 2008. View at Publisher · View at Google Scholar · View at MathSciNet - Y. Y. Wang, L. Xie, and C. E. de Souza, “Robust control of a class of uncertain nonlinear systems,”
*Systems & Control Letters*, vol. 19, no. 2, pp. 139–149, 1992. View at Publisher · View at Google Scholar · View at MathSciNet - T. Liu, H. Zhang, Q. J. Chen, and H. C. Yan, “${H}_{\infty}$ control for networked control systems with limited information,”
*Journal of the Franklin Institute*, vol. 349, no. 5, pp. 1915–1929, 2012. View at Publisher · View at Google Scholar · View at MathSciNet - L. Zhang, E.-K. Boukas, and P. Shi, “Exponential ${H}_{\infty}$ filtering for uncertain discrete-time switched linear systems with average dwell time: a
*μ*-dependent approach,”*International Journal of Robust and Nonlinear Control*, vol. 18, no. 11, pp. 1188–1207, 2008. View at Publisher · View at Google Scholar · View at MathSciNet