Abstract and Applied Analysis

Volume 2014 (2014), Article ID 486978, 8 pages

http://dx.doi.org/10.1155/2014/486978

## Analysis and Design of Networked Control Systems with Random Markovian Delays and Uncertain Transition Probabilities

^{1}Shenzhen Key Laboratory of Urban Rail Transit, College of Mechatronics and Control Engineering, Shenzhen University, Shenzhen 518060, China^{2}Shenzhen Key Laboratory of Laser Engineering, College of Electronic Science and Technology, Shenzhen University, Shenzhen 518060, China^{3}School of Electrical Engineering and Information, Anhui University of Technology, Ma'anshan 243000, China

Received 16 January 2014; Accepted 3 March 2014; Published 14 April 2014

Academic Editor: Shuping He

Copyright © 2014 Li Qiu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

This paper focuses on the stability issue of discrete-time networked control systems with random Markovian delays and uncertain transition probabilities, wherein the random time delays exist in the sensor-to-controller and controller-to-actuator. The resulting closed-loop system is modeled as a discrete-time Markovian delays system governed by two Markov chains. Using Lyapunov stability theory, a result is established on the Markovian structure and ensured that the closed-loop system is stochastically stable. A simulation example illustrates the validity and feasibility of the results.

#### 1. Introduction

Networked control systems (NCS) find many successful applications in power grids, manufacturing plants, vehicles, aircrafts, spacecrafts, remote surgery, and so on [1]. Compared with the traditional control systems, the use of the communication networks brings many advantages such as low cost, reduced weight, and simple installation and maintenance, as well as high efficiency, flexibility, and reliability. However, inserting communication networks into feedback control loops has also resulted in several interesting and challenging issues, such as packet dropouts [2], time delays [3–10], quantization [11], time-varying transmission intervals [12], distributed synchronization [13], or some of the constraints considered simultaneously [14–17], which make the analysis and design of NCS complex. These imperfections block the way of harvesting reliable NCS by implementing existing control techniques [18]. To overcome these drawbacks, significant attention has been paid to the NCS research ranging from system identification and stability analysis to controller and filter designs. See the survey papers [1, 19, 20] and the references therein.

The network-induced time delays are known to be the major challenges in NCS, which may be potential causes for the deteriorating performance or instability of NCS. Consequently, numerous works have been conducted on the time-delay issue in the past years. For example, in [21], the mixed control issue of NCS with random time delays has been investigated based on Markovian jump linear systems method. In [9], the stability problem of NCS with uncertain time-varying delays has been investigated. The stability and stabilization of NCS with random time delay usually use Markovian jump linear systems (MJLS) approach, and, recently, many significant achievements have been obtained for MJLS in [22–26]. However, most of the approaches for NCS based on Markovian jump systems framework assumed that the Markovian transition probabilities are known a priori, which severely limit the utility of the Markov model. Furthermore, such assumption may not hold true especially in the case where networked control is applied to the remote plants. Recently, the filter problem for a class of uncertain Markovian jumping systems with bounded transition probabilities has been investigated in [27], but the well-established results cannot be directly used to NCS. To the best of the authors’ knowledge, up to now, very limited efforts have been devoted to studying the system with uncertain transition probability matrices for NCS, which motivates our investigation.

In this paper, we address the analysis and design of NCS with random time delays modeled by Markov chains in forward sensor-to-controller (S-C) and feedback controller-to-actuator (C-A) communication links and with the uncertain transition probability matrices. The main contributions of this paper are highlighted as follows. (i) A model is proposed for NCS with random Markovian delays and uncertain transition probability matrices. (ii) The system modeled will be more generalized and avoid the ideal assumption that the transition probabilities are known a priori. (iii) New criteria for stability are obtained based on a Lyapunov approach. Finally, a numerical example is provided to demonstrate the effectiveness of the proposed control scheme for NCS with random time delays and uncertain transition probability matrices.

The remainder of this paper is organized as follows. A model with Markovian delays and uncertain transition probabilities is obtained in Section 2. The main results are obtained based on a Lyapunov approach and the linear matrix inequalities technique in Section 3. Section 4 presents the simulation results. Finally, the conclusions are provided in Section 5.

*Notations.* Matrices are assumed to have appropriate dimensions. and denote the -dimensional Euclidean space and the set of all real matrices, respectively. The notations () indicate that is a real symmetric positive (negative) definite matrix. and denote the identity matrix and the zero matrix with appropriate dimensions, respectively. Superscripts “” and “” stand for the matrix transposition and the matrix inverse, respectively. stands for the mathematical expectation and stands for a block-diagonal matrix of and . and denote the identity matrix and zero matrix with appropriate dimensions, respectively. denotes the expression , and means symmetric terms in symmetric entries.

#### 2. NCS Model

The framework of networked control systems is depicted in Figure 1. The plant, sensor, controller, and actuator are spatially distributed and closed through a network. Random time delays exist in both of S-C and C-A.

The plant is described by the following discrete-time linear time-invariant plant model: where is the system state vector and is the control input. and are known real constant matrices with appropriate dimensions.

For this system, we will consider a state feedback controller as follows: where is the state feedback controller gain.

Random S-C and C-A time delays are and , respectively. and are assumed be bounded; that is, , , where , , , and . One way to model delays and is by using the finite-state Markov chains presented in [21]. The main advantages of the Markov model considering the dependence between delays are that the current time delays in real networks delays are frequently related to the previous delays. In this paper and are modeled as two homogeneous Markov chains.

By substituting controller (2) to plant (1), we obtain a closed-loop system as follows: where .

In system (3), and are two finite state discrete-time homogeneous Markov chains with values in the finite sets and with the uncertain transition probability matrices and . and denote the uncertain transition probability matrices of Markov chain and , respectively, with probabilities and , which are defined by where , and , for all and . The transition probability matrices and are unknown a priori but belong to the following bounded compact set: where () and () are known constant matrices. () and () denote the uncertainty in the transition probability matrices, where and satisfy where , , and and are the known small scalar for all and , respectively.

*Remark 1. *Closed-loop system (3) is a linear system with the Markovian delays and , which describe the behavior of the S-C and C-A random time delays, and with the uncertain transition probabilities.

*Remark 2. *The uncertain transition probabilities and contain the certain terms and , and the uncertain terms and , respectively. The uncertain terms and are bounded, and the sums of the elements in each row are zeros.

#### 3. Stability Analysis and Controller Design

By applying a Lyapunov approach and a linear matrix inequality technique, this section provides sufficient conditions for the stochastic stability and the synthesis of state feedback controller design of the system (3).

*Definition 3 (see [21]). *The closed-loop system (3) is said to be stochastically stable if, for every finite , initial mode and , there exists a finite such that

Theorem 4. *For the system (3), random but bounded scalars and . If, for each mode and and matrices , , , , , and , and exist that satisfy the following matrix inequalities:
**
where
**
and and are defined in (4) and (5).*

Then the closed-loop system (3) is stochastically stable.

*Proof. *For the closed-loop system (3), the stochastic Lyapunov functional candidate is constructed as follows:
with
where , , , , , , and .

Let , noting that . Then . For simplicity, we will use the following notations: . Then, for any weighting matrices with compatible dimensions (and let ), we have . Along the trajectory of the solution of the closed-loop system (3), we obtain
By Jensen’s inequality, we can obtain
Similarly, we have
By substituting (16) and (17) to (15) and then combining (12), (13), and (14), we have
where . By using the Schur complement, (8) guarantees that . Therefore,
where denotes the minimal eigenvalue of and . From (19), it follows that, for any ,
Furthermore
By taking as the limit, we obtain
According to Definition 3, the closed-loop system (3) exhibits stochastic stability for all uncertain transition probability matrices.

Theorem 4 gives a sufficient condition for the stochastic stability of the system (3). However, it should be noted that the controller gain cannot be obtained according to the condition in (8) because of the nonlinear terms and and the uncertain terms and . To handle this problem, the equivalent LMI conditions are given as follows.

Before proceeding further, we provide the following lemma that will play a significant role in processing the uncertainty terms and of uncertain transition probability matrices and .

Lemma 5 (see [28]). *
For any vectors of and positive matrix , the following holds:
*

*Theorem 6. For the system (3), the random but bounded scalars and . If, for each mode and , the tuning parameters and , the scalars and , and matrices , , , , , , , , , and , and exist such that
where
*

Then the closed-loop system (3) is stochastically stable and the controller is a state feedback controller of the system (3).

*Proof. *Let , , , and , where and are known tuning parameters. We restrict to be the same for all (namely, ) and give the notations as
Pre- and postmultiplying and to (8), respectively, we have
where
where and are defined in Theorem 4 and , , and are defined in Theorem 6.

According to the assumption on uncertain transition probabilities and and the fact that and , one has
Note that
By Lemma 5 and the fact that , we have
Similarly, we have

Note that, for any matrix , we have for and . Combining (29), (31), and (32) and by the Schur complement, (24) can be yielded easily from (27); this completes the proof of Theorem 6.

*4. Numerical Example*

*4. Numerical Example*

*In this section, we illustrate our results through an example. We apply the results in Theorem 6 to a simple inverted pendulum system [5] shown in Figure 2, which is a two-order unstable system. The state variables are , where is the angular position of the pendulum. The parameters used are kg and m, without friction surfaces. The sampling time is s. The plant matrices are given by
*

*We assume that the stochastic Markovian jumping S-C delay and C-A delay and their uncertain transition probability matrices are given as follows:
The eigenvalues of are 1.1695 and 0.8551. Therefore, the discrete-time model is unstable.*

*Figures 3 and 4 show part of the simulation of the Markov chains mode. The initial conditions are as follows: , , and . By Theorem 6, when , , , and , we can obtain the gain matrix of state feedback controller (2) which is constructed as
*

*The state trajectories of the system (3) are shown in Figure 5, where two curves represent state trajectories under the controller gains . Figure 5 also indicates that the system (3) is stochastically stable.*

*Remark 7. *In this example, the uncertain transition probabilities are given as a discrete probability distribution function. When the uncertain transition probability is given as a continuous probability distribution function, we can use the norm of the continuous probability distribution function as the upper bound to simulation.

*5. Conclusions*

*5. Conclusions*

*The state feedback stabilization problem for a class of NCS with the S-C and C-A random time delays is investigated in this paper. The resulting closed-loop NCS is modeled as a linear system with uncertain Markovian transition probabilities. New sufficient conditions on stochastic stability and stabilization are obtained by Lyapunov stability theory and linear matrix inequalities method. An example is presented to illustrate the effectiveness of the approach. Although only the time-delay issue for NCS is addressed in this paper, the method can be extended to the NCS with the random packet dropouts, time delays, and packet dropouts and to the MJLS with the uncertain Markovian transition probabilities.*

*Conflict of Interests*

*Conflict of Interests*

*The authors declare that there is no conflict of interests regarding the publication of this paper.*

*Acknowledgments*

*Acknowledgments*

*This work was supported partly by the National Natural Science Foundation of China (Grant nos. 61174070 and 61104107), the Natural Science Foundation of Guangdong Province (Grant no. S2013040016183), the Foundation of Key Laboratory of Autonomous Systems and Networked Control, Ministry of Education, China, and the Natural Science Foundation of Shenzhen University (Grant no. 201207).*

*References*

*References*

- J. P. Hespanha, P. Naghshtabrizi, and Y. G. Xu, “A survey of recent results in networked control systems,”
*Proceedings of the IEEE*, vol. 95, no. 1, pp. 138–162, 2007. View at Publisher · View at Google Scholar · View at Scopus - M. C. F. Donkers, W. P. M. H. Heemels, N. van de Wouw, and L. Hetel, “Stability analysis of networked control systems using a switched linear systems approach,”
*IEEE Transactions on Automatic Control*, vol. 56, no. 9, pp. 2101–2115, 2011. View at Publisher · View at Google Scholar · View at MathSciNet - H. Li and Y. Shi, “Output feedback predictive control for constrained linear systems with intermittent measurements,”
*Systems and Control Letters*, vol. 62, no. 4, pp. 345–354, 2013. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - C. Z. Zhang, G. Feng, J. B. Qiu, and Y. Y. Shen, “Control synthesis for a class of linear network-based systems with communication constraints,”
*IEEE Transactions on Automatic Control*, vol. 60, no. 8, pp. 3339–3348, 2013. View at Publisher · View at Google Scholar - L. Qiu, B. G. Xu, and S. B. Li, “${H}_{2}/{H}_{\infty}$ control of networked control system with random time delays,”
*Science China: Information Sciences*, vol. 54, no. 12, pp. 2615–2630, 2011. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - D. Yue, E. G. Tian, Z. D. Wang, and J. Lam, “Stabilization of systems with probabilistic interval input delays and its applications to networked control systems,”
*IEEE Transactions on Systems, Man, and Cybernetics A: Systems and Humans*, vol. 39, no. 4, pp. 939–945, 2009. View at Publisher · View at Google Scholar · View at Scopus - H. Y. Li, X. J. Jing, and H. R. Karimi, “Output-feedback-based ${H}_{\infty}$ control for vehicle suspension systems with control delay,”
*IEEE Transactions on Industrial Electronics*, vol. 61, no. 1, pp. 436–446, 2014. View at Publisher · View at Google Scholar - R. N. Yang, G. P. Liu, P. Shi, C. Thomas, and M. V. Basin, “Predictive output feedback control for networked control systems,”
*IEEE Transactions on Industrial Electronics*, vol. 61, no. 1, pp. 512–520, 2014. View at Publisher · View at Google Scholar - M. B. G. Cloosterman, N. van de Wouw, W. P. M. H. Heemels, and H. Nijmeijer, “Stability of networked control systems with uncertain time-varying delays,”
*IEEE Transactions on Automatic Control*, vol. 54, no. 7, pp. 1575–1580, 2009. View at Publisher · View at Google Scholar · View at MathSciNet - X. L. Luan, P. Shi, and F. Liu, “Stabilization of networked control systems with random delays,”
*IEEE Transactions on Industrial Electronics*, vol. 58, no. 9, pp. 4323–4330, 2011. View at Publisher · View at Google Scholar · View at Scopus - R. Q. Lu, Y. Xu, A. Xue, and J. C. Zheng, “Networked control with state reset and quantized measurements: observer-based case,”
*IEEE Transactions on Industrial Electronics*, vol. 60, no. 11, pp. 5206–5213, 2013. View at Publisher · View at Google Scholar - H. Fujioka, “A discrete-time approach to stability analysis of systems with aperiodic sample-and-hold devices,”
*IEEE Transactions on Automatic Control*, vol. 54, no. 10, pp. 2440–2445, 2009. View at Publisher · View at Google Scholar · View at MathSciNet - Y. Tang, H. J. Gao, W. Zou, and J. Kurths, “Distributed synchronization in networks of agent systems with nonlinearities and random switchings,”
*IEEE Transactions on Systems, Man, and Cybernetics B: Cybernetices*, vol. 43, no. 1, pp. 358–370, 2013. View at Publisher · View at Google Scholar - H. Yu and P. J. Antsaklis, “Event-triggered output feedback control for networked control systems using passivity: achieving ${L}_{2}$ stability in the presence of communication delays and signal quantization,”
*Automatica*, vol. 49, no. 1, pp. 30–38, 2013. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - W. P. M. H. Heemels, A. R. Teel, N. van de Wouw, and D. Nešić, “Networked control systems with communication constraints: tradeoffs between transmission intervals, delays and performance,”
*IEEE Transactions on Automatic Control*, vol. 55, no. 8, pp. 1781–1796, 2010. View at Publisher · View at Google Scholar · View at MathSciNet - H. L. Dong, Z. D. Wang, and H. J. Gao, “Distributed H filtering for a class of Markovian jump nonlinear time-delay systems over lossy sensor networks,”
*IEEE Transactions on Industrial Electronics*, vol. 60, no. 10, pp. 4665–4672, 2013. View at Publisher · View at Google Scholar - X. M. Tang and B. C. Ding, “Model predictive control of linear systems over networks with data quantizations and packet losses,”
*Automatica*, vol. 49, no. 5, pp. 1333–1339, 2013. View at Publisher · View at Google Scholar · View at MathSciNet - H. P. Li and Y. Shi, “Network-based predictive control for constrained nonlinear systems with two-channel packet dropouts,”
*IEEE Transactions on Industrial Electronics*, vol. 61, no. 3, pp. 1574–1582, 2014. View at Publisher · View at Google Scholar - T. C. Yang, “Networked control system: a brief survey,”
*IEE Proceedings: Control Theory and Applications*, vol. 153, no. 4, pp. 403–412, 2006. View at Publisher · View at Google Scholar · View at Scopus - L. X. Zhang, H. J. Gao, and O. Kaynak, “Network-induced constraints in networked control systems—a survey,”
*IEEE Transactions on Automatic Control*, vol. 9, no. 1, pp. 403–416, 2013. View at Publisher · View at Google Scholar - Y. Shi and B. Yu, “Robust mixed ${H}_{2}/{H}_{\infty}$ control of networked control systems with random time delays in both forward and backward communication links,”
*Automatica*, vol. 47, no. 4, pp. 754–760, 2011. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - O. L. V. Costa and D. Z. Figueiredo, “Stochastic stability of jump discrete-time linear systems with Markov chain in a general borel space,”
*IEEE Transactions on Automatic Control*, vol. 59, no. 1, pp. 223–227, 2014. View at Publisher · View at Google Scholar - S. P. He, J. Song, and F. Liu, “Unbiased estimation of Markov jump systems with distributed delays,”
*Signal Processing*, vol. 100, pp. 85–92, 2014. View at Publisher · View at Google Scholar - S. P. He and F. Liu, “Finite-time ${H}_{\infty}$ control of nonlinear jump systems with time-delays via dynamic observer-based state feedback,”
*IEEE Transactions on Fuzzy Systems*, vol. 20, no. 4, pp. 605–614, 2012. View at Publisher · View at Google Scholar - S. P. He, “Resilient ${L}_{2}$−${L}_{\infty}$ filtering of uncertain Markovian jumping systems within the finite-time interval,”
*Abstract and Applied Analysis*, vol. 2013, Article ID 791296, 7 pages, 2013. View at Publisher · View at Google Scholar · View at MathSciNet - S. P. He and F. Liu, “Adaptive observer-based fault estimation for stochastic Markovian jumping systems,”
*Abstract and Applied Analysis*, vol. 2012, Article ID 176419, 11 pages, 2012. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - S. P. He and F. Liu, “Robust finite-time estimation of Markovian jumping systems with bounded transition probabilities,”
*Applied Mathematics and Computation*, vol. 222, pp. 297–306, 2013. View at Publisher · View at Google Scholar · View at MathSciNet - Y. S. Moon, P. Park, W. H. Kwon, and Y. S. Lee, “Delay-dependent robust stabilization of uncertain state-delayed systems,”
*International Journal of Control*, vol. 74, no. 14, pp. 1447–1455, 2001. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet

*
*