Analysis and Design of Networked Control Systems with Random Markovian Delays and Uncertain Transition Probabilities

Qiu, Li; Liu, Chengxiang; Yao, Fengqi; Xu, Gang

doi:https://doi.org/10.1155/2014/486978

Abstract and Applied Analysis

On this page

Abstract Introduction Numerical Example Conclusions Acknowledgments References Copyright Related Articles

Special Issue

Robust Control, Optimization, and Applications to Markovian Jumping Systems

View this Special Issue

Research Article | Open Access

Volume 2014 | Article ID 486978 | https://doi.org/10.1155/2014/486978

Analysis and Design of Networked Control Systems with Random Markovian Delays and Uncertain Transition Probabilities

Li Qiu,¹Chengxiang Liu,²Fengqi Yao,³and Gang Xu¹

Academic Editor: Shuping He

Received16 Jan 2014

Accepted03 Mar 2014

Published14 Apr 2014

Abstract

This paper focuses on the stability issue of discrete-time networked control systems with random Markovian delays and uncertain transition probabilities, wherein the random time delays exist in the sensor-to-controller and controller-to-actuator. The resulting closed-loop system is modeled as a discrete-time Markovian delays system governed by two Markov chains. Using Lyapunov stability theory, a result is established on the Markovian structure and ensured that the closed-loop system is stochastically stable. A simulation example illustrates the validity and feasibility of the results.

1. Introduction

Networked control systems (NCS) find many successful applications in power grids, manufacturing plants, vehicles, aircrafts, spacecrafts, remote surgery, and so on [1]. Compared with the traditional control systems, the use of the communication networks brings many advantages such as low cost, reduced weight, and simple installation and maintenance, as well as high efficiency, flexibility, and reliability. However, inserting communication networks into feedback control loops has also resulted in several interesting and challenging issues, such as packet dropouts [2], time delays [3–10], quantization [11], time-varying transmission intervals [12], distributed synchronization [13], or some of the constraints considered simultaneously [14–17], which make the analysis and design of NCS complex. These imperfections block the way of harvesting reliable NCS by implementing existing control techniques [18]. To overcome these drawbacks, significant attention has been paid to the NCS research ranging from system identification and stability analysis to controller and filter designs. See the survey papers [1, 19, 20] and the references therein.

The network-induced time delays are known to be the major challenges in NCS, which may be potential causes for the deteriorating performance or instability of NCS. Consequently, numerous works have been conducted on the time-delay issue in the past years. For example, in [21], the mixed control issue of NCS with random time delays has been investigated based on Markovian jump linear systems method. In [9], the stability problem of NCS with uncertain time-varying delays has been investigated. The stability and stabilization of NCS with random time delay usually use Markovian jump linear systems (MJLS) approach, and, recently, many significant achievements have been obtained for MJLS in [22–26]. However, most of the approaches for NCS based on Markovian jump systems framework assumed that the Markovian transition probabilities are known a priori, which severely limit the utility of the Markov model. Furthermore, such assumption may not hold true especially in the case where networked control is applied to the remote plants. Recently, the filter problem for a class of uncertain Markovian jumping systems with bounded transition probabilities has been investigated in [27], but the well-established results cannot be directly used to NCS. To the best of the authors’ knowledge, up to now, very limited efforts have been devoted to studying the system with uncertain transition probability matrices for NCS, which motivates our investigation.

In this paper, we address the analysis and design of NCS with random time delays modeled by Markov chains in forward sensor-to-controller (S-C) and feedback controller-to-actuator (C-A) communication links and with the uncertain transition probability matrices. The main contributions of this paper are highlighted as follows. (i) A model is proposed for NCS with random Markovian delays and uncertain transition probability matrices. (ii) The system modeled will be more generalized and avoid the ideal assumption that the transition probabilities are known a priori. (iii) New criteria for stability are obtained based on a Lyapunov approach. Finally, a numerical example is provided to demonstrate the effectiveness of the proposed control scheme for NCS with random time delays and uncertain transition probability matrices.

The remainder of this paper is organized as follows. A model with Markovian delays and uncertain transition probabilities is obtained in Section 2. The main results are obtained based on a Lyapunov approach and the linear matrix inequalities technique in Section 3. Section 4 presents the simulation results. Finally, the conclusions are provided in Section 5.

Notations. Matrices are assumed to have appropriate dimensions. and denote the -dimensional Euclidean space and the set of all real matrices, respectively. The notations () indicate that is a real symmetric positive (negative) definite matrix. and denote the identity matrix and the zero matrix with appropriate dimensions, respectively. Superscripts “” and “” stand for the matrix transposition and the matrix inverse, respectively. stands for the mathematical expectation and stands for a block-diagonal matrix of and . and denote the identity matrix and zero matrix with appropriate dimensions, respectively. denotes the expression , and means symmetric terms in symmetric entries.

2. NCS Model

The framework of networked control systems is depicted in Figure 1. The plant, sensor, controller, and actuator are spatially distributed and closed through a network. Random time delays exist in both of S-C and C-A.

The plant is described by the following discrete-time linear time-invariant plant model: where is the system state vector and is the control input. and are known real constant matrices with appropriate dimensions.

For this system, we will consider a state feedback controller as follows: where is the state feedback controller gain.

Random S-C and C-A time delays are and , respectively. and are assumed be bounded; that is, , , where , , , and . One way to model delays and is by using the finite-state Markov chains presented in [21]. The main advantages of the Markov model considering the dependence between delays are that the current time delays in real networks delays are frequently related to the previous delays. In this paper and are modeled as two homogeneous Markov chains.

By substituting controller (2) to plant (1), we obtain a closed-loop system as follows: where .

In system (3), and are two finite state discrete-time homogeneous Markov chains with values in the finite sets and with the uncertain transition probability matrices and . and denote the uncertain transition probability matrices of Markov chain and , respectively, with probabilities and , which are defined by where , and , for all and . The transition probability matrices and are unknown a priori but belong to the following bounded compact set: where () and () are known constant matrices. () and () denote the uncertainty in the transition probability matrices, where and satisfy where , , and and are the known small scalar for all and , respectively.

Remark 1. Closed-loop system (3) is a linear system with the Markovian delays and , which describe the behavior of the S-C and C-A random time delays, and with the uncertain transition probabilities.

Remark 2. The uncertain transition probabilities and contain the certain terms and , and the uncertain terms and , respectively. The uncertain terms and are bounded, and the sums of the elements in each row are zeros.

3. Stability Analysis and Controller Design

By applying a Lyapunov approach and a linear matrix inequality technique, this section provides sufficient conditions for the stochastic stability and the synthesis of state feedback controller design of the system (3).

Definition 3 (see [21]). The closed-loop system (3) is said to be stochastically stable if, for every finite , initial mode and , there exists a finite such that

Theorem 4. For the system (3), random but bounded scalars and . If, for each mode and and matrices , , , , , and , and exist that satisfy the following matrix inequalities: where and and are defined in (4) and (5).

Then the closed-loop system (3) is stochastically stable.

Proof. For the closed-loop system (3), the stochastic Lyapunov functional candidate is constructed as follows: with where , , , , , , and .
Let , noting that . Then . For simplicity, we will use the following notations: . Then, for any weighting matrices with compatible dimensions (and let ), we have . Along the trajectory of the solution of the closed-loop system (3), we obtain By Jensen’s inequality, we can obtain Similarly, we have By substituting (16) and (17) to (15) and then combining (12), (13), and (14), we have where . By using the Schur complement, (8) guarantees that . Therefore, where denotes the minimal eigenvalue of and . From (19), it follows that, for any , Furthermore By taking as the limit, we obtain According to Definition 3, the closed-loop system (3) exhibits stochastic stability for all uncertain transition probability matrices.

Theorem 4 gives a sufficient condition for the stochastic stability of the system (3). However, it should be noted that the controller gain cannot be obtained according to the condition in (8) because of the nonlinear terms and and the uncertain terms and . To handle this problem, the equivalent LMI conditions are given as follows.

Before proceeding further, we provide the following lemma that will play a significant role in processing the uncertainty terms and of uncertain transition probability matrices and .

Lemma 5 (see [28]). For any vectors of and positive matrix , the following holds:

Theorem 6. For the system (3), the random but bounded scalars and . If, for each mode and , the tuning parameters and , the scalars and , and matrices , , , , , , , , , and , and exist such that where
Then the closed-loop system (3) is stochastically stable and the controller is a state feedback controller of the system (3).

Proof. Let , , , and , where and are known tuning parameters. We restrict to be the same for all (namely, ) and give the notations as Pre- and postmultiplying and to (8), respectively, we have where where and are defined in Theorem 4 and , , and are defined in Theorem 6.
According to the assumption on uncertain transition probabilities and and the fact that and , one has Note that By Lemma 5 and the fact that , we have Similarly, we have
Note that, for any matrix , we have for and . Combining (29), (31), and (32) and by the Schur complement, (24) can be yielded easily from (27); this completes the proof of Theorem 6.

4. Numerical Example

In this section, we illustrate our results through an example. We apply the results in Theorem 6 to a simple inverted pendulum system [5] shown in Figure 2, which is a two-order unstable system. The state variables are , where is the angular position of the pendulum. The parameters used are kg and m, without friction surfaces. The sampling time is s. The plant matrices are given by

We assume that the stochastic Markovian jumping S-C delay and C-A delay and their uncertain transition probability matrices are given as follows: The eigenvalues of are 1.1695 and 0.8551. Therefore, the discrete-time model is unstable.

Figures 3 and 4 show part of the simulation of the Markov chains mode. The initial conditions are as follows: , , and . By Theorem 6, when , , , and , we can obtain the gain matrix of state feedback controller (2) which is constructed as

The state trajectories of the system (3) are shown in Figure 5, where two curves represent state trajectories under the controller gains . Figure 5 also indicates that the system (3) is stochastically stable.

Remark 7. In this example, the uncertain transition probabilities are given as a discrete probability distribution function. When the uncertain transition probability is given as a continuous probability distribution function, we can use the norm of the continuous probability distribution function as the upper bound to simulation.

5. Conclusions

The state feedback stabilization problem for a class of NCS with the S-C and C-A random time delays is investigated in this paper. The resulting closed-loop NCS is modeled as a linear system with uncertain Markovian transition probabilities. New sufficient conditions on stochastic stability and stabilization are obtained by Lyapunov stability theory and linear matrix inequalities method. An example is presented to illustrate the effectiveness of the approach. Although only the time-delay issue for NCS is addressed in this paper, the method can be extended to the NCS with the random packet dropouts, time delays, and packet dropouts and to the MJLS with the uncertain Markovian transition probabilities.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgments

This work was supported partly by the National Natural Science Foundation of China (Grant nos. 61174070 and 61104107), the Natural Science Foundation of Guangdong Province (Grant no. S2013040016183), the Foundation of Key Laboratory of Autonomous Systems and Networked Control, Ministry of Education, China, and the Natural Science Foundation of Shenzhen University (Grant no. 201207).

References

J. P. Hespanha, P. Naghshtabrizi, and Y. G. Xu, “A survey of recent results in networked control systems,” Proceedings of the IEEE, vol. 95, no. 1, pp. 138–162, 2007.
View at: Publisher Site | Google Scholar
M. C. F. Donkers, W. P. M. H. Heemels, N. van de Wouw, and L. Hetel, “Stability analysis of networked control systems using a switched linear systems approach,” IEEE Transactions on Automatic Control, vol. 56, no. 9, pp. 2101–2115, 2011.
View at: Publisher Site | Google Scholar | MathSciNet
H. Li and Y. Shi, “Output feedback predictive control for constrained linear systems with intermittent measurements,” Systems and Control Letters, vol. 62, no. 4, pp. 345–354, 2013.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
C. Z. Zhang, G. Feng, J. B. Qiu, and Y. Y. Shen, “Control synthesis for a class of linear network-based systems with communication constraints,” IEEE Transactions on Automatic Control, vol. 60, no. 8, pp. 3339–3348, 2013.
View at: Publisher Site | Google Scholar
L. Qiu, B. G. Xu, and S. B. Li, “ $H_{2} / H_{\infty}$ control of networked control system with random time delays,” Science China: Information Sciences, vol. 54, no. 12, pp. 2615–2630, 2011.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
D. Yue, E. G. Tian, Z. D. Wang, and J. Lam, “Stabilization of systems with probabilistic interval input delays and its applications to networked control systems,” IEEE Transactions on Systems, Man, and Cybernetics A: Systems and Humans, vol. 39, no. 4, pp. 939–945, 2009.
View at: Publisher Site | Google Scholar
H. Y. Li, X. J. Jing, and H. R. Karimi, “Output-feedback-based $H_{\infty}$ control for vehicle suspension systems with control delay,” IEEE Transactions on Industrial Electronics, vol. 61, no. 1, pp. 436–446, 2014.
View at: Publisher Site | Google Scholar
R. N. Yang, G. P. Liu, P. Shi, C. Thomas, and M. V. Basin, “Predictive output feedback control for networked control systems,” IEEE Transactions on Industrial Electronics, vol. 61, no. 1, pp. 512–520, 2014.
View at: Publisher Site | Google Scholar
M. B. G. Cloosterman, N. van de Wouw, W. P. M. H. Heemels, and H. Nijmeijer, “Stability of networked control systems with uncertain time-varying delays,” IEEE Transactions on Automatic Control, vol. 54, no. 7, pp. 1575–1580, 2009.
View at: Publisher Site | Google Scholar | MathSciNet
X. L. Luan, P. Shi, and F. Liu, “Stabilization of networked control systems with random delays,” IEEE Transactions on Industrial Electronics, vol. 58, no. 9, pp. 4323–4330, 2011.
View at: Publisher Site | Google Scholar
R. Q. Lu, Y. Xu, A. Xue, and J. C. Zheng, “Networked control with state reset and quantized measurements: observer-based case,” IEEE Transactions on Industrial Electronics, vol. 60, no. 11, pp. 5206–5213, 2013.
View at: Publisher Site | Google Scholar
H. Fujioka, “A discrete-time approach to stability analysis of systems with aperiodic sample-and-hold devices,” IEEE Transactions on Automatic Control, vol. 54, no. 10, pp. 2440–2445, 2009.
View at: Publisher Site | Google Scholar | MathSciNet
Y. Tang, H. J. Gao, W. Zou, and J. Kurths, “Distributed synchronization in networks of agent systems with nonlinearities and random switchings,” IEEE Transactions on Systems, Man, and Cybernetics B: Cybernetices, vol. 43, no. 1, pp. 358–370, 2013.
View at: Publisher Site | Google Scholar
H. Yu and P. J. Antsaklis, “Event-triggered output feedback control for networked control systems using passivity: achieving $L_{2}$ stability in the presence of communication delays and signal quantization,” Automatica, vol. 49, no. 1, pp. 30–38, 2013.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
W. P. M. H. Heemels, A. R. Teel, N. van de Wouw, and D. Nešić, “Networked control systems with communication constraints: tradeoffs between transmission intervals, delays and performance,” IEEE Transactions on Automatic Control, vol. 55, no. 8, pp. 1781–1796, 2010.
View at: Publisher Site | Google Scholar | MathSciNet
H. L. Dong, Z. D. Wang, and H. J. Gao, “Distributed H filtering for a class of Markovian jump nonlinear time-delay systems over lossy sensor networks,” IEEE Transactions on Industrial Electronics, vol. 60, no. 10, pp. 4665–4672, 2013.
View at: Publisher Site | Google Scholar
X. M. Tang and B. C. Ding, “Model predictive control of linear systems over networks with data quantizations and packet losses,” Automatica, vol. 49, no. 5, pp. 1333–1339, 2013.
View at: Publisher Site | Google Scholar | MathSciNet
H. P. Li and Y. Shi, “Network-based predictive control for constrained nonlinear systems with two-channel packet dropouts,” IEEE Transactions on Industrial Electronics, vol. 61, no. 3, pp. 1574–1582, 2014.
View at: Publisher Site | Google Scholar
T. C. Yang, “Networked control system: a brief survey,” IEE Proceedings: Control Theory and Applications, vol. 153, no. 4, pp. 403–412, 2006.
View at: Publisher Site | Google Scholar
L. X. Zhang, H. J. Gao, and O. Kaynak, “Network-induced constraints in networked control systems—a survey,” IEEE Transactions on Automatic Control, vol. 9, no. 1, pp. 403–416, 2013.
View at: Publisher Site | Google Scholar
Y. Shi and B. Yu, “Robust mixed $H_{2} / H_{\infty}$ control of networked control systems with random time delays in both forward and backward communication links,” Automatica, vol. 47, no. 4, pp. 754–760, 2011.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
O. L. V. Costa and D. Z. Figueiredo, “Stochastic stability of jump discrete-time linear systems with Markov chain in a general borel space,” IEEE Transactions on Automatic Control, vol. 59, no. 1, pp. 223–227, 2014.
View at: Publisher Site | Google Scholar
S. P. He, J. Song, and F. Liu, “Unbiased estimation of Markov jump systems with distributed delays,” Signal Processing, vol. 100, pp. 85–92, 2014.
View at: Publisher Site | Google Scholar
S. P. He and F. Liu, “Finite-time $H_{\infty}$ control of nonlinear jump systems with time-delays via dynamic observer-based state feedback,” IEEE Transactions on Fuzzy Systems, vol. 20, no. 4, pp. 605–614, 2012.
View at: Publisher Site | Google Scholar
S. P. He, “Resilient $L_{2}$ − $L_{\infty}$ filtering of uncertain Markovian jumping systems within the finite-time interval,” Abstract and Applied Analysis, vol. 2013, Article ID 791296, 7 pages, 2013.
View at: Publisher Site | Google Scholar | MathSciNet
S. P. He and F. Liu, “Adaptive observer-based fault estimation for stochastic Markovian jumping systems,” Abstract and Applied Analysis, vol. 2012, Article ID 176419, 11 pages, 2012.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
S. P. He and F. Liu, “Robust finite-time estimation of Markovian jumping systems with bounded transition probabilities,” Applied Mathematics and Computation, vol. 222, pp. 297–306, 2013.
View at: Publisher Site | Google Scholar | MathSciNet
Y. S. Moon, P. Park, W. H. Kwon, and Y. S. Lee, “Delay-dependent robust stabilization of uncertain state-delayed systems,” International Journal of Control, vol. 74, no. 14, pp. 1447–1455, 2001.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet

Copyright

Copyright © 2014 Li Qiu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

761

Downloads

1361

Citations