Mathematical Problems in Engineering

Volume 2013 (2013), Article ID 635941, 10 pages

http://dx.doi.org/10.1155/2013/635941

## Control for Networked Control Systems with Time Delays and Packet Dropouts

^{1}School of Automation, Nanjing University of Science and Technology, Nanjing 210094, China^{2}Department of Engineering, Faculty of Engineering and Science, University of Agder, 4898 Grimstad, Norway

Received 30 December 2012; Accepted 25 March 2013

Academic Editor: Yang Yi

Copyright © 2013 Yilin Wang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

This paper is concerned with the control issue for a class of networked control systems (NCSs) with packet dropouts and time-varying delays. Firstly, the addressed NCS is modeled as a Markovian discrete-time switched system with two subsystems; by using the average dwell time method, a sufficient condition is obtained for the mean square exponential stability of the closed-loop NCS with a desired disturbance attenuation level. Then, the desired controller is obtained by solving a set of linear matrix inequalities (LMIs). Finally, a numerical example is given to illustrate the effectiveness of the proposed method.

#### 1. Introduction

Networked control systems (NCSs) are distributed systems in which communication between sensors, actuators, and controllers is supported by a shared real-time network. Compared with conventional point-to-point system connection, this new network-based control scheme reduces system wiring and has low cost, high reliability, information sharing, and remote control [1, 2]. Nevertheless, the introduction of communication networks also brings some new problems and challenges, such as time-delay, packet dropout, quantization, and band-limited channel [3–8], which all might be potential sources of poor performance, even of instability.

Random delay and packet dropout in NCS are two major causes for the deterioration of system stability; various approaches have been developed for the NCS with random communication delays and packet dropout in [9–17]. The time delay occurs in various physical, industrial, and engineering systems and is a source of poor performance and instability of systems. In [9, 10], the uncertainties of the delays are transformed into those of the system models with uncertain parameters. The delay is limited to take finite values during a sampling period, and the NCS is ultimately modeled as a discrete-time switched system with a finite number of subsystems [11, 12]. In [13–15], the delay is assumed to be random and follows some specific distribution laws, which may not be exactly known prior in practice. And in some literature the delay is separated into a nominal part and an uncertain part; in this way, the NCS is represented as an uncertain system with norm-bounded uncertainties or polytopic uncertainties. Another important issue in NCS control problem is packet dropout; most of the NCS models are presented by using the Bernoulli random binary distributed sequence methods or the Markov chain. For NCSs, let the binary-valued function denote the data transmission status from sensor to controller and controller to actuator, respectively, where 1 means successful packet communication and 0 is the case of packet dropout [16]. Reference [17] proposes an iterative method to model NCSs with bounded packet dropout as MJLSs with partly unknown transition probabilities.

On the other hand, in view of abrupt variation in the structures, such as component failures, sudden environmental disturbance, and abrupt variations of the operating points of NCSs, it is more appropriate to model such class of systems as a special class of stochastic hybrid systems with finite operation modes. And packet dropout (time-delay) of the next sampling moment may have a close relation to the previous moment, so it is reasonable to model NCS as the Markov switched system. The mean square stabilization of a class of Markovian NCS is studied in [18], and the average dwell time (ADT) approach is applied to investigate the stability of the NCS in [19]. However, to the best of our knowledge, the problems of mean square exponential stability and control for the NCS have not been fully investigated to date. This motivates the present study.

With the motivation of the above reasons, we consider the mean square exponential performance for NCS with random delay and packet dropout. The main contribution can be summarized as follows: (i) an NCS model with random delay and packet dropout is proposed firstly; the packet dropout process is modeled as a finite state Markov chain and the resulting closed-loop system is a Markovian switching system; (ii) the parameter-dependent Lyapunov function is applied for stability analysis and control synthesis, and sufficient conditions for the robustly mean square exponential stability of the closed-loop system are given by using the ADT method [20], where the convergence of the Markov chain is utilized; and (iii) a state feedback controller is designed by using a cone complementary linearization approach to ensure that the closed-loop system is mean square exponentially stable and achieves the disturbance attenuation level.

The paper is organized as follows. In Section 2, the NCS with packet dropouts and time-varying delays is modeled as a class of the Markovian discrete-time switched system with two subsystems. The mean square exponential stability of the closed-loop NCS with a desired disturbance attenuation level is developed in Section 3 and the desired controller is formulated in a set of LMIs. A numerical example is provided in Section 4. Finally, Section 5 concludes this paper.

*Notation 1. *Throughout the paper, the superscript ‘‘’’ and ‘‘’’ stand for the inverse and transpose of a matrix, respectively; denotes the -dimensional Euclidean space and the notation means that is a real symmetric positive definite matrix. is the expectation of the stochastic variable . and represent identity matrix and zero matrix with appropriate dimensions in different places. In symmetric block matrices or complex matrix expressions, we use an asterisk * to represent a term that is induced by symmetry and stands for a block diagonal matrix. refers to the Euclidean norm for vectors and induced 2-norm for matrix. stands for the space of square integrable functions on .

#### 2. Model of Networked Control System

Consider the following system: where , , and are the state vector, control input vector, and controlled output vector, respectively, and is the exogenous disturbance signal belonging to . , , , and are known real matrices with appropriate dimensions. is the nonlinear function vector, and . satisfies the local Lipschitz condition, that is, where is a known constant.

In the considered NCS, time delays exist in both channels from sensor to controller and from controller to actuator. Sensor-to-controller delay and controller-to-actuator delay are denoted by and , respectively. The assumptions in the above NCS are as follows:(1)the discrete-time state-feedback controller and the actuator are event driven; the sensor is time-driven with sampling period ,(2)the network-induced delay satisfies ,(3)the zero-order hold device does not update the output value until the new value arrives.

The output value of the discrete-time state-feedback controller corresponding to is denoted by

Consider the plant input:

Discretizing system (1) in one period, we can obtain the discrete state equation of the NCS: where , , , , and .

By using the Jordan form of the matrix , is rewritten as [21] with , where and are constant matrices, and the eigenvalue of is .

Then, is a subset of with where , , is the set of vertices, and denotes the convex hull. Thus we obtain with , .

Defining an augmented vector , during each sampling period, two cases may arise, which can be listed as follows.

: no packet dropout happens; (5) can be written as where Substituting (8) into (9) gives rise to where

: packet dropout happens; (5) can be written as where .

From (2)–(9), the nonlinear uncertainty satisfies where is a known constant positive-definite matrix.

By the above analysis and assumptions, we can see that networked control system can be described by the following switched system with two modes: where is called a switching signal. represents no packet dropout, while implies packet dropout. The switching characteristics between the two modes are often assumed as the Markov chain, and is transition probability from mode to , ; therefore, of the Markov chain has ergodicity and satisfied the following condition: where is the limitation of state . So is the stationary distribution of the Markov chain.

For an arbitrary switching sequence and any given integer , let imply the initial time, and , represent the switching instants. Denote as the all sequence of the time period in which subsystem 1 is active during the time interval . Similarly, represents the all period sequence that subsystem 2 is active during the time interval .

Lemma 1 (Schur complement [22]). *For a given matrix , where are square matrices, the following conditions are equivalent:*(1)*;*(2)*;*(3)*.*

Lemma 2 (see [23]). *The stochastic stability in discrete time implies the stochastic stability in continuous time.*

*Definition 3 (see [24]). *The closed-loop system (15) is mean square exponentially stable with , if there exists , , such that
for all initial condition .

*Definition 4 (see [25]). *For any , let denote the total number of the switching of during the interval . If
holds for a given , , then the constant is called the average dwell time and is the chatter bound. For simplicity, we choose without loss of generality.

*Definition 5 (see [20]). *Given scalars and , the closed-loop system (15) is robustly exponentially stable with an exponential performance if the following conditions are satisfied: (a)the closed-loop system (15) with is exponentially stable; (b)under the zero-initial condition, it holds that

#### 3. Main Results

The following theorems present a sufficient condition for the mean square stability of the considered system and the controller design method.

##### 3.1. Stability Analysis

In this subsection, sufficient conditions for the existence of mean square exponential stability of system (15) with are given in the following theorem.

Theorem 6. *System (15) is mean square exponentially stable with a decay rate , if there exist positive definite matrices , , scalars , , and , such that**
where .*

*Proof. *For the system (15), define the following Lyapunov function:
where
For subsystem 1, it follows from (15) that
where
From inequality (20), one obtains
In the same way, for subsystem 2, we obtain
then
Considering the condition (22), we get that
Then for , we get
Note that the Markov chain is stationary (16); then
Therefore, we can obtain that
From Definition 4 we have that
And from [24], we can get ; then combining (23) and (24), we can know that
which ensure the convergence of .

In this case,
Furthermore
Then
Therefore, by Definition 3, system (15) is mean square exponentially stable.

*Remark 7. *From Lemma 2, we know that system (1) is also mean square exponentially stable.

##### 3.2. Performance Analysis and Controller Design

In this subsection, we are in the position to prove the main result. The controller design method is given in the following theorem.

Theorem 8. *For given scalars , , , and , if there exist positive definite matrices , , , , and matrix of appropriate dimensions, , such that (22)–(24) and the following inequalities:
**
where , ,
**
hold, then system (15) with the controller gain matrix has robustly mean square exponential stability with disturbance attenuation level .*

*Proof. *It is easy to obtain that (20) and (21) can be deduced from (41) and (42), respectively. Then from Theorem 6, it can be verified that closed-loop system (15) is mean square exponentially stable with .

For the nonzero , using the same Lyapunov function candidates as in Theorem 6, the following relations can be obtained:
From inequalities (43), we have
where
In terms of the Schur complement, we obtain
where ,
In light of Lemma 1, if equalities (47) and (48) hold, then combining (44) and (45), we have that
where .

Combining (22) and (49), it can be seen that
Since and the zero-initial state assumption, it can be seen that
From (34), (51) can be written as
Multiplying both sides of inequality (52) by , we can obtain
which is equivalent to
Then, from Definition 4 and (24)
we have
Therefore
which implies that
Then
By Definition 5, system (15) has an exponential performance . This completes the proof.

*Remark 9. *It should be pointed out that the conditions proposed in Theorem 8 are not standard LMIs. In this paper, it is suggested to use the cone complementarity linearization (CCL) algorithm to solve this problem [26]; a nonlinear constraint can be converted to a linear optimization problem with a rank constraint.

*Remark 10. *In this paper, the mean square exponential performance of the system (15) can be guaranteed, which means the noise attenuation performance is different when the decay degree of the system is different, and the decay degree has a close relation with the elements of the transition probabilities. Note that the scalar in the sequel symbolizes the decreasing rate of the Lyapunov function to be constructed for each subsystem from Theorem 6. Then, if , the evaluated performance index will approach the normal performance for the whole time domain.

#### 4. Numerical Example

In this section, we present an example to illustrate the effectiveness of the proposed approach. Consider the following system:

Let the sampling period be , and . Assume that the transition probability matrix of stochastic switching signals is given as ; the corresponding matrices are given by For subsystem 2 without state feedback, is an unstable matrix, and . By Theorem 6, we can get . Take , ; then , which satisfies the condition (16). It is assumed that ; solving LMIs (41) and (42) in Theorem 8, we get the following solutions: Then the controller gain can be obtained: The state trajectories of the NCS and the corresponding switching signal are shown in Figures 1 and 2, respectively, where the initial condition and .

From simulation results, it can be seen that the NCS is robustly mean square exponentially stable and the disturbance attenuation level .

#### 5. Conclusions

In this paper, a discrete-time switched system with two subsystems has been presented to model the NCS with time delay and packet dropout. A new approach by using the average dwell time method is proposed to study the robust stabilization and control of the addressed NCS. Finally, a numerical example has been given to demonstrate the effectiveness of the proposed method.

#### Acknowledgment

This work was supported by the National Natural Science Foundation of China under Grants nos. 60974027 and 61273120.

#### References

- G. P. Liu, Y. Q. Xia, J. Chen, D. Rees, and W. S. Hu, “Networked predictive control of systems with random network delays in both forward and feedback channels,”
*IEEE Transactions on Industrial Electronics*, vol. 54, no. 3, pp. 1282–1297, 2007. View at Publisher · View at Google Scholar · View at Scopus - W. Zhang, M. S. Branicky, and S. M. Phillips, “Stability of networked control systems,”
*IEEE Control Systems Magazine*, vol. 21, no. 1, pp. 84–97, 2001. View at Google Scholar · View at Scopus - H. Song, L. Yu, and W. A. Zhang, “Stabilisation of networked control systems with communication constraints and multiple distributed transmission delays,”
*IET Control Theory & Applications*, vol. 3, no. 10, pp. 1307–1316, 2009. View at Publisher · View at Google Scholar · View at MathSciNet - W. A. Zhang and L. Yu, “Output feedback stabilization of networked control systems with packet dropouts,”
*IEEE Transactions on Automatic Control*, vol. 52, no. 9, pp. 1705–1710, 2007. View at Publisher · View at Google Scholar · View at MathSciNet - W. A. Zhang and L. Yu, “A robust control approach to stabilization of networked control systems with time-varying delays,”
*Automatica*, vol. 45, no. 10, pp. 2440–2445, 2009. View at Publisher · View at Google Scholar · View at Scopus - L. Zhang, Y. Shi, T. Chen, and B. Huang, “A new method for stabilization of networked control systems with random delays,”
*IEEE Transactions on Automatic Control*, vol. 50, no. 8, pp. 1177–1181, 2005. View at Publisher · View at Google Scholar · View at MathSciNet - P. Seiler and R. Sengupta, “An ${H}_{\infty}$ approach to networked control,”
*IEEE Transactions on Automatic Control*, vol. 50, no. 3, pp. 356–364, 2005. View at Publisher · View at Google Scholar · View at MathSciNet - M. E. M. Ben Gaid and A. Çela, “Trading quantization precision for update rates for systems with limited communication in the uplink channel,”
*Automatica*, vol. 46, no. 7, pp. 1210–1214, 2010. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - C. Zhou, M. Du, and Q. Chen, “Co-design of dynamic scheduling and H-infinity control for networked control systems,”
*Applied Mathematics and Computation*, vol. 218, no. 21, pp. 10767–10775, 2012. View at Publisher · View at Google Scholar · View at MathSciNet - J. F. Wang and H. Z. Yang, “Exponential stability of a class of networked control systems with time delays and packet dropouts,”
*Applied Mathematics and Computation*, vol. 218, no. 17, pp. 8887–8894, 2012. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - J. F. Wang and H. Z. Yang, “${H}_{\infty}$ control of a class of networked control systems with time delay and packet dropout,”
*Applied Mathematics and Computation*, vol. 217, no. 18, pp. 7469–7477, 2011. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - W. A. Zhang, L. Yu, and S. Yin, “A switched system approach to ${H}_{\infty}$ control of networked control systems with time-varying delays,”
*Journal of the Franklin Institute*, vol. 348, no. 2, pp. 165–178, 2011. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - E. Tian and D. Yue, “A new state feedback ${H}_{\infty}$ control of networked control systems with time-varying network conditions,”
*Journal of the Franklin Institute*, vol. 349, no. 3, pp. 891–914, 2012. View at Publisher · View at Google Scholar · View at MathSciNet - L. Zhou, X. Xiao, and G. Lu, “Network-based control of discrete-time descriptor systems with random delays,”
*Circuits, Systems, and Signal Processing*, vol. 30, no. 5, pp. 1055–1070, 2011. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - Y. Shi and B. Yu, “Output feedback stabilization of networked control systems with random delays modeled by Markov chains,”
*IEEE Transactions on Automatic Control*, vol. 54, no. 7, pp. 1668–1674, 2009. View at Publisher · View at Google Scholar · View at MathSciNet - Y. Zhang and H. J. Fang, “Stabilization of nonlinear networked systems with sensor random packet dropout and time-varying delay,”
*Applied Mathematical Modelling*, vol. 35, no. 5, pp. 2253–2264, 2011. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - Y. G. Sun and S. Y. Qin, “Stability and stabilization of networked control systems with bounded packet dropout,”
*Acta Automatica Sinica*, vol. 37, no. 1, pp. 113–118, 2011. View at Publisher · View at Google Scholar · View at MathSciNet - D. X. Xie, X. D. Han, H. Huang, and Z. Q. Wang, “Research on robust mean square stability of networked control systems with packet dropout,”
*Journal of Systems Engineering and Electronics*, vol. 21, no. 1, pp. 95–101, 2010. View at Publisher · View at Google Scholar · View at Scopus - Y. Sun and S. Qin, “Stability of networked control systems with packet dropout: an average dwell time approach,”
*IET Control Theory & Applications*, vol. 5, no. 1, pp. 47–53, 2011. View at Publisher · View at Google Scholar · View at MathSciNet - L. X. Zhang, E. K. Boukas, and P. Shi, “Exponential ${H}_{\infty}$ filtering for uncertain discrete-time switched linear systems with average dwell time: a $\mu $-dependent approach,”
*International Journal of Robust and Nonlinear Control*, vol. 18, no. 11, pp. 1188–1207, 2008. View at Publisher · View at Google Scholar · View at MathSciNet - M. B. G. Cloosterman,
*Control over communication networks: modeling, analysis, and synthesis [Ph.D. thesis]*, Technische Universiteit Eindhoven, Eindhoven, The Netherlands, 2008. - S. Boyd, L. El Ghaoui, E. Feron, and V. Balakrishnan,
*Linear Matrix Inequalities in System and Control Theory*, vol. 15 of*SIAM Studies in Applied Mathematics*, SIAM, Philadelphia, Pa, USA, 1994. View at Publisher · View at Google Scholar · View at MathSciNet - Y. Song, H. Dong, and M. R. Fei, “Mean square exponential stabilization of Markov networked control systems based on switching frequency,”
*Acta Automatica Sinica*, vol. 38, no. 5, pp. 876–881, 2012. View at Publisher · View at Google Scholar · View at MathSciNet - G. S. Zhai, B. Hu, K. Yasuda, and A. N. Michel, “Disturbance attenuation properties of time-controlled switched systems,”
*Journal of the Franklin Institute*, vol. 338, no. 7, pp. 765–779, 2001. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - G. Rubino and B. Sericola, “Sojourn times in finite Markov processes,”
*Journal of Applied Probability*, vol. 26, no. 4, pp. 744–756, 1989. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - L. El Ghaoui, F. Oustry, and M. AitRami, “A cone complementarity linearization algorithm for static output-feedback and related problems,”
*IEEE Transactions on Automatic Control*, vol. 42, no. 8, pp. 1171–1176, 1997. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet