Mathematical Problems in Engineering

Volume 2013 (2013), Article ID 218682, 7 pages

http://dx.doi.org/10.1155/2013/218682

## Observer-Based Feedback Stabilization of Networked Control Systems with Random Packet Dropouts

School of Computer Science and Technology, China University of Mining and Technology, Xuzhou 221116, China

Received 27 March 2013; Accepted 13 May 2013

Academic Editor: Tingwen Huang

Copyright © 2013 Pengpeng Chen and Shouwan Gao. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

This paper is concerned with observer-based feedback stabilization of networked control systems (NCSs) with random packet dropouts. Both sensor-to-controller (S/C) and controller-to-actuator (C/A) packet dropouts are considered, and their behavior is assumed to obey the Bernoulli random binary distribution. The hold-input strategy is adopted, in which the previous packet is used if the packet is lost. An observer-based feedback controller is designed, and sufficient conditions for stochastic stability are derived in the form of linear matrix inequalities (LMIs). A numerical example illustrates the effectiveness of the results.

#### 1. Introduction

In the past few years, dramatic progress has been made for network analysis. Unparticular, many important results have been obtained in engineering, such as the stability analysis and controller design for networked control systems (NCSs) [1–3] and consensus for networked multiagent systems [4, 5]. While NCSs have recently been receiving increasing attention due to their advantages over classical feedback control systems, the insertion of the communication network gives rise to new challenges. Among these challenges, time delays and packet losses are two important factors that can severely degrade the performance of NCSs. In the past few years, much attention has been paid to the time delay problem of NCSs, see [6–10], to name a few. Moreover, some existing control methods for time delays [11] can be used to NCSs with time delay. On the other hand, the control problem of NCSs with packet losses has also attracted considerable research interests (see, e.g., [12, 13] and references therein). This paper focuses on the impact of packet losses on the controller design for NCSs.

An arguably popular approach for modeling the packet loss phenomenon is to view the packet loss as a binary switching sequence according to a Bernoulli process which takes on values of zero and one with certain probability. Recently, some results have been obtained on such model [15–17]. For example, in [15], the Kalman filtering problem is presented in the setting of intermittent observations and how the expected estimation error covariance depends on the tradeoff between loss probability and the system dynamics is showed. In [16], the problem of robust finite-horizon filtering is investigated for a class of uncertain systems with missing measurements. Moreover, in [17], the feedback stabilization schemes for discrete-time control systems with packet dropping network link are studied, and the feedback strategy presented is considerably simpler to implement.

It is noticed that, based on the Bernoulli distributed model, almost all the stability conditions and controller designs given in the aforementioned references are derived in terms of the assumption that the packet dropout exists only in the sensor-to-controller (S/C) side. The effect of controller-to-actuator (C/A) packet dropouts is neglected due to the complicated NCS modeling. Lately, there have appeared some research results which simultaneously consider S/C and C/A packet losses. In [14], the robust H∞ control problem is considered for NCSs with both S/C and C/A random communication packet losses. By modeling the random packet loss as a linear function of the stochastic variable satisfying Bernoulli binary distribution, stability analysis and controller synthesis problems are investigated. In [18], the observer-based H∞ control problem is studied for discrete-time mixed delay systems with random packet dropouts and multiplicative noises. By modeling the packet-loss phenomenon as Bernoulli distributed white sequences, the packet losses from S/C and from C/A are simultaneously considered. Furthermore, in [19], the similar problem is investigated for a class of networked nonlinear systems with global Lipschitz nonlinearities and random communication packet losses. In the above works, the zero-input strategy is adopted, in which, without considering the disturbance, the actuator (controller) input is set to zero when the C/A (S/C) packet is lost. However, for systems whose state and input signals change little from one time step to the next, for example, process control systems, the strategy may not perform well. In these situations, the hold-input strategy, that the latest packet stored in the buffer is used when the C/A or S/C packet is lost, gives a better performance [20]. To the best of the authors’ knowledge, based on the hold-input strategy, the problem of observer-based feedback stabilization for NCSs with random S/C and C/A packet dropouts has not been investigated to date, which motivates the present study.

In this paper, the observer-based feedback stabilization problem for NCSs with both random S/C and C/A packet losses is considered. If the packet is lost, the hold-input strategy is adopted. Sufficient conditions for stochastic stability are given, and corresponding controller design steps are provided. An example is finally given to show the effectiveness of the control scheme proposed.

#### 2. Problem Formulation

Consider the following NCS with random data packet dropouts shown in Figure 1, where sensors, controllers, and actuators are clock-driven: where is the state vector, is the control input to the actuator, is the desired control input computed by the controller, and is the measurement vector with transmission missing. are known real constant matrices with appropriate dimensions. The stochastic variable models the S/C packet loss: if the measurement packet is lost, then . Otherwise . Similarly, the stochastic variable models the C/A packet loss: implies that the control packet is lost, and implies that the control packet is correctly delivered. are independent identically distributed (i.i.d.) Bernoulli random variables with The buffers store only one packet, and they will be updated if a new packet arrives. By such a mechanism, the buffers always store the most recent packet and are used for the purpose of packet dropout compensation. For buffer 1, if the measurement packet is correctly delivered, then , that is, , while if the packet is lost, , that is, . This observation model is summarized by (2). For buffer 2, if the packet is correctly delivered, then , that is, . Otherwise, the actuator will employ the previous control value, that is, , , as suggested in [21]. This compensation scheme is summarized by (3).

The dynamic observer-based control scheme for the system is described as follows: where is the state estimation and and are the observer and controller gains, respectively.

Let the estimation error be and by substituting (2), (3), and (5) to (1) and (6), we have Moreover, we can rewrite (2) and (3) as

By defining (7)-(8) can be rewritten in a compact form as follows: where Since and are stochastic variables, we need to introduce the following definition before proceeding further.

*Definition 1. * System (1) is said to be mean square stable if for any , there is a such that when . In addition, if for any initial conditions, the system (1) is said to be globally mean-square asymptotically stable (GMSAS).

#### 3. Main Results

In this section, we shall discuss the observer-based feedback controller design problem for (1). Without loss of generality, we make the following assumption.

*Assumption 2. *The matrix is of full-column rank; that is, .

For the matrix being of full-column rank, there always exist two orthogonal matrices and , such that where and , in which are nonzero singular values of .

Furthermore, in order to derive the main result, the following lemma will be needed.

Lemma 3 (see [22] ). * Let the matrix be of full-column rank. If matrix is of the following structure
**
where , , and are defined in (12); then there exists a nonsingular matrix such that .*

Theorem 4. * Consider the networked control problem in Figure 1. Given the dynamic observer-based control scheme (5), system (1) is GMSAS for any S/C and C/A random data packet dropouts if there exist matrices and satisfying
**
where
**
in which .*

*Proof. *To prove the theorem, we introduce the following functions:
where and are positive definite matrices to be determined. Then, we have
where

Noting that and , we obtain
in which

By the Schur complement, (14) guarantees . Thus, for all , it is easy to know that
That is, there exists satisfying
Using the smoothing property
in (22) after taking the conditional expectation, we can conclude
Continuing this process, we get
which implies that
Since are positive definite matrices, it is easy to conclude that
which implies , and the proof is completed.

Note that the condition (14) is not an LMI, hence, cannot be solved by MATLAB LMI Toolbox. In the following, we will deal with the controller design problem and derive the explicit expression of the controller parameters in terms of LMI.

Theorem 5. * Consider the networked control problem in Figure 1. The dynamic observer-based control scheme (5) exists such that system (1) is GMSAS for any and random data packet dropouts if there exist matrices , , , , , and , satisfying
**
where
**
in which , and , and come from (12). Moreover, the controller parameters are given by
*

*Proof. *Since there exist , and , such that , where , and come from (12). It follows from Lemma 3 that there exists a nonsingular matrix such that . Let , , and ., we can conclude that (28) is equivalent to (14).

#### 4. Numerical Example

In this section, an example is used to demonstrate that the controller designed in this paper is effective. We compare our strategy with zero-input strategy [14], which shows that, for systems whose state and input signals change little from one time step to the next, the hold-input strategy adopted in the paper has a better performance.

Consider the following discrete-time unstable system: It is assumed that .

By zero-input strategy in [14], the controller gain and the observer gain are and , respectively. Suppose that the initial conditions are , , and . We have Figures 2(a) and 2(b). Then, by Theorem 5 of our paper, we obtain and . With the same initial conditions, we have Figures 3(a) and 3(b). From Figures 2 and 3 we know that the system can be stabilized by both controllers; however, by comparison, it is easy to know that our controller gives a better performance.

*Remark 6. * From the system in this example, we can observe that the state, measurement, and input signals change slowly. Moreover, since the latest packet stored in the buffer is used when the C/A or S/C packet is lost, our controller provides a smoother sequence of inputs. These are the reason why hold-input strategy adopted in the paper gives a better performance.

#### 5. Conclusion

In this paper, the problem of observer-based feedback stabilization is considered for NCSs with random packet dropouts. The hold-input strategy is adopted, and sufficient conditions for stochastic stability are derived in the form of linear matrix. Furthermore, the dynamic observer-based control scheme is designed. An example shows that, for systems whose state and input change little from one time step to the next, the hold-input strategy adopted performs better than the zero-input strategy.

#### Acknowledgments

This work was supported in part by the National Natural Science Foundation of China under Grant 61202478 and the Fundamental Research Funds for the Central Universities under Grant 2012QNB18.

#### References

- J. Nilsson,
*Real-time control systems with delays [Ph.D. thesis]*, Lund Institute of Technology, Lund, Sweden, 1998. - W. Zhang, M. S. Branicky, and S. M. Phillips, “Stability of networked control systems,”
*IEEE Control Systems Magazine*, vol. 21, no. 1, pp. 84–99, 2001. View at Google Scholar · View at Scopus - D. Yue, Q. L. Han, and C. Peng, “State feedback controller design of networked control systems,”
*IEEE Transactions on Circuits and Systems II*, vol. 51, no. 11, pp. 640–644, 2004. View at Publisher · View at Google Scholar · View at Scopus - H. Wang, X. Liao, and T. Huang, “Accelerated consensus to accurate average in multi-agent networks via state prediction,”
*Nonlinear Dynamics*, 2013. View at Publisher · View at Google Scholar - H. Li, X. Liao, and T. Huang, “Second-order locally dynamic consensus of multiagent systems with arbitrarily fast switching directed topologies,”
*IEEE Transactions on Systems, Man, and Cybernetics: Systems*, no. 99, pp. 1–11, 2013. View at Publisher · View at Google Scholar - P. V. Zhivoglyadov and R. H. Middleton, “Networked control design for linear systems,”
*Automatica*, vol. 39, no. 4, pp. 743–750, 2003. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - D. Yue, Q.-L. Han, and J. Lam, “Network-based robust ${H}_{\infty}$ control of systems with uncertainty,”
*Automatica*, vol. 41, no. 6, pp. 999–1007, 2005. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - L. Zhang, Y. Shi, T. Chen, and B. Huang, “A new method for stabilization of networked control systems with random delays,”
*IEEE Transactions on Automatic Control*, vol. 50, no. 8, pp. 1177–1181, 2005. View at Publisher · View at Google Scholar · View at MathSciNet - H. Gao, T. Chen, and J. Lam, “A new delay system approach to network-based control,”
*Automatica*, vol. 44, no. 1, pp. 39–52, 2008. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - M. Liu, D. W. C. Ho, and Y. Niu, “Stabilization of Markovian jump linear system over networks with random communication delay,”
*Automatica*, vol. 45, no. 2, pp. 416–421, 2009. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - S. P. Wen, Z. Zeng, and T. Huang, “H∞ Filtering for neutral systems with mixed delays and multiplicative noises,”
*IEEE Transactions on Circuits and Systems Part II*, vol. 59, no. 11, pp. 820–824, 2012. View at Google Scholar - J. Xiong and J. Lam, “Stabilization of linear systems over networks with bounded packet loss,”
*Automatica*, vol. 43, no. 1, pp. 80–87, 2007. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - J. Wu and T. Chen, “Design of networked control systems with packet dropouts,”
*IEEE Transactions on Automatic Control*, vol. 52, no. 7, pp. 1314–1319, 2007. View at Publisher · View at Google Scholar · View at MathSciNet - Z. Wang, F. Yang, D. W. C. Ho, and X. Liu, “Robust ${H}_{\infty}$ control for networked systems with random packet losses,”
*IEEE Transactions on Systems, Man, and Cybernetics B*, vol. 37, no. 4, pp. 916–924, 2007. View at Publisher · View at Google Scholar · View at Scopus - B. Sinopoli, L. Schenato, M. Franceschetti, K. Poolla, M. I. Jordan, and S. S. Sastry, “Kalman filtering with intermittent observations,”
*IEEE Transactions on Automatic Control*, vol. 49, no. 9, pp. 1453–1464, 2004. View at Publisher · View at Google Scholar · View at MathSciNet - Z. Wang, F. Yang, D. W. C. Ho, and X. Liu, “Robust finite-horizon filtering for stochastic systems with missing measurements,”
*IEEE Signal Processing Letters*, vol. 12, no. 6, pp. 437–440, 2005. View at Publisher · View at Google Scholar · View at Scopus - H. Mo and C. N. Hadjicostis, “Feedback control over packet dropping network links,” in
*Proceedings of the Mediterranean Conference on Control and Automation (MED '07)*, Athens, Greece, July 2007. View at Publisher · View at Google Scholar · View at Scopus - S. P. Wen, Z. Zeng, and T. Huang, “Observer-based ${H}_{\infty}$ control of discrete time-delay systems with random communication packet losses and multiplicative noises,”
*Applied Mathematics and Computation*, vol. 219, no. 12, pp. 6484–6493, 2013. View at Publisher · View at Google Scholar · View at MathSciNet - J. G. Li, J. Q. Yuan, and J. G. Lu, “Observer-based ${H}_{\infty}$ control for networked nonlinear systems with random packet losses,”
*ISA Transactions*, vol. 49, no. 1, pp. 39–46, 2010. View at Publisher · View at Google Scholar · View at Scopus - L. Schenato, “To zero or to hold control inputs with lossy links?”
*IEEE Transactions on Automatic Control*, vol. 54, no. 5, pp. 1093–1099, 2009. View at Publisher · View at Google Scholar · View at MathSciNet - A. V. Savkin and I. R. Petersen, “Robust filtering with missing data and a deterministic description of noise and uncertainty,”
*International Journal of Systems Science*, vol. 28, no. 4, pp. 373–378, 1997. View at Google Scholar · View at Scopus - D. W. C. Ho and G. Lu, “Robust stabilization for a class of discrete-time non-linear systems via output feedback: the unified LMI approach,”
*International Journal of Control*, vol. 76, no. 2, pp. 105–115, 2003. View at Publisher · View at Google Scholar · View at MathSciNet