#### Abstract

This paper is concerned with the problem of designing a fault-tolerant controller for uncertain discrete-time networked control systems against actuator possible fault. The step difference between the running step and the time stamp of the used plant state is modeled as a finite state Markov chain of which the transition probabilities matrix information is limited. By introducing actuator fault indicator matrix, the closed-loop system model is obtained by means of state augmentation technique. The sufficient conditions on the stochastic stability of the closed-loop system are given and the fault-tolerant controller is designed by solving a linear matrix inequality. A numerical example is presented to illustrate the effectiveness of the proposed method.

#### 1. Introduction

Networked control systems (NCSs) are used in many fields such as remote surgery and unmanned aerial vehicles especially in a number of emerging engineering applications such as arrays of microactuators and even neurobiological and socialeconomical systems [1–3]. Compared with the traditional wiring, the communication channels can simplify the installation and reduce the costs of cables and maintenance of the system. However, the network in the control systems also brings many problems, such as network-induced delay and packet dropout, and makes system analysis more challenging [4, 5]. Network-induced delays can degrade the performance of control systems designed without considering them and even destabilize the system [6, 7].

Because of the complexity caused by network, NCSs are more vulnerable to faults. An effective way to increase the reliability of the NCSs is to introduce fault-tolerant control (FTC). Therefore, the research on fault-tolerant control of NCSs has great theoretical and applied significance; however research on FTC for NCSs is different from that for traditional control systems in many aspects [8, 9]. In [10], a fault estimator was proposed for NCSs with transfer delays, process noise, and model uncertainty. On the basis of the information on fault estimator, a fault-tolerant controller using sliding mode control theory was designed to recover the system performance. In [11], the random packet dropout and the sensor or actuator failure were described as binary random variables; the sufficient condition for asymptotical mean-square stability of the NCSs was derived. By using matrix measure technique, a fault-tolerant controller was designed for NCSs with network-induced delay and model uncertainty in [12]. In [13], a FTC algorithm considering actuator failure of an NCS was presented, and the NCS with data packet dropout was modeled as an asynchronous dynamical system. Based on information scheduling, FTC design methods were proposed for NCSs with communication constrains in [14]. In [15], the problem of fault-tolerant control for NCSs with data packet dropout is studied and the closed-loop system was modeled as Markov jump system. However, elements of transition probabilities matrix are assumed to be completely known and the controller can not be solved by LMIs. To the best of the authors’ knowledge, up to now, very limited efforts have been devoted to studying FTC for uncertain NCSs with uncertain transition probability matrices, which motivates our investigation.

Problems of partial sensors inactivation are equal to problems of data pack dropout which can be solved by common technique; we focus on the problems of reliability when actuators are inactivated in this paper.

In this paper, the step difference between the running step and the time stamp of the used plant state is modeled as a finite state Markov chain. And the information of the transition probabilities matrix is limited; that is, a part of elements of transition probabilities matrix is unknown. The closed-loop system model is obtained by means of state augmentation technique and the mode-dependent fault-tolerant controller is designed which guarantees the stochastic stability of the closed-loop system.

This paper is organized as follows. In Section 2, we formulate the state feedback controller design problem. In Section 3, the sufficient conditions to guarantee the stochastic stability are presented, and the fault-tolerant controller is also given. A simulation example is used to illustrate the effectiveness of the proposed method in Section 4. The conclusion remarks are addressed in Section 5.

#### 2. Problem Formulation

Consider the NCSs setup in Figure 1, in which the controllers are placed in a remote location, and both sensor measurement data and control data are transmitted through network.

By adding a buffer to the actuator, the delay from sensor to controller and the delay from controller to actuator can be lumped together, and the new variable is described as which is modeled as a Markov chain. And denotes the step difference between the running step and the time stamp of the used plant state, and it depends on the random time-delay and the data packet drops on the random communication delay and the data packet dropout [16]. Assume that both time-delay and the data packet dropout are bounded, so is bounded. The step delay takes values in and the transition probability matrix of is . That is, jumps from mode to with probability which is defined by , where , , . The set contains modes of , and the transition probabilities of the jumping process in this paper are considered to be partly accessed; that is, some elements in matrix are unknown. For example, for the time-delay with 3 modes, the transition probabilities matrix may be as follows:where “” represents the inaccessible elements. For notational clarity, , we denote with Moreover, if , it is further described as , , where represents the th known element with the index in the th row of the matrix . And is described as , where represents the th unknown element with the index th in the th row of the matrix .

Assume that the model of the plant is an uncertain discrete-time system as follows: where is state vector and is the control input. and are all real constant matrices. , where is an uncertain time-varying matrix satisfying the bound , where denotes the identity matrix with appropriate dimension.

Considering the effect of the random communication delay and the data packet dropout, we describe the state feedback control law asThe fault indicator matrix is given bywith for and means the actuator experiences a total failure, whereas the actuator is in healthy state when . Since there are actuators, the set of possible related failure modes is finite and is denoted by with elements, where is a particular pattern of matrix .

Consequently, the closed-loop system from (3) and (4) can be expressed asAt sampling time , if we augment the state-variable as , the closed-loop system (6) can be written aswherehas all elements being zeros except for the block being identity.

It can be seen that the closed-loop system (7) is a jump linear system with different modes.

It is noticed that and whereThroughout this paper, we use the following definition.

*Definition 1. *System (7) is stochastically stable if for every finite and initial mode there exists a finite such that the following holds:

The object of this paper is to construct a fault-tolerant controller with structure as given by (4) which achieves that the closed-loop system (7) is stochastically stable under all actuator failure modes. In the following, and for this paper are denoted as and , respectively.

To proceed, we will need the following two lemmas.

Lemma 2 (see [17]). *Given matrices , , and of appropriate dimensions and is symmetric, holds for all satisfying if and only if there exists a scalar such that .*

Lemma 3 (see [18]). *The matrix is of full-array rank; then there exist two orthogonal matrices and , such that , where , where are nonzero singular values of . If matrix has the following structure**there exists a nonsingular matrix such that , where , .*

#### 3. Controller Design

With Definition 1, the sufficient conditions on the stochastic stability of the closed-loop system (7) can be obtained.

Theorem 4. *The closed-loop system (7) with partly unknown transition probabilities (2) is stochastically stable if there exists matrix , such that**where .*

*Proof. *For the closed-loop system (7), consider the quadratic function which is given byThen,Hence, if (12) and (13) hold, . One haswhere ; hence one can get . According to Definition 1, system (7) is stochastically stable.

Clearly, no knowledge on , is needed in (12) and (13), which completes the proof.

Theorem 5. *Consider system (7) with partly unknown transition probabilities (2). If there exist matrices , and positive scalars , , , and such that**where**then there exists a mode-dependent controller of the form (4) such that the resulting system (7) is stochastically stable. Furthermore, an admissible controller is given by*

*Proof. *According to Theorem 4, we know that the system (7) is stochastically stable with the partly unknown transition probabilities (2) if inequalities (12) and (13) hold. By Schur complement, inequality (12) is equivalent towhere , .

By Lemma 2, there exists a scalar such that where Using Schur complement and Lemma 2 again, one can getSimilarly, from (13) one can obtainPerforming a congruence transformation to (23) and (24) by , setting , one can obtain (25) and (26), respectively. One hasFor the matrix of full-column rank, there always exist two orthogonal matrices and such that where , are nonzero singular values of . Assume that the matrix has the following structure: according to Lemma 3, there exists matrix such that , setting Since , one can get which implies that Thus, (19) is obtained from (29) and (31), which completes the proof.

#### 4. Numerical Example

In this section, a numerical example is given to show the validity and potential of our developed theoretical results. The dynamics are described as follows:Assume the time-delay takes values from and the transition probabilities matrix is . When the first actuator experiences a total failure, that is, the fault indicator matrix , the fault-tolerant and delay-dependent controller gain is solved from Theorem 5 as follows: When the second actuator experiences a total failure while the first actuator works normally, that is, the fault indicator matrix , the controller gain is solved as follows: When both actuators work normally, that is, the fault indicator matrix , the controller gain is solved asZero-input responses of states , are shown in Figures 2 and 3 when .

The curves of zero-input response states , show that the NCS with partly unknown transition probabilities is stochastically stable against actuator possible fault.

#### 5. Conclusions

This paper is concerned with the problem of fault-tolerant control for uncertain discrete-time networked systems against actuator possible fault. The time-delay is modeled as a finite state Markov chain and the Markov chain’s transition probabilities the information is limited. The closed-loop system is established through the state augmentation technique and the state feedback controller is designed which guarantees the stability of the resulting closed-loop systems. It is shown that the controller design problem under consideration is solvable if a set of LMIs is feasible. Simulation results show that the closed-loop systems are stochastically stable against actuator fault.

#### Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

#### Acknowledgments

This study is supported by the National Natural Science Foundation of China under Grant no. 61174029, the National Natural Science Foundation of China under Grant no. 61503136, the Zhejiang Provincial Natural Science Foundation of China under Grant no. LY12F03008, and the Huzhou Natural Science Foundation of China under Grant no. 2014YZ07.