#### Abstract

The problem of state feedback control for a class of nonlinear networked control systems with time delay is discussed in this paper. The time delay is modeled as a finite state Markov chain of which transition probabilities are partly unknown. The closed-loop system model is obtained by means of state augmentation. A sufficient condition is given which guarantees the stochastic stability of the closed-loop system in the form of linear matrix inequalities and the maximum bound of the nonlinearity is also obtained. Finally, a simulation example is used to show the validity of the proposed method.

#### 1. Introduction

Networked control systems (NCSs) are feedback control systems with control loops closed via digital communication channels [1]. As is well known, NCSs are widely used in many fields such as remote surgery, mobile sensor networks, and unmanned aerial vehicles especially in a number of emerging engineering applications such as arrays of microactuators and even social-economical systems [2–4]. Compared with the point-to-point wiring, the use of communication channels can reduce the costs of cables and simplify the installation and maintenance of the system. However, the insertion of the network will make system analysis and synthesis more challenging [5–8]. Network-induced delays can degrade the performance of control systems designed without considering them and even destabilize the system [9–11].

Up to now, the effect of time delay on the stability and performance of NCSs has received great attention [12, 13]. The time delay may be constant, time-varying, and, in most cases, random [14–16]. For the random cases, the time delays are commonly modeled as white sequences taking on values of zero and one with certain probability [17, 18] or as finite state Markov chains [19–21]. In the real networks, the current time delays are usually related with the previous delays, so the Markov chain model is proper compared to the white sequence model to describe the time delay.

In [22, 23], the random delays are modeled as Markov chains such that the closed-loop system is a jump linear system. In [24–26], the random time delays are modeled as Markov chains, and output feedback controller design methods for NCSs with random network-induced delays are proposed. In [27], the mixed / control issue of NCSs with random time delays has been investigated based on Markov jump linear systems method. In the above literature [22–27], all parts of the elements in the transition probabilities matrix of the time delays are assumed to be completely known. However, in almost all kinds of networks, all parts of the elements in the desired transition probabilities matrix are hard or costly to obtain. In [28–30], the stability issue of discrete-time networked control systems with random Markov delays and uncertain transition probabilities is studied. And the controlled plants in [22–30] are assumed to be linear. However, almost all the practical controlled plants are nonlinear; it is significant and necessary to further study nonlinear NCSs with partly unknown transition probabilities. To the best of the authors’ knowledge, up to now, very limited efforts have been devoted to studying the system with uncertain transition probability matrices for nonlinear NCSs, which motivates our investigation.

This paper studies the state feedback problem of a class of nonlinear NCSs. The time delay is modeled as a finite state Markov chain of which transition probabilities are partly unknown. The closed-loop system model is obtained by means of state augmentation and the mode-dependent state feedback controller is designed which guarantees the stochastic stability of the closed-loop system. The state feedback controller is designed which guarantees the stability of the resulting closed-loop systems. The maximum bound of nonlinear disturbance is also obtained.

*Notations*. The superscript stands for the transpose of a matrix. and denote the -dimensional Euclidean space and the set of all real matrices, respectively. denotes the block diagonal matrix. and 0 stand for unit matrix and zero matrix with appropriate dimensions, respectively. denotes the entry of matrices implied by symmetry.

#### 2. Problem Formulation

Consider the NCS setup in Figure 1, in which the controlled plant is a nonlinear time-invariant discrete-time system and is the bounded and random time delay from the senor to the controller which takes value in and the transition probability matrix of is .

That is, jump from mode to with probability which is defined by , where , , . Likewise, the transition probability matrix is defined byThe set contains modes of , and the transition probabilities of the jumping process in this paper are considered to be partly accessed; that is, some elements in matrix are unknown. For example, for the time delay with 4 modes, the transition probabilities matrix may be as follows:where “?” represents the inaccessible elements. For notational clarity, , we denote by Moreover, if , it is further described as , , where represents the known element with the index in the row of the matrix . And is described as , where represents the unknown element with the index in the row of the matrix .

Assume that the model of the plant is a nonlinear discrete-time system as follows: where is state vector, is the control input, and are all real constant matrices, and is nonlinear disturbance, satisfying the following Lipschitz condition [31]:where is a real constant matrix and is the bound of the nonlinear disturbance.

It is noticed that when the controller is designed, the exact is known. Hence, the controller gain can be designed depending on ; that is, Consequently, the closed-loop system from (4) and (6) can be expressed asAt sampling time , if we augment the state variable as the closed-loop system (7) can be written aswherehas all elements being zeros except for the block being identity. It can be seen that the closed-loop system (9) is a jump linear system with different modes.

To proceed, we will need the following lemmas.

Lemma 1 (see [2]). *Let , be symmetric matrices. The conditions on , such that hold if there exists a scalar such that .*

Lemma 2 (see [32]). *For given scalars and matrices , always holds.*

Lemma 3 (see [18]). *The matrix is of full-array rank; then, there exist two orthogonal matrices and , such that , where , where are nonzero singular values of . If matrix has the following structure,**there exists a nonsingular matrix such that , where and .*

Throughout this paper, we use the following definition.

*Definition 4 (see [20]). *The system (9) is stochastically stable if, for every finite and initial mode , there exists a finite matrix such that the following holds:Our objective for this paper is to find the controller gain such that the closed-loop system (7) is stochastically stable. In the following, if we know that , and for this paper are denoted by and , respectively.

#### 3. Controller Design

Theorem 5 5. *Consider system (9) with partly unknown transition probabilities (3). If there exist matrices , and a scalar such that**where**hold for all ; there exists a mode-dependent controller of the form (6) such that the resulting system (9) is stochastically stable. Furthermore, if the LMI (13) has a solution, an admissible controller is given by*

*Proof. *For the closed-loop system (9), consider the quadratic function which is given by . We have whereIf , it can be proved that the closed-loop system (9) is stochastically stable which is similar to that of [18] and is omitted here.

From (5), one can getAccording to Lemma 1, if there exists a scalar such that the inequality (16) subject to (18) holds. Assume that ; inequality (19) can be written as where According to Lemma 2, one can get whereBy Schur complement, one can obtainwherePerforming a congruence transformation to (24) by and letting = , = , = , we can getwhereFor the matrix of full-array rank, there always exist two orthogonal matrices and such that , where and are nonzero singular values of . Assume that the matrix has the following structure:according to Lemma 3, there exists matrix such that ; setting , we can obtain (13) from (26). Since , we can get that is, , which implies that , which completes the proof.

*Remark 6. *When all the elements in the transition probabilities matrix of the time delays are known, then , which is a special case.

*Remark 7. *We introduce some structure restrictions on the matrix variables which enable us to present the existence conditions of the controller in terms of LMIs. Nevertheless, such restriction will introduce some extents of conservatism into the controller design.

The maximum bound of nonlinear disturbance can be found by solving the following optimization problem:

#### 4. Numerical Examples

In this section, one numerical example will be given to show the validity and potential of our developed theoretical results. Consider the nonlinear time-invariant discrete-time plant with the following data:

Assume that the time delay from the sensor to the controller takes values from . Consider the following transition probabilities matrix:

Our purpose is to design a mode-dependent controller of the form (6) such that the closed-loop system (9) is stochastically stable with the partly unknown transition probabilities. Let in (5) be unit matrix; by solving (13) in Theorem 5, the controller gain under the transition probabilities matrix is solved as follows:

The maximum bound of nonlinear disturbance under the transition probabilities matrix is 0.1876.

Figure 2 shows one simulation run of the Markov jump delays under the transition probabilities matrix . Figure 3 shows the state response of the closed-loop system using the obtained controller under the transition probabilities matrix when .

It can be seen that the closed-loop system with the partly unknown transition probabilities under the designed controller is stochastically stable.

#### 5. Conclusions

In this paper, the state feedback stabilization problem has been considered for a kind of nonlinear networked control systems with random communication delays. A Markov chain is employed to describe the random communication time delay of which transition probabilities are partly unknown. The closed-loop system is established through the state augmentation technique and the state feedback controller is designed which guarantees the stability of the resulting closed-loop systems. It is shown that the controller design problem under consideration is solvable if a set of LMIs is feasible. Simulation results show the validity of the proposed method.

#### Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

#### Acknowledgments

This work was supported by the National Natural Science Foundation of China under Grant no. 61174029, the National Natural Science Foundation of China under Grant no.61503136, and the Natural Science Foundation of Huzhou under Grant no. 2014YZ07.