Mathematical Problems in Engineering

Volume 2015 (2015), Article ID 524584, 6 pages

http://dx.doi.org/10.1155/2015/524584

## Further Results on Stability Analysis of Discrete-Time Markov Jump Linear Systems with Time-Varying Delay and Partly Known Transition Probabilities

State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China

Received 8 August 2014; Revised 23 October 2014; Accepted 23 October 2014

Academic Editor: Quanxin Zhu

Copyright © 2015 Xingang Zhao et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

This paper is concerned with the stability analysis of discrete-time Markov jump linear systems (MJLSs) with time-varying delay and partly known transition probabilities. The time delay is varying between lower and upper bounds, and the partly known transition probabilities cover the cases of known, uncertain with known lower and upper bounds, and completely unknown, which is more general than the existing result. Via constructing an appropriate Lyapunov function and employing a new technique to separate Lyapunov variables from unknown transition probabilities, a novel stability criterion is obtained in the framework of linear matrix inequality. A numerical example is given to show the effectiveness of the proposed approach.

#### 1. Introduction

Markov jump linear systems (MJLSs), a class of stochastic systems, have been widely applied in manufacturing systems, power systems, aerospace systems, and networked control systems. This is due to its ability to model many practical systems with abrupt random changes in their structures and parameters. Regarding the details on the basic theory of MJLSs, for example, controllability, observability, stability, stabilisability, and optimal control, and so forth, please refer to [1–8] and the references therein.

Time delay, unavoidable in many practical systems, can degrade the closed loop system performance or even lead the resulting system to be unstable. In recent years, therefore, the time delay problem has been widely studied and a great number of research results concerning this point exist in the references for linear system; see, for example, [9–13] and so on. Regarding the study of MJLSs with time delay, mean square stochastic stability conditions are presented in [7] and exponential stability conditions are proposed in [8]. However, these results are delay independent. To make full use of the available information on the size of delays, delay-dependent results are more attractive. Employing a model transformation, delay-dependent stability conditions for MJLSs with constant delay are proposed in [14]. To derive less conservative results, this idea was further improved by [15, 16]. Instead of using model transformation or bounding for cross terms, zero equations are utilized by [17]. Considering the fact that time delay for practical system is time varying, based on the free weighting matrix technique, [18] proposes a less conservative stability criterion for MJLSs with time-varying delays. By introducing some improved integral equalities, a new stability condition for MJLSs with time-varying delay is proposed in [19]. Motivated by above results, [20] proposes improved stochastic stability conditions for MJLSs with interval time delay. Regarding the stability analysis of Markovian jump neural systems with mixed delay, sample data control, impulse control, and exponential stability are investigated in [21–27]. With resorting to new technique to deal with the time delay, based on a Lyapunov-Krasovskii functional and the stochastic analysis theory, some novel sufficient conditions are established in the framework of linear matrix inequalities [22–27]. It deserves to note that all above results are based on transition probabilities which are known. Practically, it is hard or costly to obtain the complete knowledge on the transition probabilities [28, 29]. A typical example can be found in networked control systems (NCSs). Due to the complexity of the network environment, the variation of delays could be vague and random, which leads to the fact that all or part of the elements in the expected transition probabilities matrix are probably hard or expensive to obtain [28–32]. To be consistent with the actual situation, transition probabilities in [28–32] are assumed to be known or unknown. With this assumption, stability analysis of MJLSs with time-varying delay is investigated in [32]. However, in these results, when transition probabilities are unknown with known lower and upper bounds, they are treated as completely unknown, which may cause conservativeness. Moreover, the technique to separate Lyapunov variables and unknown transition probabilities in [32] still leaves some room for further improvement.

Motivated by the above observations, this paper is devoted to the stability analysis of discrete-time MJLSs with time-varying delay and partly known transition probabilities. The boundary information of time-varying delay is made full use of and the partly known transition probabilities include the cases of known, uncertain with known lower and upper bounds, and completely unknown, which is more general than the existing result. Via constructing an appropriate Lyapunov-Krasovskii functional, combining the property of transition probabilities and free weighted matrix technique, a novel stability criterion is obtained in the framework of linear matrix inequality. A numerical example is utilized to show the effectiveness of the proposed approach.

The rest of the paper is organized as follows. Section 2 gives the problem description, in Section 3, a novel theorem about delay range dependent stability for systems with more general transition probabilities is derived by using Lyapunov function method, Section 4 illustrates the efficiency of the proposed method, and Section 5 concludes this paper.

*Notation. * denotes the dimensional Euclidean space and the notation means that is real symmetric and positive definite (semidefinite). represents the set of positive integers. In symmetric block matrices or complex matrix expressions, we use an asterisk to represent a term that is induced by symmetry and stands for a block-diagonal matrix. and represent, respectively, the identity matrix and zero matrix.

#### 2. System Description and Preliminaries

Consider the following class of discrete-time Markov jump linear systems: where is the state vector. The time delay is considered to be time-varying with known lower and upper bounds, namely, . () is a discrete-time homogeneous Markov chain, which takes values in a finite set with the following mode transition probabilities: where and .

Considering the fact that transition probabilities are hard to be measured exactly, they are assumed to be known, unknown with known lower and upper bounds, and completely unknown in this context [31]. To present the considered transition probabilities clearly, an example of partly known transition probability matrix is given in the following: where “” denotes that the corresponding element is completely unknown, and , represent unknown elements with known bounds, and represents the exactly known elements. Subsequently, all transition probabilities in the above matrix can be classified by the following two sets:

*Remark 1. *With the fact that known transition probabilities can be treated as equal lower and upper bounds, that is to say, , the first set, , includes not only unknown transition probabilities with known bounds but also completely known case.

Before proceeding further, let us introduce the following stability definition.

*Definition 2. *System (1) is said to be stochastically stable if for every initial condition , and , the following holds:

#### 3. Main Results

In this part, a new delay-dependent stochastic stability condition for MJLSs with partly known transition probabilities is presented in the following theorem.

Theorem 3. *Consider the MJLSs (1) with partly known transition probabilities (3), if there exist symmetric matrices , , , , , , , , , , such that
**
where*

*Proof. *Consider system (1) and construct a stochastic Lyapunov functional as
where

Defining , it follows that

Summing up (10), one has

Therefore, we have
where

On the other hand, the following formula holds:

Considering the fact that , it yields
Since transition probabilities are partly known, we have and . Therefore, it follows that

According to (6), we can get .

*Remark 4. *According to Theorem 3, when calculating the forward difference of , is divided as and .

*Remark 5. *Different from the existing result [32], to separate Lyapunov variables from unknown transition probabilities, the property of transition probabilities is made full use of, namely, . Thanks to this separation, the method proposed in Theorem 3 is less conservative than that of [32].

*4. Illustrative Example*

*To show the effectiveness of the proposed method, a numerical example is given below.*

*Example 1. *Consider the MJLSs (1) with four operation modes and the following system matrices:
Our purpose is to check the stability of (1) with different cases of transition probabilities.

*Case 1. *Transition probabilities are known
In this case, given and , system (1) is unstable even if all the transition probabilities are known. It implies that the underlying system will be unstable for any time-varying delay starting from .

*Case 2. *Transition probabilities are partly known
In this case, we assume that the range of the time-varying delay belongs to . By solving the conditions given in Theorem 1 of [32] and Theorem 3 in this paper, respectively, no feasible solution can be found for the former. Therefore, the method proposed in this paper is less conservative than the existing result.

*Case 3. *We consider the case that there are unknown elements in the transition probability matrix varying an interval
where .

By solving the conditions given in Theorem 3, Table 1 is obtained.

According to Table 1, it can be seen that the more transition probabilities knowledge we have, the larger the delay range can be obtained.