#### Abstract

This technical paper deals with the problem of stochastic stability and stabilization for a class of linear Markovian jumping systems with discrete time-varying delay. A novel delay-dependent stochastic stability criterion for Markovian delay systems is established based on new augmented Lyapunov-Krasovskii functional and delay fractioning techniques. Then a state feedback controller is designed to guarantee the stochastic stability of the resulting closed-loop system. Numerical examples are provided to illustrate the effectiveness of the proposed design approach in this paper.

#### 1. Introduction

Markovian jump systems are a special class of hybrid systems with both modes and state variables. Since many dynamical systems such as the chemical processes, transportation systems, and manufacturing systems can be modeled as Markovian jump systems, considerable attention has been devoted to the problem of analysis and synthesis for Markovian jump systems over the past decades; see, for example, [1–4] and the references therein.

On the other hand, time delays are often encountered in various practical systems such as biological, electronics, and economical systems, which are frequently one of the main causes of poor performance, oscillation, or even instability [5–10]. Thus the analysis and synthesis of Markovian jump systems with time delay are of theoretical and practical importance and have received considerable research interest in the past few decades (e.g., [1–4, 10–13]).

In the literature, different design approaches have been proposed to deal with the delays. Generally, to get stability criteria, a Lyapunov function (or functional) is involved. For more details, one can see [10–14] and references therein. In those results, the information of delay is included in some criteria, which is so-called delay dependent, while others are irrelevant to the delay [15–17], which is called delay independent. It is well known that the former ones are generally much less conservative than the latter ones due to using the information of delay such as its length or rules of changes [18–20]. Therefore, how to choose a Lyapunov function (or functional) and derive a less conservative condition from the time derivative of such a function (or functional) is one of the most important techniques in the analysis and synthesis process.

Since cross products between two vectors are commonly encountered, different bound techniques are introduced. For example, Park’s inequality and Moon’s inequality were frequently used for bounding some cross terms. Moreover, many researchers tried to construct special forms of Lyapunov functional to obtain a feasible result. Some delay-dependent conditions were obtained through model transformation approaches; more details can be found in [18–22] and references therein. But these choices of specific functional and overbounding techniques are the origin of conservatism [20–23].

Slack matrices technique has been proven to be an effective approach to establish an improved result. To mention a few, by introducing two auxiliary matrices a new LMI representation of H∞ performance is presented for the linear systems with a single time-varying state delay in [19]. Wu et al. [20] and He et al. [21] tried to seek the relationship between the terms in the Newton-Leibniz formula and to introduce some free weighting matrices to express this relationship and some delay-dependent stability conditions with less conservativeness have been established. These methods are quite different from the conventional one of using model transformation which may introduce some superfluous dynamics into the original system. Additional studies can be found in [22–26] and references cited therein.

To improve the delay-dependent conditions, some efforts on constructing new Lyapunov functional were made by employing the delay partitioning method [21, 23–26]. To mention a few, a delay partitioning method has been developed for the delay-dependent stability analysis of fuzzy time-varying state delay systems based on a novel fuzzy Lyapunov-Krasovskii functional in [23]. In [24], by choosing an augmented Lyapunov-Krasovskii functional and utilizing the delay-partitioning method, novel delay-dependent mean square asymptotic stability conditions are derived in terms of LMIs. With the idea of delay partitioning, in [25] a new delay-dependent stochastic stability criterion on the stochastic stability of Markovian jump systems with time-delay has been proposed, which is less conservative than most existing results. However, when revisiting those problems, we find that there is still much room left for improvement, which motivates the present study.

In this context, we are interested in investigating the delay-dependent stability analysis and stabilization problem for a class of Markovian jump systems with time-varying delay. By employing the delay partitioning method and introducing some slack matrix variables based on the Newton-Leibniz formula, a less conservative delay-dependent stability condition is proposed. Then a state feedback controller, which guarantees the stochastic stability of the corresponding closed-loop system, is designed.

The rest of the paper is organized as follows. Section 2 gives problem formulation and some necessary lemmas. In Section 3, we present our main results of stability analysis and stabilization problem. Numerical examples are given in Section 4, followed by the conclusions, which are presented in Section 5.

*Notations*. The notations used throughout the paper are standard except where otherwise stated. The superscript “” stands for matrix transposition. “” and “0” denote the identity matrix and a zero matrix with compatible dimensions, respectively. The notation “” means that is real symmetric and positive definite (positive semidefinite); stands for a block-diagonal matrix with matrices on the diagonal. “” represents the elements below the main diagonal of a symmetric matrix. denotes the Euclidean norm of a vector or the spectral norm of a matrix. Matrices, if their dimensions are not explicitly stated, are assumed to be compatible for algebraic operations.

#### 2. Problem Formulations and Preliminaries

Consider the following stochastic linear state-delay systems with Markovian jumping parameters: where is the system state vector, is the controlled input vector, and , and are matrix functions of the random jumping process . is a continuous-time Markovian jump process with right continuous trajectories taking discrete values in a given finite set with transition probability matrix given by where and , for , is the transition rate from mode at time to mode at time and for each mode , . is the system’s initial function which is continuous differentiable on and are the initial conditions of the continuous state and mode. is a continuously differentiable function, which denotes the time-varying delay when the mode is in , satisfying the conditions as follows: where and are known positive real constants.

*Remark 1. *It should be pointed out that, when a time-varying delay is considered, it is usually assumed that , while we only require in this paper, which is more general, as discussed by Xu et al. [22].

For notational simplicity, in the sequel, for each possible , , a matrix will be denoted as ; for example, and are denoted as and , respectively, and so on.

To facilitate further developments, we introduce the following lemma and definition that will be frequently used in deriving the main results.

Lemma 2 (Schur complement). *Given constant matrices , , and with appropriate dimensions, where and , then if and only if
*

*Definition 3. *The Markovian jump system
is said to be stochastically stable, if for any finite defined on and the following condition is satisfied:

#### 3. Main Results

In this section, we will consider the stability and stabilization problem of the system (1). First of all, we introduce the following results which will be used in deriving the main results.

By the Leibniz-Newton formula, we have and then for any appropriate dimensional matrices , , , , , , we have that the following equation holds:

Moreover, since , , for any appropriate dimensional matrix , where

##### 3.1. Stability Analysis

Combining delay partitioning approach and free-weighting matrices technique, a new delay-dependent stochastic stability condition is established in the theorem as follows.

Theorem 4. *For given positive scalars and , the autonomous Markovian jump system (1) with is stochastically stable if there exist matrices , , , , , , ,
**
and free-weighting matrices with appropriate dimensions, such that the following LMIs hold:
**
where
*

*Proof. *We define the following Lyapunov-Krasovskii functional candidate:
with
where , , , , , , and are matrices to be determined.

Let be the weak infinitesimal generator of the random process . Then, for each , , we have

According to (8)–(11) and considering , in (4), we have
where
and is denoted in (14).

By Schur complement (Lemma 2) and some matrices primary manipulations, it is easy to see that the abovementioned matrix in (22) is equivalent to (13).

Since , , , we have .

It is easy to see that if LMIs (13)–(15) hold.

Set ; then . For any , we have

By Dynkin’s formula, we have

Hence

Set ; then . From (17), it is easy to see that for any

From inequalities (26) and (27), we know that
where , .

By Gronwell-Bellman lemma, we have

Thus, according to (28), we have

As , we have

For there always exists a scalar , such that

From Definition 3, we know that the Markovian jump system in (1) with is stochastically stable.

The proof is thus completed.

*Remark 5. *Benefiting from a novel LKF construction, Theorem 4 presents a delay-dependent stochastic stability criterion which is much less conservative than most existing results in the literature. The idea of delay portioning used here is different from those approaches in the literature. For example, assuming the time delay can be denoted as a constant part and time-varying part, the idea of delay partitioning is employed to the constant part and some LKF are constructed in [21, 23–26]. As a further improved result, an appropriate LKF is established with the idea of partitioning the lower bound of time delay in [26]. However, in this brief, we divided the whole time varying delay interval into multi-parts, with which a novel LKF is constructed.

If the system mode set , the jump linear system (1) is simplified into a general linear system. Then we have the following simplified result.

Corollary 6. *For given positive scalars and , the autonomous Markovian jump system (1) with is stochastically stable if there exist matrices , , , ,
**
and free-weighting matrices , with appropriate dimensions, such that the following LMIs hold:
**
where
*

##### 3.2. Stabilization Controller Design

Now we are in a position to present a solution to the stabilization problem for system (1). We assume that the state feedback controller is in the general formula as follows: where and are the gain matrices of the state feedback controller to be designed.

Then, for each , the resulting close-loop system of (1) with (36) becomes where , . Thus, representing by , by in Theorem 4, and by some matrices primary manipulations, we can obtain the following delay-dependent theorem.

Theorem 7. *For given positive scalars and , the autonomous Markovian jump system (1) is stochastically stable if there exist matrices , , , , , , ,
** and free-weighting matrices with appropriate dimensions, such that the following LMIs hold:
**
where
*

In this case, if the conditions abovementioned are feasible, the matrices in (36) are given by and . That is, the state feedback control law (36) can be designed as

*Proof. *By performing a congruence transformation to both sides of (12), and defining matrices , , we can obtain (38).

Similarly, by performing a congruence transformation to (14) by and defining matrices , , , we have (40).

By performing a congruence transformation to (13) with diag and defining matrices , , , , , we have

According to the definition of and , the following equation always holds:
which implies that

This completes the proof.

*Remark 8. *The stabilization controller design problem is solved in Theorem 7, which guarantees the addressed Markovian jump system to be stochastically stable. Sometimes, we would like to design a memory-less state feedback control law ; in this case, just set in Theorem 7.

*Remark 9. *It is worth pointing out that our main results are based on the LMI conditions, which can be easily obtained using LMI Control Toolbox.

#### 4. Numerical Examples

In this section, some examples are presented to demonstrate the effectiveness of our proposed theoretical results.

*Example 1. *Consider a Markovian jump system in (1) with two modes and the following parameters [27]:

The generator matrix of the stochastic process is

To compare our stability result in Theorem 4 with those in [27–30], we assume . When and , the result of [28] cannot be applied to stability. When and , based on the result of [29], the system is found to be delay-independent stable. If we increase , for example, and , the result of [29] cannot guarantee system stability. By the results in [27, 30], we can obtain a feasible solution with and , respectively. By Theorem 4 of this paper, we can obtain a feasible solution with , which is much larger than that of [27, 30]. We can see that our criterion gives a less conservative result than those in [27–30].

*Example 2. *Consider the Markovian jump system (1) as Example 1. For and and various , the results obtained by the proposed method in Theorem 4 for the admissible upper bound value of for which the system (1) remains stochastic stable are shown in Table 1.

*Example 3. *Consider the Markovian jump system (1) as Example 1. Suppose , , , and ; according to Theorem 7, one can obtain a state feedback controller designed as

The simulation results are illustrated in Figures 1–3 with the initial condition . Among them, Figure 1 shows the Markovian jumping signal. The control input signal is given in Figure 2, while Figure 3 plots the state responses of system (1) under the presented control law . From the simulation, it is shown that the designed control scheme is feasible and effective since the resulting closed-loop system is stable.

#### 5. Conclusion

In this paper, new delay-dependent conditions for stochastic stability and stabilization of a class of Markovian jump systems with time delay are presented. By the idea of delay fractioning approach and introducing some zero equations, a sufficient condition is given to guarantee the stochastic stability of the Markovian jump systems, which is less conservative than most existing results. Furthermore, based on the new criterion, an approach has been shown to design a state feedback controller, which guarantees the resulting closed-loop system to be stochastically stable. Finally, numerical examples have been provided to demonstrate the effectiveness of the proposed methods in this paper.

#### Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

#### Acknowledgments

This work is supported by the National Natural Science Foundation of China (nos. 61304108, 61273094, and 51307035) and the Project for Distinguished Young Scholars of the Basic Research Plan in Shenzhen City under Contract no. JCJ201110001. The authors are very thankful to the reviewers for their valuable suggestions and comments.