Abstract
In this paper, exponential stability and robust control problem are investigated for a class of discrete-time time-delay stochastic systems with infinite Markov jump and multiplicative noises. The jumping parameters are modeled as an infinite-state Markov chain. By using a novel Lyapunov-Krasovskii functional, a new sufficient condition in terms of matrix inequalities is derived to guarantee the mean square exponential stability of the equilibrium point. Then some sufficient conditions for the existence of feedback controller are presented to guarantee that the resulting closed-loop system has mean square exponential stability for the zero exogenous disturbance and satisfies a prescribed performance level. Numerical simulations are exploited to validate the applicability of developed theoretical results.
1. Introduction
During the past decades, Markov jump systems have been the subject of a great deal of research since they have been used extensively both in theory and in applications. Markov jump systems are hybrid dynamical systems composed of subsystems with the transitions determined by a Markov chain. A number of results that focused on Markov jump systems have been published ranging from filtering, stability, observability, and control to engineering application; see, for example, [1–15] and the references therein.
Note that most of the theoretical works related to Markov jump systems in the literatures concentrated on the case where the state space of the Markov chain is finite. However, it may be more appropriate to characterize abrupt changes in many real plants via an infinite-state Markov chain. As far as applications are concerned, infinite Markov jump systems are critical in some physics plants, such as solar thermal receiver, aircraft, and robotic manipulator systems. Theoretically, finite Markov jump systems are fundamentally different from those governed by infinite-state space. The work in [14] studied exponential almost sure stability of random jump systems. The work in [16] considered the definition and computation of an -type norm for stochastic systems with infinite Markov jump and periodic coefficients. LQ-optimal control problem has been dealt with for discrete-time infinite Markov jump systems in [17]. The work in [18] demonstrated the inequivalence between stochastic stability and mean square exponential stability in discrete-time case. With this motivation, infinite Markov jump systems have stirred widespread research interests.
Time-delay is one of the inherent features of many practical systems and also is the big source of instability and poor performances in systems [19]. Moreover, stochastic modeling has had extensive applications. Hence, dynamical time-delay stochastic systems deserve our consideration. Stability analysis and controller design of time-delay Markov jump systems have been investigated by many authors [15, 20, 21]. Unfortunately, the literature about these issues for infinite Markov jump case is less developed. And, to the best of our knowledge, only a few results have been presented so far [18, 22, 23], let alone the problem involving time-delay. Actually, [18, 23] investigated the exponential stability and infinite horizon control problem for discrete-time infinite Markov jump systems with multiplicative noises, respectively, but they neglected the effects of time-delay. Meanwhile, the authors in [22] considered time-delay, when discussing the stabilization problem for linear stochastic delay differential equations with infinite Markovian switching, but it was hard for the obtained stability results to deal with control problem. As mentioned above, stability and control for time-delay stochastic systems with infinite Markov jump and multiplicative noises have not received enough attention despite their importance in practical applications, which motivates us for the present research.
We aim to address the exponential stability and control problem for a class of discrete-time time-delay stochastic systems with infinite Markov jumps and multiplicative noises in this paper. The main contributions of this paper are as follows: First of all, we investigate exponential stability of the equilibrium point for the considered systems by employing a novel Lyapunov-Krasovskii functional. Further, a sufficient condition is established to ensure exponential stability with a given performance index of the closed-loop system. And we introduce the slack matrix to decouple the Lyapunov matrices, which makes the controller design feasible. Moreover, some numerical examples are provided to show the effectiveness of the proposed design approaches.
The remaining part of this paper is constructed as follows. In Section 2, we formulate the system model and recall some definitions and lemmas. In Section 3, we present our main results, where we derive some sufficient conditions for exponential stability with a given performance index. Two numerical examples and their simulations are given to illustrate the effectiveness of the obtained results in Section 4. Conclusions are made in Section 5.
For convenience, we fix some notations that will be used throughout this paper. The -dimensional real Euclidean space is denoted by . stands for the linear space of all by real matrices. Let be the Euclidean norm of or the operator norm of . By and we denote the set of all symmetric matrices and the identity (zero) matrix, respectively. denotes the transpose of a matrix (or vector) . We say that is positive (semipositive) definite if . represent the maximum (minimum) eigenvalue of . is called the Kronecker function. . . is -measurable, and .
2. Preliminaries
Consider the following discrete-time time-delay stochastic system with infinite Markov jump parameter and multiplicative noises:where represents the system state, is the control input, denotes the disturbance, and is the system output. is a sequence of independent random vectors defined on a given complete probability space , which satisfies and . is a vector-valued initial condition. is the bounded constant delay with . Markov chain takes values in a countably infinite set with transition probability matrix , where , and is nondegenerate, for all . Assume and are mutually independent, and , . Assume belongs to .
We introduce the Banach spaces and . The notations will be written as (resp., ) and (resp., ) if and only if and , , , respectively. When , means that , . Therefore, we have . For all coefficients of the considered systems, we suppose they have a finite norm .
Definition 1 (see [10, 18]). System (1) with and is called mean square exponential stability if there exist and such thatfor all , and Further, system (1) with is called exponential stabilizable if there exists a sequence such that the closed-loop systemwith has mean square exponential stability, where is called exponentially stabilizing feedback.
Definition 2. Closed-loop system (3) is said to have an noise disturbance attenuation level , if under zero initial value the following condition is satisfied:for any .
Lemma 3 (see [22]). We denote . LetAssume that for all for some . Then, if and only if , where and is called the Schur complement of in .
Remark 4. Lemma 3 is the infinite-dimensional version of Schur complements (see [24]).
3. Main Results
Firstly, stability will be analyzed, and a sufficient condition is obtained for system (1) with and to have mean square exponential stability.
Theorem 5. System (1) with and is exponentially mean square stable, if we can find matrices , such that the following matrix inequality holds:uniformly with respect to , where
Proof. Construct the following Lyapunov-Krasovskii functional:By the assumption that is independent of the Markov chain and , besides , we haveandandThus, combining (8) with (9)-(11), we getwherewith and is defined as
Applying Lemma 3 to (6) leads towhere . Further, we have . It is clear from that there exists a sufficiently small scalar such that . Therefore, it follows thatOn the other hand, by using (8), we deduce thatwhereNoting (15) and (16), for any constant , we obtain thatwhere . By taking summation from 0 to on both sides of (18), for , it implies thatRecalling (8) and (16), denoting and , we haveandrespectively. Furthermore, it suffices to show that there exists a constant such thatActually, letting , then we have and . Therefore, (22) has a unique solution . By substituting (20)-(22) into (19), we obtainwhere . This indicates that system (1) with and has mean square exponential stability. The proof is completed.
Remark 6. Due to the consideration of an infinite-state Markov chain, the infinite dimension Banach spaces have been introduced. Furthermore, it should be pointed out that a novel Lyapunov-Krasovskii functional (8) has been constructed to analyze the mean square exponential stability for system (1) with and .
Next, we prove that system (1) with verifies the performance disturbance attenuation .
Theorem 7. System (1) has mean square exponential stability for and with a prescribed performance for , if we can find matrices , such that the following matrix inequality holds:uniformly with respect to , where
Proof. It is well established that (24) implies (6). Applying Theorem 5 one obtains that system (1) has mean square exponential stability for and .
Let us now show that system (1) with satisfies a prescribed performance level. To this end, constructing the same Lyapunov-Krasovskii functional as in Theorem 5 and under the zero initial condition, the following index is introduced:whereand is defined as The last ‘≤’ in (26) holds as a result of the similar line with (12). Then, by using Lemma 3 in (24), we obtain that . Thus, . Taking the limit in (26), we haveThis ends the proof.
Combining Theorem 5 with Theorem 7, the following corollary can be easily derived for closed-loop system (3).
Corollary 8. Let the feedback control gain , , be given. Then closed-loop system (3) has mean square exponential stability for with a prescribed performance if there exist two matrices and , such thatuniformly with respect to , where
Below, based on Corollary 8, we are ready to present the controller design for system (1).
Theorem 9. For system (1), a state feedback controller can be designed such that closed-loop system (3) has mean square exponential stability for and a given performance can be ensured if there exist matrices , , , and such thatuniformly with respect to , whereMoreover, if matrix inequalities (31) are feasible, then an exponentially stabilizing feedback gain can be given by
Proof. Via Lemma 3, we conclude that (29) is equivalent to the following matrix inequality:Premultiply and postmultiply with (34), and letBy a tedious calculation, one can rewrite (34) aswhereAccording to Corollary 8 and the fact thatnamely,the desired result is derived.
Remark 10. The work in [20] presented a necessary and sufficient condition for the existence of the mixed control by four coupled matrix Riccati equations (CMREs). Note that CMREs are hardly solved in practice, and this motivates us to find a new sufficient condition in terms of matrix inequalities that can be easily solved to guarantee that the resulting closed-loop system has mean square exponential stability for the zero exogenous disturbance and satisfies a prescribed performance level.
Remark 11. With the introduction of a slack matrix , a sufficient condition is obtained in Theorem 9, in which the Lyapunov matrices are not involved in any product with system matrices. This makes the controller design feasible and can be easily carried out by solving corresponding matrix inequalities.
Remark 12. It is worth noting that the obtained results can be extended to discrete-time time-delay infinite Markov jump stochastic systems with time-varying delays. Assume that the time-varying delay satisfies ; then by similar procedures to the above and choosing the following Lyapunov-Krasovskii functionthe corresponding results can be derived.
4. Illustrative Example
In this section, some illustrative examples are presented to demonstrate the effectiveness of the developed method.
Example 1. Consider the following one-dimensional discrete-time time-delay stochastic system with infinite Markov jumps:where the transition probability is defined by , , , , . Now takeLet , , and time-delay . By direct computation, (6) holds. According to Theorem 5, we deduce that system (41) has mean square exponential stability, and Figure 1 presents the state response of system (41) with initial conditions for .
Example 2. Consider the following one-dimensional discrete-time time-delay stochastic system with infinite Markov jumps:where the transition probability is defined by , , , , . The coefficients of system (43) are reset to beThe purpose here is to design an controller such that the closed-loop system has mean square exponential stability and with a given norm bound . Applying Theorem 9, the controller can be designed asWith the initial conditions for and the exogenous disturbance , Figures 2 and 3 show the state and output responses, respectively.
5. Conclusions
In this paper, the issue of exponential stability and robust control for a class of discrete-time time-delay stochastic systems with infinite Markov jumps and multiplicative noises has been studied. Time-delay and infinite Markov jump are taken into consideration simultaneously. By using Lyapunov-Krasovskii functional and introducing slack matrix, an matrix inequality approach has been adopted to ensure the mean square exponential stability and satisfy a prescribed performance level. Finally, some illustrative examples are given to demonstrate the usefulness of the proposed design methods. Further research directions would include the investigation on control problem and asynchronous control problem for discrete-time time-delay stochastic systems with infinite Markov jumps.
Data Availability
The data used to support the findings of this study are included within the article.
Conflicts of Interest
The authors declare that they have no conflicts of interest.
Acknowledgments
This work is supported by National Natural Science Foundation of China under Grant 61673013, Natural Science Foundation of Shandong Province under Grant ZR2016JL022, and the SDUST Research Fund under Grant 2015TDJH105.