#### Abstract

The problems of reachable set estimation and state-feedback controller design are investigated for singular Markovian jump systems with bounded input disturbances. Based on the Lyapunov approach, several new sufficient conditions on state reachable set and output reachable set are derived to ensure the existence of ellipsoids that bound the system states and output, respectively. Moreover, a state-feedback controller is also designed based on the estimated reachable set. The derived sufficient conditions are expressed in terms of linear matrix inequalities. The effectiveness of the proposed results is illustrated by numerical examples.

#### 1. Introduction

The research on singular systems has attracted significant attention in the past years due to the fact that singular systems can better describe a larger class of physical systems such as robotic systems, electric circuits, and mechanical systems. When singular systems experience abrupt changes in their structures, it is natural to model them as singular Markovian jump systems [1, 2]. The analysis and synthesis of such class of systems have gained considerable attention because of their importance in applications (see, e.g., the literature [3–10] and the references therein).

Reachable set is one of the important techniques for parameter estimation or state estimation problems [11]. Reachable set for a dynamic system is the set containing all the system states starting from the origin under bounded input disturbances. However, the exact shape of reachable sets of a dynamic system is very complex and hard to obtain; for this reason a number of researchers began to turn their attention to the reachable set estimation problem. The common strategies for reachable set estimation are ellipsoidal method [12] and polyhedron method [13]. The main idea of these methods is to detect simple convex shapes like ellipsoid or polyhedron, which contains all the system states. Compared with polyhedron method, the primary advantage of ellipsoidal method is that the ellipsoid structure is simple and directly related to quadratic Lyapunov functions. As a result, linear matrix inequalities (LMIs) techniques can be used to determine bounding ellipsoids. In the framework of bounding ellipsoid, the reachable set estimation problem for linear time delay systems has received significant research attention in recent years. In [14] sufficient conditions for the existence of bounding ellipsoids containing the reachable set of continuous-time linear systems with time-varying delays were derived by using the Lyapunov-Razumikhin function. In [15], by using Lyapunov-Krasovskii functional method, the author derived some less conservative conditions than those in [14]. In [16] the reachable set of delayed systems with polytopic uncertainties was investigated by using the maximal Lyapunov-Krasovskii functional approach, and some new conditions bounding the set of reachable states are derived. Interesting results on reachable set of delayed systems with polytopic uncertainties can also be found in [17–20]. In addition, some other strategies without using Lyapunov-Krasovskii functional have been provided to estimate the reachable set of continuous-time linear time-varying systems [21] and nonlinear time delay systems [22, 23]. The authors in [24] extended the ideas of reachable set estimation of continuous-time systems to discrete-time systems, wherein a fundamental result (Lemma 2.1 [24]) for the reachable set estimation of discrete-time systems was proposed. The authors in [25] improved the fundamental result obtained in [24] and provided a basic tool (Lemma 4 [25]) for the reachable set estimation of discrete-time systems. On the basis of the general ideas proposed in [25], the reachable set estimation problem was also extended to some classes of complicated systems, such as singular systems [26], Markovian jump systems [27], switched linear systems [28], and T-S fuzzy systems [29, 30]. For the reachable set estimation of discrete-time systems, the other important contributions can be found in [31, 32]. On the other hand, the problem of controller design for specifications involved with the reachable set of a control system is also a very important issue [33]. The controller design problems concerning reachable set were studied in [34] and [35] by using ellipsoidal method and polyhedron method, respectively. Two issues were raised in [34]: the first one is to design a controller such that the reachable set of the closed-loop system is contained in an ellipsoid, and the admissible ellipsoid should be as small as possible; the second one is to design a controller such that the reachable set of the closed-loop system is contained in a given ellipsoid. By constructing suitable Lyapunov-Krasovskii functional, LMI-based sufficient conditions for the existence of controller guaranteeing the ellipsoid bounds as small as possible have been derived for continuous-time delay systems [34] and discrete-time periodic systems [36]. It is obvious that the LMI-based controller design is quite simple and numerically tractable. However, it should be pointed out that the reachable set estimation and synthesis problems of singular Markovian jump systems are much more difficult and challenging than that for nonsingular Markovian jump systems since the ellipsoid containing the reachable set is not directly related to quadratic Lyapunov functions. To the best of the authors’ knowledge, no related results have been established for reachable set estimation and synthesis of singular Markovian jump systems, which has motivated this paper.

In this paper, we consider the problems of reachable set estimation and synthesis of singular Markovian jump systems. By using the Lyapunov approach, the estimation conditions on state reachable set and output reachable set are derived, respectively. Moreover, the desired state-feedback controller is designed based on the estimated reachable set.

*Notation*. Throughout this paper, denotes the -dimensional Euclidean space; represents the transpose of ; stands for ; (<0) means is a symmetric positive (negative) definite matrix; refers to the expectation; denotes the matrix composed of elements of first rows and columns of matrix ; refers to the Euclidean vector norm; the symbol “” in LMIs denotes the symmetric term of the matrix; is the unit matrix with appropriate dimensions.

#### 2. Problem Formulation

Consider the following singular Markovian jump system:where is the state vector, is the control input, is the measured output, and is the exogenous disturbance which satisfies, , , , and are real constant matrices with appropriate dimensions and . is a continuous-time Markovian process with transition rate matrix and the evolution of Markovian process is governed by the following transition rate:where and ; for is the transition rate from mode to mode and .

For notational simplicity, in the sequel, for each possible , , matrices , , , and will be denoted by , , , and , respectively. When , the system is referred to as a free system.

In this paper we are interested in determining ellipsoids that contain, respectively, the state reachable set and output reachable set. In the reachable set analysis, it is required that systems should be asymptotically stable. When this requirement is not met, we will further design a state-feedback controller such that the reachable set of the closed-loop system is contained in the smallest ellipsoid.

The state reachable set of the free system in (1) is defined by An ellipsoid bounding the reachable set can be always represented as follows: Particularly, when for , the ellipsoid will become a ball which is denoted by .

Since , there exist two nonsingular matrices and such thatLet . Then the free system can be rewritten as the following differential-algebraic form:

The following definition and lemma are also useful in deriving the main results.

*Definition 1 (see [2]). *(I) The free system is said to be regular if is not identically zero for each .

(II) The free system is said to be impulse-free if for each .

Lemma 2 (see [2]). *For any matrices and with , one has .*

Lemma 3 (see [12]). *Let be a Lyapunov function and . If then , .*

#### 3. Main Results

##### 3.1. State Reachable Set Estimation

In this subsection, we will focus our attention on determining a ball which contains the state reachable set of the free system.

Theorem 4. *If there exist nonsingular matrices and a scalar such that the following LMIs hold for each ,then the state reachable set of free system starting from the origin is mean-square bounded within the following set:where *

*Proof. *We first prove the regularity and nonimpulsiveness of the free system. Let . Then, by (10), we obtain that . From (11), it is easy to show thatPre- and postmultiplying (14) by and , respectively, we getwhere will be irrelevant to the results of the following discussion; thus the real expressions of these two variables are omitted. It follows from (15) thatwhich implies that is nonsingular for each . Therefore, by Definition 1, we have that the free system is regular and nonimpulsive.

Next, we will show the state reachable set of free system is mean-square bounded within the set . Consider the following Lyapunov function:Let be the weak infinitesimal generator of the random process . Calculating the difference of along the trajectories of the free system, we getDefining the augmented system variable as and using conditions (10) and (11), we haveThen we can deduce from Lemma 3 that , which infers thatRecalling that , it follows from (20) thatFrom (21) we have , which implies that .

Since is nonsingular for each , (8) can be rewritten asThen we can deduce thatIt follows from the fact thatwhere .

By (24), it can be seen thatwhich implies that the trajectories of (7)-(8) are mean-square bounded within the set . Moreover, notice that , and (25) can be rewritten as . By denoting , the state reachable set of free system is mean-square bounded within the set .

It should be noted that inequality (10) represents a nonstrict LMI. This may lead to numerical problems since equality constraints are usually not satisfied perfectly. Below, we will develop a numerically tractable and nonconservative LMI condition.

Theorem 5. *If there exist symmetric positive definite matrices , nonsingular matrices , and a scalar such that the following LMI holds for each ,then the state reachable set of free system is mean-square bounded within the following set:where is any matrix with full row rank and satisfies ; is any matrix with full column rank and satisfies .*

*Proof. *Let in (26); it is easy to obtain (10) and (11). In this case, inequality (20) will be replaced by , which infers that with . Then, following the same lines as (22)–(25) in Theorem 4, we can get for any . Therefore, the state reachable set of free system is mean-square bounded within the set .

*Remark 6. *In order to make the ellipsoid as small as possible, we require . For this purpose, we can add the additional requirement and then maximize a positive scalar , which is equivalent to the following minimization problem:where .

##### 3.2. Output Reachable Set Estimation

Theorem 7. *If there exist symmetric positive definite matrices and , nonsingular matrices , and a scalar such that the following LMIs hold for each ,then the output reachable set of free system is mean-square bounded within the following set:where , , , and are defined in Theorem 5.*

*Proof. *By Theorem 5, LMI (30) ensuresWith this and (31), we obtain thatDue to the fact that , (34) can be rewritten as . Thus, the output reachable set of free system is mean-square bounded within the set .

*Remark 8. *The output reachable set is also expected to be as small as possible. To achieve this goal, we first solve LMI (30) and get satisfying , which can be implemented by using (29). Then we add the additional requirement and maximize a positive scalar , which is equivalent to the following minimization problem:where .

##### 3.3. State-Feedback Controller Design

In this section, we turn our attention to the state-feedback control problem. Our goal here is to find a state-feedback controller, which not only stabilizes the closed-loop system, but also makes the ellipsoid bound on the reachable set of closed-loop system as small as possible.

Now, consider the state-feedback controller , where is a gain matrix to be determined later. By using this controller, the closed-loop system can be obtained aswhere .

Theorem 9. *Consider singular Markov jump system (1). If there exist nonsingular matrices , matrices , and scalars , such that the following LMIs hold for each ,then the reachable set of system (1) is mean-square bounded within the set , and the desired controller gain matrix is given by , where *

*Proof. *Denote and for each . Then, pre- and postmultiplying (39) by and its transpose, respectively, we obtainwhere , .

Using Lemma 2, we haveFrom (41) and (42), it is easy to obtain thatwhere , .

By Schur complement, the previous matrix inequality becomeswhere .

Since , (38) infers that . Pre- and postmultiplying the previous matrix inequality by and , respectively, we have . This together with (44) implieswhere .

Pre- and postmultiplying (37) by and , respectively, we obtainFrom the above discussion, we show that if (37)–(39) hold, then (45) and (46) hold. Thus, it follows from Theorem 4 that the closed-loop system can be stabilized by the designed state-feedback controller.

Next, we show that the reachable set of the closed-loop system (36) is mean-square bounded within the set . From (45) and (46), it is easy to show that there exists a Lyapunov function such that , where denotes the difference of along the trajectories of (36). It follows from Lemma 3 that , which impliesNoting that , then (47) can be rewritten asRecalling that is a lower triangular matrix, (48) infers thatwhere .

By (49), it can be seen thatUsing the fact that , we getThis together with (24) yieldsFrom (24), (51), and (52), we have thatwhere . This implies that . Recalling that , we haveBy denoting , the reachable set of closed-loop system (36) is mean-square bounded within the set .

*Remark 10. *In order to make the ellipsoid as small as possible, we shall carry out the following minimization problem:

#### 4. Numerical Examples

In this section, two numerical simulation examples are given to show the effectiveness of the main results derived above.

*Example 11. *Consider the free system in (1) with the following parameters: The switching between two modes is described by the following transition rate matrix:

In this example, we choose , . By solving optimization problem (29) with the aid of fminsearch, the minimal and the corresponding are and , respectively. Using the above parameter values, we can obtain and by solving (26). Owing to Theorem 5, the state reachable set is mean-square bounded within the set .

By applying Theorem 7, we have the following results:Therefore, the output reachable set of free system is mean-square bounded within the set .

For simulation we assume that and the disturbance is chosen as . A case for stochastic variation with transition rate matrix is shown in Figure 1. The state reachable set and the ball are depicted in Figure 2. Figure 2 shows that the trajectory of the system is mean-square bounded within the region . The output reachable set , the ball , and the ellipsoid are depicted in Figure 3. Figure 3 shows that the output reachable set is mean-square bounded within the region .

*Example 12. *Consider system (1) with the following parameters: The switching between two modes is described by the following transition rate matrix: By Theorem 9, we get the following results: Therefore, the gain matrices of state-feedback controller can be obtained as The corresponding parameter values and are, respectively, and , which imply and . Applying this controller makes the state reachable set of closed-loop system (36) mean-square bounded within the region .

For the purpose of the simulation, we assume the initial condition and the disturbance is chosen as . Figure 4 shows one possible switching between two modes. Figure 5 depicts the state reachable set of closed-loop system (36).

#### 5. Conclusions

This paper has dealt with the problems of reachable set estimation and state-feedback controller design for singular Markovian jump systems. New sufficient conditions for the state reachable set estimation and output reachable set estimation have been, respectively, derived in terms of linear matrix inequalities. Based on the estimated reachable set, the state-feedback controller has also been designed. Numerical examples and simulation results have been provided to demonstrate the effectiveness of the proposed methods.

#### Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this paper.

#### Acknowledgments

This work was supported by Applied Basic Research Project of Science and Technology Department of Sichuan Province (no. 2017JY0336), a project supported by Scientific Research Fund of Sichuan Provincial Education Department (no. 16ZA0146), the National Natural Science Foundation of China (no. 11501474), the Longshan Academic Talents Research Support Program of the Southwest University of Science and Technology (no. 17LZX537 and no. 17LZXY11), and the Doctoral Research Foundation of Southwest University of Science and Technology (no. 13zx7141).