#### Abstract

In this work, the result of reachable set bounding and extended dissipative control synthesis of the Markovian jump time-delayed system is studied subject to stochastic actuator failures and partially known transition probabilities. Specifically, a novel actuator fault model is designed, in which the actuator fault matrix satisfies a certain probabilistic condition. Under the construction of an appropriate Lyapunov–Krasovskii functional (LKF), as well as reciprocal convex approach, Jensen’s integral inequality, and reachable set lemma, delay-dependent sufficient criteria are obtained in terms of linear matrix inequalities (LMIs) for finding an ellipsoid to bound the reachable sets of the Markovian jump time-delayed system with bounded disturbances. Finally, two numerical examples are provided to validate the effectiveness of the proposed strategy.

#### 1. Introduction

Markovian jump systems are a kind of stochastic switched systems, in which the switching between multiple modes is governed by a stochastic process described by a Markov chain. Furthermore, Markovian jump systems are appropriate model systems with random abrupt variations, which may be due to malfunction of machine in manufacturing systems, fluctuations in operating points, and environmental disturbances [1–5]. Therefore, a remarkable progress has been made in the study of Markovian jump systems and has proved its successful applications in chemical systems, economic systems, power systems, electrical circuit systems, and so on [6–9]. A new feedback controller is designed in [10] to ensure the finite-time mean square stability of the nonlinear Markovian jump systems, in which the nonlinear element satisfies the prescribed conic sector condition. Very recently, the problem of model reduction for nonhomogeneous Markovian jump systems is studied in [11], in which asynchronization is designed by a hidden Markov model with Markovian jump parameters. Xia et al. [12] reported the result of the dissipative sampled-data scheme for fuzzy Markovian jump systems. However, it is mentioned that the abovementioned studies are based on a particular ideal assumption that the information of each element in the transition probabilities matrix is available. In fact, it is hard to measure or determine the knowledge of all the elements, which motivates further study on Markovian jump systems with partly known transition probabilities that are more general [13–15].

It is known that reachable set estimation is used to find an appropriate domain, which can bound all the reachable states of a dynamical system with respect to input disturbances and zero initial conditions. During the past few years, reachable set estimation of dynamical systems has various practical applications in aircraft collision avoidance, peak-to-peak gain minimization, and control synthesis. Therefore, it is necessary to study the problem of reachable set estimation with time-delay dynamical systems, and a great number of results have been paid much attention in past few years [16–18]. For instance, the problem of reachable set estimation of singular systems is studied subjected to time delay and bounded peak inputs [19]. Based on the novel LKF approach, sufficient conditions are derived in terms of LMIs to ensure the reachable set of the linear systems bounded in [20]. Feng et.al. [21] reported the reachable set estimation of discrete-time fuzzy systems subjected to time delay and external disturbance.

In practical control systems, there often exist faults due to the reasons of actuators aging, zero shift, electromagnetic interference, and nonlinear amplification in different frequency field. During the system operation, faults may affect the sensors, the actuators, and the system components, which may lead to intolerable performance of the closed-loop dynamical system. Therefore, from a safety as well as performance point of view, it is required to design a fault-tolerant controller, which can tolerate actuator or sensor faults and guarantee the stability and performance of resulting closed-loop systems [22–25]. For example [26], a fuzzy-based fault-tolerant control approach is designed for nontriangular nonlinear systems with respect to immeasurable states and actuator failures. Sun et.al. [27] studied the composite reliable control problem for stochastic systems with disturbance observer. Based on the Lyapunov–Krasovskii functional together with partially known transition conditions, a new set of sufficient condition is derived in [28] for the nonlinear time-delay systems subjected to random fluctuations.

On the other side, the concept of extended dissipative was firstly considered in [29] where some well-known performance indices, namely, performance, passivity performance, mixed passivity performance, performance, and -dissipative performance can be obtained by adjusting weighting matrices of extended dissipative [29–31]. Very recently, the concept of extended dissipative has been effectively applied to several dynamical systems in reports [32–34]. Zhu et.al. [35] reported the problem of finite-time extended dissipative-based control of neutral switched systems with stochastic actuator failures. Under the extended dissipative analysis with an average dwell-time approach, an explicit expression of the desired Markov switching estimator is presented in [36]. To the best of authors’ knowledge, the extended dissipative concept together with reachable set estimation has not been applied to Markovian jump time-delayed systems subjected to probabilistic faults yet in the existing literatures, which motivates our present study. The main notable contributions of this paper can be highlighted as follows:(i)The concept of extended dissipative and reachable set estimation is successfully first time applied to Markovian jump time-delayed systems with partially known transition probabilities and bounded disturbances(ii)We have investigated the result of the extended dissipative analysis and stochastic fault-tolerant control design for a class of Markovian jump systems where the transition rate matrix satisfies the partially known probability conditions(iii)Under the appropriate LKF, Jensen’s integral inequality and the reciprocal convex approach, a new set of sufficient conditions is obtained in the form of LMIs to guarantee the Markovian jump time-delayed system bounded by an ellipsoid and satisfies the extended dissipative performance index(iv)Two numerical simulation demonstrate the feasibility and effectiveness of the proposed approach

The remaining part of this work is constructed as follows. The system description and problem formulation are provided in Section 2. The main results on extended dissipative-based stochastic fault-tolerant control for Markovian jump time-delayed systems with partially known transition probabilities and bounded disturbance are given in Section 3. Two examples are presented in Section 4 to demonstrate the effectiveness and feasibility of the obtained results. Finally, conclusions and the direction of future research are made in Section 5.

*Notations 1. *The superscripts “” and “” stand for matrix transposition and matrix inverse, respectively; and denote the dimensional Euclidean space and the set of all real matrices, respectively; the notation means that is real, symmetric, and positive definite (positive semi-definite); is the identity matrix of appropriate dimension; the notation stands for the expectation operator; and “” is used to represent a term that is induced by symmetry.

#### 2. Problem Formulation and Preliminaries

Consider the following Markovian jump systems with time-varying delay defined on a complete probability space and described as follows:where is the state vector; is the control input with respect to actuator fault; is the disturbance; represents system output; is the initial condition of the state; and is the Markov process and takes values in a finite set , and it satisfies the following transition probability conditions:where and ; is the transition rate from mode at time to mode at time if and ; the matrices , , , , , and are known matrices of compatible dimensions. The set comprises the various operation modes of system (1), and for each possible value of , the system matrices of the th mode are denoted by , , , , and . Further, the time-varying delay satisfieswhere and are the given constants. The disturbance term is assumed to be bounded:where is a positive scalar.

On the other side, the transition rate matrices for system (1) with operation modes are defined bywhere “” represents the unknown transition rate. For the simplicity of presentation, we introduce the following notations. For , let with

The reachable set of system (1) is denoted as follows:

For a positive-definite symmetric matrix , we define an ellipsoid bounding the reachable set (7) as follows:

We consider the following static feedback controller for system (1):in which represent the controller gain matrices to be determined. Then, the following stochastic fault model is adopted for this study:where with are the unrelated random variables. It is assumed that is with mathematical expectation and variance , respectively, and .

Also, we define and .

Combining (1) and (10), we obtain the following closed-loop systems:

Our main aim of this study is to derive an ellipsoid , as small as possible, that bounds the reachable set of system (1) subject to time-varying delays and bounded disturbances (4). Then, we will design a stochastic fault-tolerant controller (10), such that the reachable set of the closed-loop system (11) is bounded and extended dissipative by a given ellipsoid . Before proving our main results, the following lemmas, assumption, and definition are introduced.

Lemma 1 (see [35]). *For any symmetric positive definite matrix and a scalar , such that the following integrations are well-defined, then*

Lemma 2 (see [35]). *Given appropriate dimensioned matrices , , and with , , then the inequality holds if and only if .*

Lemma 3 (see [18]). *Let have positive values in an open subset of . Then, the reciprocally convex combination of over satisfiessubjected to*

Lemma 4 (see [18]). *Let be a Lyapunov function for system (11), , , , , and the constant is mentioned in (3). If , then .*

*Assumption 1. *(see [35]). For given real symmetric matrices , and , the following conditions hold:(1), , and (2), for all (3)(4), for all

*Definition 1. *(see [35]). For given matrices , and , the considered closed-loop system (8) is said to be the extended dissipative if there exists a scalar such that the upcoming inequality holds for all and :where .

#### 3. Main Results

In this section, the first reachable set estimation problem for Markovian jump time-delayed systems with partially known transition probabilities is considered based on Jensen’s integral equality, novel reachable set lemma, and improved reciprocally convex combination method. Next, under extended dissipative performance index, a novel stochastic fault-tolerant controller is proposed and a sufficient condition is given.

Theorem 1. *For any given scalars , , , , , and the matrix , if there exists appropriately dimensioned matrices , , , , , , and , symmetric matrices , , , and , and a scalar , the following LMIs hold for :where*

Then, the reachable set of system (11) can be bounded by the ellipsoid .

*Proof. *We consider the following Lyapunov–Krasovskii functional candidate for systems (11) aswhereDefine the weak infinitesimal operator for the Lyapunov functional together with Markovian jump system (11) asFurthermore, we haveConsidering the circumstance that the information of transition probabilities is not completely known, for any arbitrary matrices and , the following zero equations hold due to :Using Lemmas 1 and 3 to the integral terms in equations (30) and (31), we havewhere the matrices and satisfy .

Similarly, we havewhere the matrices and satisfy .

Combining (22) to (35), we havewhere . Furthermore, it is noted that and for all , which implies for all . Taking mathematical expectation, the above inequality can be rewritten asUsing Lemma 2 in (38), we obtain the inequalities (16)–(22). Based on the inequality in (27) and Lemma 4, for any initial point , if , then for any . Under the construction of the LKF in (17), we have , which means that the reachable set of the considered system (11) is bounded via the ellipsoid . Hence, this proof is finished.

Now, we are going to solve the delay-dependent extended dissipative-based control for Markovian jump time-delayed systems with stochastic actuator failures.

Theorem 2. *For any given scalars , , , , and and the constant matrices , and , if there exists appropriately dimensioned matrices , , , , , , and , symmetric matrices , , , and , and a scalar , the following LMIs hold for :where*

Then, the reachable set of the closed-loop system (1) is bounded by the prescribed ellipsoid in , and the desired state-feedback controller can be obtained as .

*Proof. *Next, we design a dissipative-based stochastic fault-tolerant controller , such that the reachable set of system (11) is bounded by a given ellipsoid . This theorem is followed from Theorem 1 and the same line as in previous theorem; then, we havewhere, , and the rest of are the same in Theorem 1. Defining and applying the congruence transformation , where to (49) and setting , , , , , and , we obtain the LMIs in Theorem 2. Then, under zero initial condition,Applying Dynkin’s formula, we haveTo prove extended dissipative, we consider two cases and , respectively. First, if , then (51) follows for any thatThis satisfies the definition . Furthermore, when as mentioned in Assumption 1, we have the matrices , and . For any , we have . Then, there exist a scalar s.t. . Then, by (51), we haveIt is mentioned that for any ,Thus, inequality (54) holds for all . This completes the proof.

*Remark 1. *It is noted that the condition in equations (39)–(46) are LMIs with respect to all the matrix variables. In order to obtain an ellipsoid with the shortest major principal axis for the reachable set of closed-loop system (11), we can maximise a positive scalar with respect to LMIs (39) andWe use the following approximation of the above inequality:

minimise subject to subject to the LMIs (39)–(46).

*Remark 2. *It is noted that most of the existing studies based on Markovian jump systems subject to fully known transition probabilities. However, in practice, it is not an easy way to scale all transition probabilities because its cost is very expensive. Therefore, the considered problems based on Markovian jump time-delayed systems with partially known probabilities is more convenient than existing works [13, 24, 29] during the jump process.

*Remark 3. *It is noted that our considered control model (10) is indeed effective in improving the performances of dynamical time-delay systems. Moreover, compared with the existing feedback reliable control approaches [25–27], our stochastic fault-tolerant controller under actuator saturation achieves better performance when information of the random variable is available. Furthermore, existing fault-tolerant control approaches are only designed under the assumption of actuator fault matrix which is partially failure or fully failure. Nevertheless, in practice, the actuators may not be fully failures under the cases, namely, electromagnetic inferences, nonlinear amplification, and cipher deviation. Based on the above facts, the actuator fault matrix need to satisfy a convinced random circulation in the probability time bound values between zero and one. Hence, it is necessary and important to take such nondeterministic fluctuating term in our proposed method.

Now, consider the following time-delay system:Next, we provide a corollary for finding an ellipsoid to bound the reachable set of the time-delay system (56).

Corollary 1. *For some scalars , , , and , if there exist appropriately dimensioned matrices , , , , , and , any matrices and such that the following LMIs hold:where , , , , , , , and , ; then, the reachable sets of system (56) can be bounded by the ellipsoid .*

*Proof. *Choose the Lyapunov functional candidate as follows:whereBy following the similar steps as in Theorem 1 with small changes, the proof is omitted here.

*Remark 4. *It is noted that the dissipative performance of this paper consists of some well-known control-based performances. For instance, by setting , inequality (15) becomes the performance. If we fix , inequality (15) reduces to the case. By choosing , and , inequality (15) becomes a passivity-based control. When we take , and , inequality (15) corresponds to mixed and passivity case. Furthermore, when we set , inequality (15) changes to the -dissipative performance.

#### 4. Numerical Simulation

In this section, numerical examples are provided to demonstrate the feasibility of the approaches proposed in this paper.

*Example 1. *Consider Markovian jump time-delayed system (11) with four modes and the following parameters:Output matrices are taken as follows:We assume that the partially known transition rate matrix is given byHere, we consider two cases:

*Case 1. *Let us take that the actuator is normal. Given , , , , and and variances , , . The state responses of the open-loop system are given in Figure 1, and it is seen that the open-loop system is unstable. By solving the LMI conditions in Theorem 2 with disturbance input and initial condition , we obtain a set of feasible solutions. The controller gain matrices are displaced as follows:Based on the controller gain matrices, the state trajectories and bounding reachable set of system (11) are shown in Figures 2 and 3, respectively. Moreover, Figure 2 represents the reachable set of system (11) bounded by the ellipsoid . Also, it is observed from Figure 3 that the state feedback controller stabilizes system (11) in the presence of partially known transition probabilities.

*Case 2. *Consider the stochastic actuators failures with , , and and and . Choose the values , , , , together with the transition probability matrix given in (47), and solving the LMIs in Theorem 2 with aid of the MATLAB LMI tool box, we can get feasible solutions, which are not given here. Moreover, the corresponding gain matrices are calculated as follows:The obtained ellipsoid and the state trajectory of system (11) with the proposed controller are shown in Figures 4 and 5. It is seen from Figure 4 that the reachable set of system (11) is contained in the ellipsoid . Also, it is observed from Figure 5 that when actuator failures occur, system (11) with the proposed reliable controller operates well and maintains the system stability. Next, the reachable set of system (11) is contained in when , which is shown in Figure 6. Figure 7 shows the mode transition rates of the closed-loop system (11). Furthermore, in Table 1, we estimate the values of for different values of . From the simulation analysis, it is easy to understand that the considered Markovian jump system (11) is bounded and extended dissipative even in the occurrence of partially known transition probabilities, time delay, stochastic faults, uncertain parameters, and external disturbances.