Mathematical Problems in Engineering

Volume 2013 (2013), Article ID 364726, 9 pages

http://dx.doi.org/10.1155/2013/364726

## Sliding Sector-Based Variable Structure Control of Continuous-Time Markov Jump Linear Systems Subject to Unknown Transition Rates

^{1}The School of Mathematics & Statistics, Nanjing University of Information Science & Technology, Nanjing, Jiangsu 210044, China^{2}The School of Automation, Southeast University, Nanjing, Jiangsu 210096, China

Received 8 August 2013; Accepted 5 October 2013

Academic Editor: Tao Li

Copyright © 2013 Yan-Mei Xue et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

Based on sliding sector technique, the variable structure control for a class of uncertain continuous-time Markovian jump linear systems (MJLS) is investigated. The elements in the transition rate matrix include completely known, boundary known, and completely unknown ones. First, the related notions about sliding sector for continuous-time Markov jump linear systems are given; then based on linear matrix inequalities (LMIs) technique, sufficient conditions for the design of the sliding sector are provided. Second, a variable structure control law is presented to guarantee the mean-square quadratic stability of the closed-loop system in spite of the effects of the existing uncertainties and unknown/uncertain transition rates. Finally, an example is given to verify the validity of the theoretical results.

#### 1. Introduction

The subject of this paper is variable structure control of continuous-time Markov jump linear uncertain systems. Control design problems of Markov jump systems are motivated by the fact that these systems represent a class of important stochastic systems which is popular in modeling practical engineering systems subject to failures or changes in structures and parameters. Such as in [1, 2], Markovian switching technique has been used to model the switching action of mobile manipulators. In addition, some important theoretical results have also been published so far; see, for example, [3–9] and the references therein. It is worth noticing that these results require that the transition probabilities/rates must be known precisely. In fact, the likelihood of obtaining the perfect information on all transition probabilities/rates is questionable, and the cost might be expensive in some areas. As a result, the study of control synthesis for Markov jump systems with uncertain or unknown transition probabilities/rates becomes interesting, and some important results have been established. For instance, the robust control designs for MJLS subject to the norm-bounded or polytopic uncertainties in the transition rates were considered in [10, 11]. However, they both require to know the structure and “nominal” terms of the uncertain transition rates. Furthermore, control designs of MJLS with partly unknown transition rates were developed in [12–14], in which the transition rate matrix included two kinds of elements: completely known and completely unknown ones. In fact, besides the two kinds of elements, it might also own boundary known elements in practice, and we will consider this more general case for reducing the conservatism of control design in this paper.

On the other hand, variable structure control is a well-known robust control technique against external disturbances, parameter uncertainties, and unmodeled dynamics [15–17], and thus there are also some remarkable results published on variable structure control of continuous-time MJLS recently [18–22]. In [21], the robust stabilization of variable structure control for continuous-time MJLS with matched uncertainties was first investigated, and then in [22], a singular system approach was introduced for systems with parameter uncertainties and unknown nonlinear function. It is worth mentioning that these works require the transition rates to be precisely known *a prior*, and to the best of our knowledge, no results have been reported to variable structure control of continuous-time MJLS with unknown transition rates. In addition, one of the disadvantages about variable structure control is that chattering phenomenon might occur on the neighbor of the sliding manifold which is harmful to actuator devices, and thus it is a barrier for the use of the variable structure control strategy [23–25]. In order to avoid the occurrence of chattering phenomenon, it is worth noting that for a class of linear deterministic systems, a variable structure control-based sliding sector is first introduced in [26]. The main feature of the sliding sector-based variable structure control scheme is that zero control input can be used in the sliding sector of the state space and then the chattering phenomenon is avoided.

Motivated by the aforementioned discussion, for a class of continuous-time uncertain MJLS subject to unknown transition rates, a novel robust variable structure control-based sliding sector technique is investigated. The main contribution of this paper is summarized as follows. First, related notions of the sliding sector for MJLS, -sliding sector, simplified -sliding sector, and inner sector and outer sector are given. Second, sufficient conditions for the design of the simplified -sliding sector for the considered Markov jump linear uncertain system are presented in terms of LMI technique. Finally, a variable structure control law is established to drive the state trajectory to converge to the inner sector of the -sliding sector and guarantee mean square quadratic stability of the closed-loop system in spite of the effect of unknown transition rates and system uncertainties.

The rest of this paper is organized as follows. The problem statement and preliminaries are presented in Section 2. The main results are given in Section 3. In Section 4, a numerical example is presented to illustrate the effectiveness of the results, and the conclusions are drawn in Section 5.

Throughout this paper, the following notations are used. denotes the -dimensional Euclidean space; stands for the transpose of matrix ; and 0 represent the identity matrix and zero matrix in appropriate dimension, respectively. In addition, the symbol is used to represent . ( ) means that is real symmetric and (semi-) positive definite. denotes the absolute value of a scalar, the standard Euclidean norm of a vector, or the induced norm of a matrix, respectively. In symmetric block matrices, the notation is used to represent a term that is induced by symmetry.

#### 2. Problem Statement and Preliminaries

Consider the following time-invariant continuous-time linear uncertain system: where and are state and control input, respectively. and are the system uncertainties. is a continuous-time Markovian process with right continuous trajectories and taking values in a finite set . It governs the switching among the different system modes with the following mode transition probabilities: where , and denote the switching rate from mode at time to mode at time , and for each .

In general, the Markov process transition rate matrix is defined by

In this paper, the transition rates of the jumping process are assumed to be partly available; that is, some elements in have been exactly known; some ones are uncertain but with known boundaries; others may have no information to use. For instance, for system (1) with four operation modes, the transition rate matrix might be described by where represents the completely unknown element in the transition rate matrix; parameters and represent the elements with known lower and upper bounds. That is, and , where , and are known parameters; denotes the precisely known element.

For clarity, denote , by Furthermore, let ; then . Let . , where denotes the th element in with the index in the th row of the matrix . denotes the th element in with the index in the th row of the matrix . and represent the number of elements in and , respectively.

*Remark 1. *When , the transition rates are reduced to the situation in [12]. Obviously, the solving method there can only treat the above known bound case as the completely unknown case, and some conservativeness has been brought in.

For convenience, let , , , and for each possible value , , where and are known constant matrices with appropriate dimensions; then system (1) can be described by

Throughout this paper, for each , suppose that the following assumptions are valid.

*Assumption 2. *The pair is controllable.

*Assumption 3. *The uncertainties satisfy , , where and are known constant matrices with appropriate dimensions, is time-varying uncertain matrix satisfying , the parameter satisfies , is a known positive scalar.

For continuous-time Markov jump linear nominal systems some related notions of sliding sector are firstly presented.

*Definition 4. *The -sliding sector is a subset of defined as
where is a positive definite symmetric matrix, is a positive semidefinite symmetric matrix, , , , and is an observable pair.

The set of the -sliding sector is nonempty since at least zero state stays inside it.

Obviously, while the state of the plant evolves in the -sliding sector , the -norm of the plant (7) decreases with zero control input since where .

*Remark 5. *When , , , the -sliding sector in (8) becomes
The definition of -sliding sector for linear deterministic systems is introduced in [26].

*Definition 6. *A simplified -sliding sector is a subset of defined as
where the linear function and the square root of the quadratic function are determined by

*Remark 7. *Suppose that the following inequalities are satisfied:
Then the parameters in the simplified -sliding sector , , , and can be selected as follows:
where .

Obviously, while the state of the plant evolves in the simplified -sliding sector , the -norm of the plant (7) decreases with zero control input since

In addition, in order to avoid the chattering phenomenon on the boundary of the -sliding sector, an inner sector and an outer sector are introduced as subsets of the -sliding sector (11): where the positive scalar satisfies . It is not difficult to see that the sets and constitute a partition of the simplified -sliding sector . That is, and .

A hysteresis dead-zone function is further introduced for avoiding the chattering. It is defined as

Lemma 8 (see [20]). *For any given and matrices , if there exists , then the following inequality holds:
*

Lemma 9 (see [27]). *Given a symmetric matrix and matrices , with appropriate dimensions, then for all satisfying , if and only if there exists a scalar such that the following inequality holds:
*

Lemma 10 (see [28]). *For symmetric and positive definite matrices and , if , then .*

#### 3. Main Results

First, we present the design of the simplified -sliding sector for the considered continuous-time Markov jump linear uncertain system (6). Second, the controller design for mean-square quadratic stability of the continuous-time Markov jump linear uncertain system is developed.

##### 3.1. The Design of the Simplified -Sliding Sector

Theorem 11. *For continuous-time Markov jump linear uncertain system (6), there exist symmetric and positive definite matrices , , and satisfying the following LMIs:
**
where
**
then the parameters of -sliding sector in (14) can be designed as , , , , and .*

*Proof. *For system (6), for all , , the conditions in (13) are equal to
In the following, we consider two cases: and in the proof.

*Case I (). *In this case, the conditions in (24) can be guaranteed when for , the following inequalities:
are satisfied. Substituting into the first inequality above and utilizing the boundary information of , one can see that the above inequalities can be guaranteed by
Pre- and postmultiplying on both sides of the first inequality in above inequalities and letting , one has
Let , , and applying Schur-complement technique and Lemma 9, one can obtain the first LMI condition in (21).

In addition, by using Lemma 10, one can see that the second inequality in (26) can be converted into the second LMI condition in (21).

*Case II (). *In this case, substituting into (24), one has

The conditions in (28) can be guaranteed provided that for , one has
Taking use of the boundary information of , one can see that the above inequalities can be guaranteed by
Pre- and postmultiplying on both sides of the first inequality in above inequalities and letting and , one has
Applying Schur-complement technique and Lemma 9 again, the above inequality (31) can be converted into the first LMI condition in (22).

Applying Lemma 10, one can see that the second inequality in (30) can be converted into the second condition in (22). By the design of the parameters of PR-sliding sector in (14), the proof of Theorem 11 is completed.

##### 3.2. Variable Structure Control Design

Theorem 12. *Considering the simplified -sliding sector (11) with the inner sector (16) and the outer sector (17), the following variable structure controller is designed to ensure that the state trajectories of the plant (6) enter into the inner sector from the outside of -sliding sector and obtain mean-square quadratic stability of the closed-loop system. Consider
*

*where*

*and the parameter satisfies the following inequality:*

*Proof. *It is assumed that the initial state of the plant lies outside the -sliding sector. In this case, we have and . It can be easily checked that
Noting that and , we have
In view of , it is easy to check that
Substituting into the above inequality and noting that , one can see that
Taking use of in (34) where , one can see that
According to the design of again, one can easily observe that
It follows from (40) and (41) that
Thus the state trajectory of the closed-loop system will be driven into the inner sector of the -sliding sector.

In the following, we will prove that the -norm keeps decreasing. Consider
Noting that and , one can see that

In the following, we first prove that
Substituting (33) and (34) into the left side of above inequality, one has
Noting that and , we have
Since , it is easy to check that
It follows from (47) and (48) that (45) is established. Thus we have
Substituting (33) into the above inequality (49) and noting that , and , one can see that
After being forced into the inner sector of the -sliding sector and before moving out of the -sliding sector, the control input is set equal to zero with . In this case, and

Once the state trajectory of the plant runs out of the -sliding sector with zero control input, the control input (32)–(34) will make it move back to the inside of the inner sector again, while the -norm keeps decreasing.

Thus, from the above proof, one can see that it guarantees that the state trajectory of the plant moves from the outside of the -sliding sector into the inside of the inner sector and the Lyapunov function keeps decreasing in the whole state space; then mean-square quadratic stability of the closed-loop system is established.

#### 4. Illustrative Example

Consider the Markov jump linear system with four operation modes:

For simulation, we take , , , , , , , and .

The transition rates matrix is where and . Since there exist the completely unknown transition rates “” and boundary known transition rates and , the reported methods in [21, 22] cannot work. Solving the LMIs conditions (21)-(22) in Theorem 11, one can obtain that positive definite matrices are as follows: Selecting , , , , , , , , , , , , then the condition in Theorem 12 is satisfied. For the purpose of simulation, let , , , and . Using these data, a simulation program has been done in Matlab. The simulation results are presented in Figures 1–3. It can be seen from Figure 1 that the system state can converge to the equilibrium point in less than 5 seconds. Figure 2 shows the response curve of the control input. One can easily see that no chattering phenomenon happens in the whole control process. The transition modes of system are given in Figure 3. It can be seen that the considered continuous-time Markov jump linear uncertain system is stochastic quadratic stable in spite of mismatched uncertainty and the transition rate matrix which covers completely known, boundary unknown, and completely unknown elements.

#### 5. Conclusions

In this paper, the problem of designing sliding sector-based variable structure controllers is considered for Markov jump linear uncertain continuous-time time-invariant systems with unknown transition rates. First, the related notions about sliding sector for continuous-time MJLSs are presented and sufficient conditions for the design of the sliding sector are given by LMIs. Second, the variable structure control law is presented to ensure the mean-square quadratic stability of the closed-loop system, and simulation results finally have verified the effectiveness of the proposed method. In our future research, how to design dynamic output feedback variable structure controller based on sliding sector technique and considering the applying of the sliding sector technique in industrial robotic systems are interesting work. Finally, the authors would like to thank the associate editor and all the reviewers for their constructive comments and suggestions for improving this paper.

#### Acknowledgments

This work was supported in part by the Funds of National Science of China (nos. 11301276,61104123), the Natural Science Funds of Jiangsu Province (BK20130984,BK20131000), the Scientific Research Foundation of Nanjing University of Information Science & Technology (S8112075001,S8112081001), and Laboratory Open Fund of Nanjing University of Information Science & Technology (N1081005112).

#### References

- L. Dai, D. Huang, and Z. Li, “Sliding mode control of hybrid joints for wheeled mobile manipulators with Markovian switching and bounded torques,”
*Intelligent Robotics and Applications*, vol. 6424, no. 1, pp. 171–182, 2010. View at Publisher · View at Google Scholar · View at Scopus - L. Ding, H. Gao, K. Xia, Z. Liu, J. Tao, and Y. Liu, “Adaptive sliding mode control of mobile manipulators with markovian switching joints,”
*Journal of Applied Mathematics*, vol. 2012, Article ID 414315, 24 pages, 2012. View at Publisher · View at Google Scholar - E. K. Boukas,
*Stochastic Switching Systems: Analysis and Design*, Birkhauser, Berlin, Germany, 2005. - E. K. Boukas and H. Yang, “Stability of discrete-time linear systems with Markovian jumping parameters,”
*Mathematics of Control, Signals, and Systems*, vol. 8, no. 4, pp. 390–402, 1995. View at Publisher · View at Google Scholar · View at Scopus - J. X. Dong and G.-H. Yang, “Robust ${H}_{2}$ control of continuous-time Markov jump linear systems,”
*Automatica*, vol. 44, no. 5, pp. 1431–1436, 2008. View at Publisher · View at Google Scholar · View at Scopus - M. G. Todorov and M. D. Fragoso, “On the stability radii of continuous-time infinite Markov jump linear systems,”
*Mathematics of Control, Signals, and Systems*, vol. 22, no. 1, pp. 23–38, 2010. View at Publisher · View at Google Scholar · View at Scopus - O. L. V. Costa and E. K. Boukas, “Necessary and sufficient condition for robust stability and stabilizability of continuous-time linear systems with Markovian jumps,”
*Journal of Optimization Theory and Applications*, vol. 99, no. 2, pp. 359–379, 1998. View at Google Scholar · View at Scopus - Z. Wang, J. Lam, and X. Liu, “Exponential filtering for uncertain Markovian jump time-delay systems with nonlinear disturbances,”
*IEEE Transactions on Circuits and Systems II*, vol. 51, no. 5, pp. 262–268, 2004. View at Publisher · View at Google Scholar · View at Scopus - S. Xu, T. Chen, and J. Lam, “Robust ${H}_{\infty}$ filtering for uncertain Markovian jump systems with mode-dependent time delays,”
*IEEE Transactions on Automatic Control*, vol. 48, no. 5, pp. 900–907, 2003. View at Publisher · View at Google Scholar · View at Scopus - M. Karan, P. Shi, and C. Y. Kaya, “Transition probability bounds for the stochastic stability robustness of continuous- and discrete-time Markovian jump linear systems,”
*Automatica*, vol. 42, no. 12, pp. 2159–2168, 2006. View at Publisher · View at Google Scholar · View at Scopus - J. L. Xiong, J. Lam, H. J. Gao, and W. C. Daniel, “On robust stabilization of Markovian jump systems with uncertain switching probabilities,”
*Automatica*, vol. 41, no. 5, pp. 897–903, 2005. View at Publisher · View at Google Scholar · View at Scopus - L. Zhang, E.-K. Boukas, and J. Lam, “Analysis and synthesis of Markov jump linear systems with time-varying delays and partially known transition probabilities,”
*IEEE Transactions on Automatic Control*, vol. 53, no. 10, pp. 2458–2464, 2008. View at Publisher · View at Google Scholar · View at Scopus - L. Zhang and E.-K. Boukas, “Stability and stabilization of Markovian jump linear systems with partly unknown transition probabilities,”
*Automatica*, vol. 45, no. 2, pp. 463–468, 2009. View at Publisher · View at Google Scholar · View at Scopus - L. Zhang and J. Lam, “Necessary and sufficient conditions for analysis and synthesis of markov jump linear systems with incomplete transition descriptions,”
*IEEE Transactions on Automatic Control*, vol. 55, no. 7, pp. 1695–1701, 2010. View at Publisher · View at Google Scholar · View at Scopus - P. Y. Richard, H. Cormerais, and J. Buisson, “A generic design methodology for sliding mode control of switched systems,”
*Nonlinear Analysis: Theory, Methods and Applications*, vol. 65, no. 9, pp. 1751–1772, 2006. View at Publisher · View at Google Scholar · View at Scopus - G. S. Tombul, S. P. Banks, and N. Akturk, “Sliding mode control for a class of non-affine nonlinear systems,”
*Nonlinear Analysis: Theory, Methods and Applications*, vol. 71, pp. 1589–1597, 2009. View at Google Scholar - M. Roopaei and M. Z. Jahromi, “Chattering-free fuzzy sliding mode control in MIMO uncertain systems,”
*Nonlinear Analysis: Theory, Methods and Applications*, vol. 71, no. 10, pp. 4430–4437, 2009. View at Publisher · View at Google Scholar · View at Scopus - Y. Niu, D. W. C. Ho, and J. Lam, “Robust integral sliding mode control for uncertain stochastic systems with time-varying delay,”
*Automatica*, vol. 41, no. 5, pp. 873–880, 2005. View at Publisher · View at Google Scholar · View at Scopus - Y. Niu, D. W. C. Ho, and X. Wang, “Sliding mode control for Itô stochastic systems with Markovian switching,”
*Automatica*, vol. 43, no. 10, pp. 1784–1790, 2007. View at Publisher · View at Google Scholar · View at Scopus - B. C. Zheng and G. H. Yang, “Sliding mode control for Markov jump linear uncertain systems with partly unknown transition rates,”
*International Journal of Systems Science*, 2013. View at Publisher · View at Google Scholar - P. Shi, Y. Xia, G. P. Liu, and D. Rees, “On designing of sliding-mode control for stochastic jump systems,”
*IEEE Transactions on Automatic Control*, vol. 51, no. 1, pp. 97–103, 2006. View at Publisher · View at Google Scholar · View at Scopus - S. Ma and E.-K. Boukas, “A singular system approach to robust sliding mode control for uncertain Markov jump systems,”
*Automatica*, vol. 45, no. 11, pp. 2707–2713, 2009. View at Publisher · View at Google Scholar · View at Scopus - C. Edwards and S. K. Spurgeon,
*Sliding Mode Control: Theory and Applications*, Taylor and Francis, London, UK, 1998. - J. Y. Hung, W. B. Gao, and J. C. Hung, “Variable structure control: a survey,”
*IEEE Transactions on Industrial Electronics*, vol. 40, no. 1, pp. 2–22, 1993. View at Publisher · View at Google Scholar · View at Scopus - V. I. Utkin,
*Sliding Modes in Control and Optimization*, Springer, Berlin, Germany, 1992. - K. Furuta and Y. Pan, “Variable structure control with sliding sector,”
*Automatica*, vol. 36, no. 2, pp. 211–228, 2000. View at Publisher · View at Google Scholar · View at Scopus - I. R. Petersen, “A stabilization algorithm for a class of uncertain linear systems,”
*Systems and Control Letters*, vol. 8, no. 4, pp. 351–357, 1987. View at Google Scholar · View at Scopus - R. A. Horn and C. R. Johnson,
*Matrix Analysis*, Cambridge University Press, 1985.