Estimation and Synthesis of Reachable Set for Singular Markovian Jump Systems

Ding, Yucai; Liu, Hui

doi:https://doi.org/10.1155/2018/5139840

Complexity

On this page

Abstract Introduction Conclusions Conflicts of Interest Acknowledgments References Copyright Related Articles

Special Issue

Advances in Modelling, Monitoring, and Control for Complex Industrial Systems

View this Special Issue

Research Article | Open Access

Volume 2018 | Article ID 5139840 | https://doi.org/10.1155/2018/5139840

Estimation and Synthesis of Reachable Set for Singular Markovian Jump Systems

Yucai Ding¹and Hui Liu¹

Academic Editor: Sing Kiong Nguang

Received31 Jan 2018

Accepted28 Mar 2018

Published26 Jun 2018

Abstract

The problems of reachable set estimation and state-feedback controller design are investigated for singular Markovian jump systems with bounded input disturbances. Based on the Lyapunov approach, several new sufficient conditions on state reachable set and output reachable set are derived to ensure the existence of ellipsoids that bound the system states and output, respectively. Moreover, a state-feedback controller is also designed based on the estimated reachable set. The derived sufficient conditions are expressed in terms of linear matrix inequalities. The effectiveness of the proposed results is illustrated by numerical examples.

1. Introduction

The research on singular systems has attracted significant attention in the past years due to the fact that singular systems can better describe a larger class of physical systems such as robotic systems, electric circuits, and mechanical systems. When singular systems experience abrupt changes in their structures, it is natural to model them as singular Markovian jump systems [1, 2]. The analysis and synthesis of such class of systems have gained considerable attention because of their importance in applications (see, e.g., the literature [3–10] and the references therein).

Reachable set is one of the important techniques for parameter estimation or state estimation problems [11]. Reachable set for a dynamic system is the set containing all the system states starting from the origin under bounded input disturbances. However, the exact shape of reachable sets of a dynamic system is very complex and hard to obtain; for this reason a number of researchers began to turn their attention to the reachable set estimation problem. The common strategies for reachable set estimation are ellipsoidal method [12] and polyhedron method [13]. The main idea of these methods is to detect simple convex shapes like ellipsoid or polyhedron, which contains all the system states. Compared with polyhedron method, the primary advantage of ellipsoidal method is that the ellipsoid structure is simple and directly related to quadratic Lyapunov functions. As a result, linear matrix inequalities (LMIs) techniques can be used to determine bounding ellipsoids. In the framework of bounding ellipsoid, the reachable set estimation problem for linear time delay systems has received significant research attention in recent years. In [14] sufficient conditions for the existence of bounding ellipsoids containing the reachable set of continuous-time linear systems with time-varying delays were derived by using the Lyapunov-Razumikhin function. In [15], by using Lyapunov-Krasovskii functional method, the author derived some less conservative conditions than those in [14]. In [16] the reachable set of delayed systems with polytopic uncertainties was investigated by using the maximal Lyapunov-Krasovskii functional approach, and some new conditions bounding the set of reachable states are derived. Interesting results on reachable set of delayed systems with polytopic uncertainties can also be found in [17–20]. In addition, some other strategies without using Lyapunov-Krasovskii functional have been provided to estimate the reachable set of continuous-time linear time-varying systems [21] and nonlinear time delay systems [22, 23]. The authors in [24] extended the ideas of reachable set estimation of continuous-time systems to discrete-time systems, wherein a fundamental result (Lemma 2.1 [24]) for the reachable set estimation of discrete-time systems was proposed. The authors in [25] improved the fundamental result obtained in [24] and provided a basic tool (Lemma 4 [25]) for the reachable set estimation of discrete-time systems. On the basis of the general ideas proposed in [25], the reachable set estimation problem was also extended to some classes of complicated systems, such as singular systems [26], Markovian jump systems [27], switched linear systems [28], and T-S fuzzy systems [29, 30]. For the reachable set estimation of discrete-time systems, the other important contributions can be found in [31, 32]. On the other hand, the problem of controller design for specifications involved with the reachable set of a control system is also a very important issue [33]. The controller design problems concerning reachable set were studied in [34] and [35] by using ellipsoidal method and polyhedron method, respectively. Two issues were raised in [34]: the first one is to design a controller such that the reachable set of the closed-loop system is contained in an ellipsoid, and the admissible ellipsoid should be as small as possible; the second one is to design a controller such that the reachable set of the closed-loop system is contained in a given ellipsoid. By constructing suitable Lyapunov-Krasovskii functional, LMI-based sufficient conditions for the existence of controller guaranteeing the ellipsoid bounds as small as possible have been derived for continuous-time delay systems [34] and discrete-time periodic systems [36]. It is obvious that the LMI-based controller design is quite simple and numerically tractable. However, it should be pointed out that the reachable set estimation and synthesis problems of singular Markovian jump systems are much more difficult and challenging than that for nonsingular Markovian jump systems since the ellipsoid containing the reachable set is not directly related to quadratic Lyapunov functions. To the best of the authors’ knowledge, no related results have been established for reachable set estimation and synthesis of singular Markovian jump systems, which has motivated this paper.

In this paper, we consider the problems of reachable set estimation and synthesis of singular Markovian jump systems. By using the Lyapunov approach, the estimation conditions on state reachable set and output reachable set are derived, respectively. Moreover, the desired state-feedback controller is designed based on the estimated reachable set.

Notation. Throughout this paper, denotes the -dimensional Euclidean space; represents the transpose of ; stands for ; (<0) means is a symmetric positive (negative) definite matrix; refers to the expectation; denotes the matrix composed of elements of first rows and columns of matrix ; refers to the Euclidean vector norm; the symbol “” in LMIs denotes the symmetric term of the matrix; is the unit matrix with appropriate dimensions.

2. Problem Formulation

Consider the following singular Markovian jump system:where is the state vector, is the control input, is the measured output, and is the exogenous disturbance which satisfies, , , , and are real constant matrices with appropriate dimensions and . is a continuous-time Markovian process with transition rate matrix and the evolution of Markovian process is governed by the following transition rate:where and ; for is the transition rate from mode to mode and .

For notational simplicity, in the sequel, for each possible , , matrices , , , and will be denoted by , , , and , respectively. When , the system is referred to as a free system.

In this paper we are interested in determining ellipsoids that contain, respectively, the state reachable set and output reachable set. In the reachable set analysis, it is required that systems should be asymptotically stable. When this requirement is not met, we will further design a state-feedback controller such that the reachable set of the closed-loop system is contained in the smallest ellipsoid.

The state reachable set of the free system in (1) is defined by An ellipsoid bounding the reachable set can be always represented as follows: Particularly, when for , the ellipsoid will become a ball which is denoted by .

Since , there exist two nonsingular matrices and such thatLet . Then the free system can be rewritten as the following differential-algebraic form:

The following definition and lemma are also useful in deriving the main results.

Definition 1 (see [2]). (I) The free system is said to be regular if is not identically zero for each .
(II) The free system is said to be impulse-free if for each .

Lemma 2 (see [2]). For any matrices and with , one has .

Lemma 3 (see [12]). Let be a Lyapunov function and . If then , .

3. Main Results

3.1. State Reachable Set Estimation

In this subsection, we will focus our attention on determining a ball which contains the state reachable set of the free system.

Theorem 4. If there exist nonsingular matrices and a scalar such that the following LMIs hold for each ,then the state reachable set of free system starting from the origin is mean-square bounded within the following set:where

Proof. We first prove the regularity and nonimpulsiveness of the free system. Let . Then, by (10), we obtain that . From (11), it is easy to show thatPre- and postmultiplying (14) by and , respectively, we getwhere will be irrelevant to the results of the following discussion; thus the real expressions of these two variables are omitted. It follows from (15) thatwhich implies that is nonsingular for each . Therefore, by Definition 1, we have that the free system is regular and nonimpulsive.
Next, we will show the state reachable set of free system is mean-square bounded within the set . Consider the following Lyapunov function:Let be the weak infinitesimal generator of the random process . Calculating the difference of along the trajectories of the free system, we getDefining the augmented system variable as and using conditions (10) and (11), we haveThen we can deduce from Lemma 3 that , which infers thatRecalling that , it follows from (20) thatFrom (21) we have , which implies that .
Since is nonsingular for each , (8) can be rewritten asThen we can deduce thatIt follows from the fact thatwhere .

By (24), it can be seen thatwhich implies that the trajectories of (7)-(8) are mean-square bounded within the set . Moreover, notice that , and (25) can be rewritten as . By denoting , the state reachable set of free system is mean-square bounded within the set .

It should be noted that inequality (10) represents a nonstrict LMI. This may lead to numerical problems since equality constraints are usually not satisfied perfectly. Below, we will develop a numerically tractable and nonconservative LMI condition.

Theorem 5. If there exist symmetric positive definite matrices , nonsingular matrices , and a scalar such that the following LMI holds for each ,then the state reachable set of free system is mean-square bounded within the following set:where is any matrix with full row rank and satisfies ; is any matrix with full column rank and satisfies .

Proof. Let in (26); it is easy to obtain (10) and (11). In this case, inequality (20) will be replaced by , which infers that with . Then, following the same lines as (22)–(25) in Theorem 4, we can get for any . Therefore, the state reachable set of free system is mean-square bounded within the set .

Remark 6. In order to make the ellipsoid as small as possible, we require . For this purpose, we can add the additional requirement and then maximize a positive scalar , which is equivalent to the following minimization problem:where .

3.2. Output Reachable Set Estimation

Theorem 7. If there exist symmetric positive definite matrices and , nonsingular matrices , and a scalar such that the following LMIs hold for each ,then the output reachable set of free system is mean-square bounded within the following set:where , , , and are defined in Theorem 5.

Proof. By Theorem 5, LMI (30) ensuresWith this and (31), we obtain thatDue to the fact that , (34) can be rewritten as . Thus, the output reachable set of free system is mean-square bounded within the set .

Remark 8. The output reachable set is also expected to be as small as possible. To achieve this goal, we first solve LMI (30) and get satisfying , which can be implemented by using (29). Then we add the additional requirement and maximize a positive scalar , which is equivalent to the following minimization problem:where .

3.3. State-Feedback Controller Design

In this section, we turn our attention to the state-feedback control problem. Our goal here is to find a state-feedback controller, which not only stabilizes the closed-loop system, but also makes the ellipsoid bound on the reachable set of closed-loop system as small as possible.

Now, consider the state-feedback controller , where is a gain matrix to be determined later. By using this controller, the closed-loop system can be obtained aswhere .

Theorem 9. Consider singular Markov jump system (1). If there exist nonsingular matrices , matrices , and scalars , such that the following LMIs hold for each ,then the reachable set of system (1) is mean-square bounded within the set , and the desired controller gain matrix is given by , where

Proof. Denote and for each . Then, pre- and postmultiplying (39) by and its transpose, respectively, we obtainwhere , .
Using Lemma 2, we haveFrom (41) and (42), it is easy to obtain thatwhere , .
By Schur complement, the previous matrix inequality becomeswhere .
Since , (38) infers that . Pre- and postmultiplying the previous matrix inequality by and , respectively, we have . This together with (44) implieswhere .
Pre- and postmultiplying (37) by and , respectively, we obtainFrom the above discussion, we show that if (37)–(39) hold, then (45) and (46) hold. Thus, it follows from Theorem 4 that the closed-loop system can be stabilized by the designed state-feedback controller.
Next, we show that the reachable set of the closed-loop system (36) is mean-square bounded within the set . From (45) and (46), it is easy to show that there exists a Lyapunov function such that , where denotes the difference of along the trajectories of (36). It follows from Lemma 3 that , which impliesNoting that , then (47) can be rewritten asRecalling that is a lower triangular matrix, (48) infers thatwhere .
By (49), it can be seen thatUsing the fact that , we getThis together with (24) yieldsFrom (24), (51), and (52), we have thatwhere . This implies that . Recalling that , we haveBy denoting , the reachable set of closed-loop system (36) is mean-square bounded within the set .

Remark 10. In order to make the ellipsoid as small as possible, we shall carry out the following minimization problem:

4. Numerical Examples

In this section, two numerical simulation examples are given to show the effectiveness of the main results derived above.

Example 11. Consider the free system in (1) with the following parameters: The switching between two modes is described by the following transition rate matrix:

In this example, we choose , . By solving optimization problem (29) with the aid of fminsearch, the minimal and the corresponding are and , respectively. Using the above parameter values, we can obtain and by solving (26). Owing to Theorem 5, the state reachable set is mean-square bounded within the set .

By applying Theorem 7, we have the following results:Therefore, the output reachable set of free system is mean-square bounded within the set .

For simulation we assume that and the disturbance is chosen as . A case for stochastic variation with transition rate matrix is shown in Figure 1. The state reachable set and the ball are depicted in Figure 2. Figure 2 shows that the trajectory of the system is mean-square bounded within the region . The output reachable set , the ball , and the ellipsoid are depicted in Figure 3. Figure 3 shows that the output reachable set is mean-square bounded within the region .

Example 12. Consider system (1) with the following parameters: The switching between two modes is described by the following transition rate matrix: By Theorem 9, we get the following results: Therefore, the gain matrices of state-feedback controller can be obtained as The corresponding parameter values and are, respectively, and , which imply and . Applying this controller makes the state reachable set of closed-loop system (36) mean-square bounded within the region .
For the purpose of the simulation, we assume the initial condition and the disturbance is chosen as . Figure 4 shows one possible switching between two modes. Figure 5 depicts the state reachable set of closed-loop system (36).

5. Conclusions

This paper has dealt with the problems of reachable set estimation and state-feedback controller design for singular Markovian jump systems. New sufficient conditions for the state reachable set estimation and output reachable set estimation have been, respectively, derived in terms of linear matrix inequalities. Based on the estimated reachable set, the state-feedback controller has also been designed. Numerical examples and simulation results have been provided to demonstrate the effectiveness of the proposed methods.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this paper.

Acknowledgments

This work was supported by Applied Basic Research Project of Science and Technology Department of Sichuan Province (no. 2017JY0336), a project supported by Scientific Research Fund of Sichuan Provincial Education Department (no. 16ZA0146), the National Natural Science Foundation of China (no. 11501474), the Longshan Academic Talents Research Support Program of the Southwest University of Science and Technology (no. 17LZX537 and no. 17LZXY11), and the Doctoral Research Foundation of Southwest University of Science and Technology (no. 13zx7141).

References

S. Xu and J. Lam, Robust Control and Filtering of Singular Systems, Springer, Berlin, Germany, 2006.
View at: MathSciNet
E.-K. Boukas, Control of Singular Systems with Random Abrupt Changes, Communications and Control Engineering, Springer, Berlin, Germany, 2008.
View at: MathSciNet
Y. Xia, E.-K. Boukas, P. Shi, and J. Zhang, “Stability and stabilization of continuous-time singular hybrid systems,” Automatica, vol. 45, no. 6, pp. 1504–1509, 2009.
View at: Publisher Site | Google Scholar | MathSciNet
L. Wu, P. Shi, and H. Gao, “State estimation and sliding-mode control of Markovian jump singular systems,” Institute of Electrical and Electronics Engineers Transactions on Automatic Control, vol. 55, no. 5, pp. 1213–1219, 2010.
View at: Publisher Site | Google Scholar | MathSciNet
Z.-G. Wu, J. H. Park, H. Su, and J. Chu, “Stochastic stability analysis for discrete-time singular Markov jump systems with time-varying delay and piecewise-constant transition probabilities,” Journal of The Franklin Institute, vol. 349, no. 9, pp. 2889–2902, 2012.
View at: Publisher Site | Google Scholar | MathSciNet
Y. Kao, J. Xie, and C. Wang, “Stabilization of singular Markovian jump systems with generally uncertain transition rates,” Institute of Electrical and Electronics Engineers Transactions on Automatic Control, vol. 59, no. 9, pp. 2604–2610, 2014.
View at: Publisher Site | Google Scholar | MathSciNet
Y. Ding, H. Liu, and J. Cheng, “H∞ filtering for a class of discrete-time singular Markovian jump systems with time-varying delays,” ISA Transactions®, vol. 53, no. 4, pp. 1054–1060, 2014.
View at: Publisher Site | Google Scholar
Q. Zhang, L. Li, X.-G. Yan, and S. K. Spurgeon, “Sliding mode control for singular stochastic Markovian jump systems with uncertainties,” Automatica, vol. 79, pp. 27–34, 2017.
View at: Publisher Site | Google Scholar | MathSciNet
Y. Ding, S. Zhong, and S. Long, “Asymptotic stability in probability of singular stochastic systems with Markovian switchings,” International Journal of Robust and Nonlinear Control, vol. 27, no. 18, pp. 4312–4322, 2017.
View at: Publisher Site | Google Scholar | MathSciNet
Y. Ma, X. Jia, and D. Liu, “Finite-time dissipative control for singular discrete-time Markovian jump systems with actuator saturation and partly unknown transition rates,” Applied Mathematical Modelling: Simulation and Computation for Engineering and Environmental Systems, vol. 53, pp. 49–70, 2018.
View at: Publisher Site | Google Scholar | MathSciNet
B. T. Polyak, S. A. Nazin, C. Durieu, and E. Walter, “Ellipsoidal parameter or state estimation under model uncertainty,” Automatica, vol. 40, no. 7, pp. 1171–1179, 2004.
View at: Publisher Site | Google Scholar | MathSciNet
S. Boyd, L. El Ghaoui, E. Feron, and V. Balakrishnan, Linear matrix inequalities in system and control theory, vol. 15 of SIAM Studies in Applied Mathematics, Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA, 1994.
View at: Publisher Site | MathSciNet
E. K. Kostousova, “On tight polyhedral estimates for reachable sets of linear differential systems,” in Proceedings of the 9th International Conference on Mathematical Problems in Engineering, Aerospace and Sciences, ICNPAA 2012, pp. 579–586, Austria, July 2012.
View at: Publisher Site | Google Scholar
E. Fridman and U. Shaked, “On reachable sets for linear systems with delay and bounded peak inputs,” Automatica, vol. 39, no. 11, pp. 2005–2010, 2003.
View at: Publisher Site | Google Scholar | MathSciNet
J.-H. Kim, “Improved ellipsoidal bound of reachable sets for time-delayed linear systems with disturbances,” Automatica, vol. 44, no. 11, pp. 2940–2943, 2008.
View at: Publisher Site | Google Scholar | MathSciNet
Z. Zuo, D. W. Ho, and Y. Wang, “Reachable set bounding for delayed systems with polytopic uncertainties: the maximal Lyapunov-Krasovskii functional approach,” Automatica, vol. 46, no. 5, pp. 949–952, 2010.
View at: Publisher Site | Google Scholar | MathSciNet
O. M. Kwon, S. M. Lee, and J. H. Park, “On the reachable set bounding of uncertain dynamic systems with time-varying delays and disturbances,” Information Sciences, vol. 181, no. 17, pp. 3735–3748, 2011.
View at: Publisher Site | Google Scholar | MathSciNet
Z. Zuo, Y. Chen, Y. Wang, D. W. Ho, M. Z. Chen, and H. Li, “A note on reachable set bounding for delayed systems with polytopic uncertainties,” Journal of The Franklin Institute, vol. 350, no. 7, pp. 1827–1835, 2013.
View at: Publisher Site | Google Scholar | MathSciNet
B. Zhang, J. Lam, and S. Xu, “Relaxed results on reachable set estimation of time-delay systems with bounded peak inputs,” International Journal of Robust and Nonlinear Control, vol. 26, no. 9, pp. 1994–2007, 2016.
View at: Publisher Site | Google Scholar | MathSciNet
Y. Sheng and Y. Shen, “Improved reachable set bounding for linear time-delay systems with disturbances,” Journal of The Franklin Institute, vol. 353, no. 12, pp. 2708–2721, 2016.
View at: Publisher Site | Google Scholar | MathSciNet
L. V. Hien and H. M. Trinh, “A new approach to state bounding for linear time-varying systems with delay and bounded disturbances,” Automatica, vol. 50, no. 6, pp. 1735–1738, 2014.
View at: Publisher Site | Google Scholar | MathSciNet
P. T. Nam, P. N. Pathirana, and H. Trinh, “Reachable set bounding for nonlinear perturbed time-delay systems: the smallest bound,” Applied Mathematics Letters, vol. 43, pp. 68–71, 2015.
View at: Publisher Site | Google Scholar | MathSciNet
Y. Sun and F. Meng, “Reachable set estimation for a class of nonlinear time-varying systems,” Complexity, Article ID 5876371, Art. ID 5876371, 6 pages, 2017.
View at: Publisher Site | Google Scholar | MathSciNet
N. D. That, P. T. Nam, and Q. P. Ha, “Reachable set bounding for linear discrete-time systems with delays and bounded disturbances,” Journal of Optimization Theory and Applications, vol. 157, no. 1, pp. 96–107, 2013.
View at: Publisher Site | Google Scholar | MathSciNet
J. Lam, B. Zhang, Y. Chen, and S. Xu, “Reachable set estimation for discrete-time linear systems with time delays,” International Journal of Robust and Nonlinear Control, vol. 25, no. 2, pp. 269–281, 2015.
View at: Publisher Site | Google Scholar | MathSciNet
Z. Feng and J. Lam, “On reachable set estimation of singular systems,” Automatica, vol. 52, pp. 146–153, 2015.
View at: Publisher Site | Google Scholar | MathSciNet
Z. Feng and W. X. Zheng, “On reachable set estimation of delay Markovian jump systems with partially known transition probabilities,” Journal of The Franklin Institute, vol. 353, no. 15, pp. 3835–3856, 2016.
View at: Publisher Site | Google Scholar | MathSciNet
Y. Chen, J. Lam, and B. Zhang, “Estimation and synthesis of reachable set for switched linear systems,” Automatica, vol. 63, pp. 122–132, 2016.
View at: Publisher Site | Google Scholar | MathSciNet
Z. Feng, W. X. Zheng, and L. Wu, “Reachable set estimation of T-S fuzzy systems with time-varying delay,” IEEE Transactions on Fuzzy Systems, 2016.
View at: Publisher Site | Google Scholar
W. Xiang, H.-D. Tran, and T. T. Johnson, “Output reachable set estimation for switched linear systems and its application in safety verification,” Institute of Electrical and Electronics Engineers Transactions on Automatic Control, vol. 62, no. 10, pp. 5380–5387, 2017.
View at: Publisher Site | Google Scholar | MathSciNet
L. Van, N. Thanh, and H. Trinh, “New results on state bounding for discrete-time systems with interval time-varying delay and bounded disturbance inputs,” IET Control Theory & Applications, vol. 8, no. 14, pp. 1405–1414, 2014.
View at: Publisher Site | Google Scholar | MathSciNet
L. V. Hien, N. Trung, and H. Binh, “A novel approach to state bounding for discrete-time Markovian jump systems with interval time-varying delay,” IMA Journal of Mathematical Control and Information, vol. 33, no. 2, pp. 293–307, 2016.
View at: Publisher Site | Google Scholar | MathSciNet
H. Trinh and L. V. Hien, “On reachable set estimation of two-dimensional systems described by the Roesser model with time-varying delays,” International Journal of Robust and Nonlinear Control, vol. 28, no. 1, pp. 227–246, 2018.
View at: Publisher Site | Google Scholar | MathSciNet
B. Zhang, J. Lam, and S. Xu, “Reachable set estimation and controller design for distributed delay systems with bounded disturbances,” Journal of The Franklin Institute, vol. 351, no. 6, pp. 3068–3088, 2014.
View at: Publisher Site | Google Scholar | MathSciNet
E. K. Kostousova, “On feedback target control for uncertain discrete-time bilinear systems with state constraints through polyhedral technique,” in Proceedings of the 9th International Conference for Promoting the Application of Mathematics in Technical and Natural Sciences, AMiTaNS 2017, Bulgaria, June 2017.
View at: Publisher Site | Google Scholar
Y. Chen and J. Lam, “Estimation and synthesis of reachable set for discrete-time periodic systems,” Optimal Control Applications and Methods, vol. 37, no. 5, pp. 885–901, 2016.
View at: Publisher Site | Google Scholar | MathSciNet

Copyright

Copyright © 2018 Yucai Ding and Hui Liu. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

670

Downloads

1120

Citations