Abstract and Applied Analysis

Abstract and Applied Analysis / 2014 / Article
Special Issue

Robust Control, Optimization, and Applications to Markovian Jumping Systems

View this Special Issue

Research Article | Open Access

Volume 2014 |Article ID 182613 | 7 pages | https://doi.org/10.1155/2014/182613

Finite-Time Control for Discrete-Time Markov Jump Systems with Actuator Saturation

Academic Editor: Hao Shen
Received28 Dec 2013
Accepted15 Feb 2014
Published09 Apr 2014

Abstract

This paper investigates the finite-time control problem for discrete-time Markov jump systems subject to saturating actuators. A finite-state Markovian process is given to govern the transition of the jumping parameters. The finite-time controller via state feedback is designed to guarantee that the resulting system is mean-square locally asymptotically finite-time stabilizable. Based on stochastic finite-time stability analysis, sufficient conditions that ensure stochastic control performance of discrete-time Markov jump systems are derived in the form of linear matrix inequalities. Finally, a numerical example is provided to illustrate the effectiveness of the proposed approach.

1. Introduction

During the past several decades, the issue of finite-time control has drawn increasing attention of academic researchers in the area of control field, and various results have been reported. To this end, a considerable amount of research has been carried out; see Hong et al. [1]; He and Liu [2, 3]; Li et al. [4]; Song et al. [5]; Lan et al. [6]. Among the proposed solutions, state feedback control is an important approach to improve finite-time control performance. For instance, by using both state feedback and dynamic output feedback control, finite-time control of the robot system is studied in Hong et al. [7]. Furthermore, based on dynamic observer-based state feedback and Lyapunov-Krasovskii functional approach, the finite-time control problem for time-delay nonlinear jump systems was addressed in the work of He and Liu [2, 3, 8].

On the other hand, more and more attention has been paid to the study of actuator saturation due to its practical and theoretical importance. Therefore, various approaches were investigated to handle systems with actuator saturation, such as in the work of Cao and Lin [9]; the stability of discrete-time systems with actuator saturation was analyzed by a saturation-dependent Lyapunov function. By introducing a time-varying sliding surface, the robust stabilization problem of linear unstable plants with saturating actuators was studied in Corradini and Orlando [10]. Furthermore, the controller design method of Markov jumping systems subject to actuator saturation was presented in Liu et al. [11]. Via dynamic anti-windup fuzzy design, the robust stabilization problem of state delayed T-S fuzzy systems with input saturation was proposed in Song et al. [12]. Other results can refer to [1317] and references therein.

It is well known that the control problem of Markov jump systems has also been extensively studied and a large variety of control problems have been widely investigated, for instance, the stabilization of Markov jump systems with time delays [1824], robust control [25], control of singular Markov systems [26], control of discrete-time stochastic Markov jump systems [27, 28], and fuzzy dissipative control for nonlinear Markovian jump systems [29]. Furthermore, robust stability for uncertain delayed neural networks with Markov jumping parameters was analyzed in Li et al. [30]. Robust filter was designed for uncertain discrete Markov jump singular systems with mode-dependent time delay in Ma and Boukas [31]. Delay-dependent robust stabilization problem for uncertain stochastic switching systems with distributed delays was studied in Shen et al. [32]. Via retarded output feedback, passivity-based control problem for Markov jump systems was addressed in Shen et al. [33]. Observer based finite-time control problem of discrete-time Markov jump systems was studied in Zhang and Liu [34]. However, to the best of our knowledge, the problem of finite-time stabilization of discrete-time stochastic systems has not been fully investigated and it is the main purpose of our study.

In this paper, the attention is focused on the finite-time control problem of discrete-time Markov jump systems with actuator saturation. A state feedback controller is designed to ensure the stochastic finite-time boundedness and stochastic finite-time stabilization of the resulting closed-loop system for all admissible disturbances. The desired controller can be designed via solving a convex optimization problem. Finally, a numerical example is employed to show the effectiveness of the proposed method.

Notation. Throughout the paper, for symmetric matrices and , the notation (resp., ) means that the matrix is positive semidefinite (resp., positive definite). is the identity matrix with appropriate dimension. The notation represents the transpose of the matrix (resp., ) means the largest (resp., smallest) eigenvalue of the matrix ; is a probability space; is the sample space, is the -algebra of subsets of the sample space, and is the probability measure on denotes the expectation operator with respect to some probability measure . Matrices, if not explicitly stated, are assumed to have compatible dimensions. The symbol is used to denote a matrix which can be inferred by symmetry, .

2. Preliminaries and Problem Description

2.1. Preliminaries

Throughout this paper, we will use the following definitions and lemmas.

Lemma 1 (see [12]). For the matrix and the system , the appropriate matrix is given if is in the set , where is defined as follows: then for any diagonal positive matrix , we derive

Lemma 2 (see [32]). For the given symmetric matrix : where , , and ; the following conditions are equivalent:(1), (2), (3).

Definition 3 (see [34]). The resulting closed-loop system (12) is stochastic finite-time stable (SFTB) with respect to with , , and if there exists state feedback controller such that

Definition 4 (see [34]). The resulting closed-loop system (12) is said to be stochastic finite-time stable via state feedback with respect to with , , , and if the system (11)-(12) is SFTB with respect to and under the zero-initial condition the output satisfies for any nonzero which satisfies (10), where is a prescribed positive scalar. Moreover, the state feedback controller (11) is called controller of MJS (12).

2.2. Problem Description

Consider the following discrete-time Markov jump system in the probability space : where is the state vector, is the controlled output, and is the saturated control input. is the external disturbances. is a discrete-time Markov process and takes values from a finite set with transition probabilities given by where , for , and . Moreover, the transition rates matrix of the system is defined by The inputs of the plant are supposed to be bounded as follows: For the system , to simplify the notation, we denote for each , and the other symbols are similarly denoted. , , , , , and are known mode-dependent constant matrices with appropriate dimensions.

Assumption 5 (see [34]). The external disturbance is varying and satisfies the following constraint condition: For the system , we construct the following state feedback controller: Then, the resulting closed-loop discrete-time Markov jump system (MJS) is as follows: where .

3. Main Results

In this section, we investigate the design of a state feedback controller which guarantees the locally finite-time stabilizable of the resulting closed-loop system. Some sufficient conditions and the method of designing state feedback controller are given.

Theorem 6. For each , there exists a feedback controller , , such that the resulting closed-loop system (12) is SFTB with respect to with , if there exist scalars , , and , three sets of mode-dependent symmetric matrices , , and , and two sets of mode-dependent matrices and , such that the following conditions hold: where

Proof. Define the following Lyapunov function for each : It is readily obtained that where
Then by pre- and postmultiplying (13) by with , , we have By using Schur complement lemma, we derive It follows that Since , we get It is shown that Then we have Since , it is easily found that Let and noting that it can be verified that Similarly, for all , we can obtain Then it is not difficult to find that which implies Then, one can obtain that Set it is easy to see that It is obvious that (37) is equivalent to (14). Based on Lemma 1, it is easy to obtain condition (15). This completes the proof.

Theorem 7. For each , there exists a feedback controller , , such that the resulting closed-loop system (12) is said to be stochastic finite-time stable via state feedback with respect to , if there exist three scalars , , and , two sets of mode-dependent symmetric matrices and , and two sets of mode-dependent matrices and , such that the following conditions hold:

Proof. Choose the similar Lyapunov function as Theorem 6 and denote Thus, in the light of Theorem 6, we have Then by pre- and postmultiplying (38) by and considering Schur complement Lemma and (43), we derive holds for all . According to (44), one can obtain that Then, we have Under the zero-value initial condition and noting that , for all , it is shown that Since and from (47), we have The following proof is similar to the process of Zhang and Liu [34].
Since , it follows that and then by pre- and postmultiplying (49) by and its transpose, respectively, we derive condition (40). This completes the proof.

Remark 8. For the given scalars , we can take as the optimized variable to obtain an optimized finite-time stabilized controller. The attenuation lever can be reduced to the minimum possible value such that LMIs (38)–(41) hold. The optimization problem can be described as follows:

4. Illustrative Examples

In this section, a numerical example is provided to demonstrate the effectiveness of the proposed method. Consider the following systems with four operation modes.

Mode 1. Consider

Mode 2. Consider

Mode 3. Consider

Mode 4. Consider

The transition rate matrix is given as follows:

In this case, we choose the initial values for , , , , , , and ; Theorem 6 yields to , , , and the bounds of the input saturation .

Based on Theorem 7, we derive

Remark 9. The figures are given on the last page. In this part Figure 1 is of the jump rates; Figure 2 shows the states of the open-loop Markovian jump system; Figure 3 shows the states of the closed-loop Markovian jump system. By applying the controller studied in this paper to the closed-loop plant, it is obviously noticed that and converge to zero quickly. Based on the figures provided, the controller we designed guarantees that the resulting closed-loop systems are mean-square locally asymptotically finite-time stabilizable.

5. Conclusions

This paper considers the finite-time stabilization problem for a class of discrete-time Markov jump systems with input saturation. The finite-time controller via state feedback is designed to guarantee the stochastic finite-time boundedness and stochastic finite-time stabilization of the considered closed-loop system for all admissible disturbances. Based on stochastic finite-time stability analysis, sufficient conditions are derived in the form of linear matrix inequalities. Finally, simulation results are given to illustrate the effectiveness of the proposed approach. In the future, we will study the finite-time stabilization problem for a class of Markov jump systems with constrained input and time delay.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgments

This work was supported by the National Natural Science Foundation of China under Grant 61203047, the Natural Science Foundation of Anhui Province under Grant 1308085QF119, and the Key Foundation of Natural Science for Colleges and Universities in Anhui province under Grant KJ2012A049.

References

  1. Y. Hong, J. Wang, and D. Cheng, “Adaptive finite-time control of nonlinear systems with parametric uncertainty,” IEEE Transactions on Automatic Control, vol. 51, no. 5, pp. 858–862, 2006. View at: Publisher Site | Google Scholar
  2. S. He and F. Liu, “Finite-time H filtering of time-delay stochastic jump systems with unbiased estimation,” Journal of Systems and Control Engineering, vol. 224, no. 8, pp. 947–959, 2010. View at: Publisher Site | Google Scholar
  3. S. He and F. Liu, “Observer-based finite-time control of time-delayed jump systems,” Applied Mathematics and Computation, vol. 217, no. 6, pp. 2327–2338, 2010. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
  4. S. Li, H. Liu, and S. Ding, “A speed control for a PMSM using finite-time feedback control and disturbance compensation,” Transactions of the Institute of Measurement and Control, vol. 32, no. 2, pp. 170–187, 2010. View at: Publisher Site | Google Scholar
  5. H. Song, L. Yu, D. Zhang, and W.-A. Zhang, “Finite-time H control for a class of discrete-time switched time-delay systems with quantized feedback,” Communications in Nonlinear Science and Numerical Simulation, vol. 17, no. 12, pp. 4802–4814, 2012. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
  6. Q. Lan, S. Li, J. Yang, and L. Guo, “Finite-time soft landing on asteroids using nonsingular terminal sliding mode control,” Transactions of the Institute of Measurement and Control, 2013. View at: Publisher Site | Google Scholar
  7. Y. Hong, Y. Xu, and J. Huang, “Finite-time control for robot manipulators,” Systems & Control Letters, vol. 46, no. 4, pp. 243–253, 2002. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
  8. S. He and F. Liu, “Finite-time H fuzzy control of nonlinear jump system with time delays via dynamic observer-based state feedback,” IEEE Transactions on Fuzzy Systems, vol. 20, no. 4, pp. 605–614, 2012. View at: Publisher Site | Google Scholar
  9. Y.-Y. Cao and Z. Lin, “Stability analysis of discrete-time systems with actuator saturation by a saturation-dependent Lyapunov function,” Automatica, vol. 39, no. 7, pp. 1235–1241, 2003. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
  10. M. L. Corradini and G. Orlando, “Linear unstable plants with saturating actuators: robust stabilization by a time varying sliding surface,” Automatica, vol. 43, no. 1, pp. 88–94, 2007. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
  11. H. Liu, E.-K. Boukas, F. Sun, and D. W. C. Ho, “Controller design for Markov jumping systems subject to actuator saturation,” Automatica, vol. 42, no. 3, pp. 459–465, 2006. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
  12. X. Song, J. Lu, S. Xu, H. Shen, and J. Lu, “Robust stabilization of state delayed T-S fuzzy systems with input saturation via dynamic anti-windup fuzzy design,” International Journal of Innovative Computing, Information and Control, vol. 7, no. 12, pp. 6665–6676, 2011. View at: Google Scholar
  13. B. M. Chen, T. H. Lee, K. Peng, and V. Venkataramanan, “Composite nonlinear feedback control for linear systems with input saturation: theory and an application,” IEEE Transactions on Automatic Control, vol. 48, no. 3, pp. 427–439, 2003. View at: Publisher Site | Google Scholar | MathSciNet
  14. W. Lan and J. Huang, “Semiglobal stabilization and output regulation of singular linear systems with input saturation,” IEEE Transactions on Automatic Control, vol. 48, no. 7, pp. 1274–1280, 2003. View at: Publisher Site | Google Scholar | MathSciNet
  15. T. Hu, A. R. Teel, and L. Zaccarian, “Anti-windup synthesis for linear control systems with input saturation: achieving regional, nonlinear performance,” Automatica, vol. 44, no. 2, pp. 512–519, 2008. View at: Publisher Site | Google Scholar | MathSciNet
  16. J. M. Araujo, P. R. Barros, and C. E. T. Dórea, “Dynamic output feedback control of constrained descriptor systems,” Transactions of the Institute of Measurement and Control, vol. 35, no. 8, pp. 1129–1138, 2013. View at: Publisher Site | Google Scholar
  17. H. Shen, X. Song, and Z. Wang, “Robust fault-tolerant control of uncertain fractional-order systems against actuator faults,” IET Control Theory & Applications, vol. 7, no. 9, pp. 1233–1241, 2013. View at: Publisher Site | Google Scholar | MathSciNet
  18. H. Gao and T. Chen, “New results on stability of discrete-time systems with time-varying state delay,” IEEE Transactions on Automatic Control, vol. 52, no. 2, pp. 328–334, 2007. View at: Publisher Site | Google Scholar | MathSciNet
  19. P. Park and J. Wan Ko, “Stability and robust stability for systems with a time-varying delay,” Automatica, vol. 43, no. 10, pp. 1855–1858, 2007. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
  20. H. Shen, S. Xu, J. Lu, and J. Zhou, “Passivity-based control for uncertain stochastic jumping systems with mode-dependent round-trip time delays,” Journal of the Franklin Institute, vol. 349, no. 5, pp. 1665–1680, 2012. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
  21. M. Wu, Y. He, J.-H. She, and G.-P. Liu, “Delay-dependent criteria for robust stability of time-varying delay systems,” Automatica, vol. 40, no. 8, pp. 1435–1439, 2004. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
  22. Z. Wu, P. Shi, H. Su, and J. Chu, “Passivity analysis for discrete-time stochastic Markovian jump neural networks with mixed time delays,” IEEE Transactions on Neural Networks, vol. 22, no. 10, pp. 1566–1575, 2011. View at: Publisher Site | Google Scholar
  23. Z. Wu, P. Shi, H. Su, and J. Chu, “Stability analysis for discrete-time Markovian jump neural networks with mixed time-delays,” Expert Systems with Applications, vol. 39, no. 6, pp. 6174–6181, 2012. View at: Publisher Site | Google Scholar
  24. Z. Wu, P. Shi, H. Su, and J. Chu, “Stochastic synchronization of Markovian jump neural networks with time-varying delay using sampled-data,” IEEE Transactions on Cybernetics, vol. 43, no. 6, pp. 1796–1806, 2013. View at: Publisher Site | Google Scholar
  25. H. Liu, F. Sun, and E. K. Boukas, “Robust control of uncertain discrete-time Markovian jump systems with actuator saturation,” International Journal of Control, vol. 79, no. 7, pp. 805–812, 2006. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
  26. J. Raouf and E. K. Boukas, “Stabilisation of singular Markovian jump systems with discontinuities and saturating inputs,” IET Control Theory & Applications, vol. 3, no. 7, pp. 971–982, 2009. View at: Publisher Site | Google Scholar
  27. Z. Wu, P. Shi, H. Su, and J. Chu, “Asynchronous l2l filtering for discrete-time stochastic Markov jump systems with randomly occurred sensor nonlinearities,” Automatica, vol. 50, no. 1, pp. 180–186, 2014. View at: Publisher Site | Google Scholar
  28. H. Shen, J. H. Park, L. Zhang, and Z.-G. Wu, “Robust extended dissipative control for sampled-data Markov jump systems,” International Journal of Control, 2014. View at: Publisher Site | Google Scholar
  29. H. Shen, Z. Wang, X. Huang, and J. Wang, “Fuzzy dissipative control for nonlinear Markovian jump systems via retarded feedback,” Journal of the Franklin Institute, 2013. View at: Publisher Site | Google Scholar
  30. H. Li, B. Chen, Q. Zhou, and W. Qian, “Robust stability for uncertain delayed fuzzy hopfield neural networks with Markovian jumping parameters,” IEEE Transactions on Systems, Man, and Cybernetics B: Cybernetics, vol. 39, no. 1, pp. 94–102, 2009. View at: Publisher Site | Google Scholar
  31. S. Ma and E. K. Boukas, “Robust H filtering for uncertain discrete Markov jump singular systems with mode-dependent time delay,” IET Control Theory & Applications, vol. 3, no. 3, pp. 351–361, 2009. View at: Publisher Site | Google Scholar | MathSciNet
  32. H. Shen, S. Xu, X. Song, and J. Luo, “Delay-dependent robust stabilization for uncertain stochastic switching systems with distributed delays,” Asian Journal of Control, vol. 11, no. 5, pp. 527–535, 2009. View at: Publisher Site | Google Scholar | MathSciNet
  33. H. Shen, S. Xu, X. Song, and G. Shi, “Passivity-based control for Markovian jump systems via retarded output feedback,” Circuits, Systems, and Signal Processing, vol. 31, no. 1, pp. 189–202, 2012. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
  34. Y. Zhang and C. Liu, “Observer-based finite-time H control of discrete-time Markovian jump systems,” Applied Mathematical Modelling, vol. 37, no. 6, pp. 3748–3760, 2013. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet

Copyright © 2014 Bo Li and Junjie Zhao. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.


More related articles

953 Views | 543 Downloads | 2 Citations
 PDF  Download Citation  Citation
 Download other formatsMore
 Order printed copiesOrder

Related articles

We are committed to sharing findings related to COVID-19 as quickly and safely as possible. Any author submitting a COVID-19 paper should notify us at help@hindawi.com to ensure their research is fast-tracked and made available on a preprint server as soon as possible. We will be providing unlimited waivers of publication charges for accepted articles related to COVID-19. Sign up here as a reviewer to help fast-track new submissions.