Mathematical Problems in Engineering

Volume 2013 (2013), Article ID 931695, 9 pages

http://dx.doi.org/10.1155/2013/931695

## Full-State Linearization and Stabilization of SISO Markovian Jump Nonlinear Systems

State Key Laboratory of Alternate Electrical Power System with Renewable Energy Sources, School of Control and Computer Engineering, North China Electric Power University, Beijing 102206, China

Received 18 January 2013; Revised 13 March 2013; Accepted 18 March 2013

Academic Editor: Rongni Yang

Copyright © 2013 Zhongwei Lin et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

This paper investigates the linearization and stabilizing control design problems for a class of SISO Markovian jump nonlinear systems. According to the proposed relative degree set definition, the system can be transformed into the canonical form through the appropriate coordinate changes followed with the Markovian switchings; that is, the system can be full-state linearized in every jump mode with respect to the relative degree set . Then, a stabilizing control is designed through applying the backstepping technique, which guarantees the asymptotic stability of Markovian jump nonlinear systems. A numerical example is presented to illustrate the effectiveness of our results.

#### 1. Introduction

Markovian jump systems have been studied since the pioneering work on quadratic control of linear jump systems in the 1960s. It switches from one mode to another in a random way, and the switching between the modes is governed by a Markov process with discrete and finite state space. Due to the advantage of the probabilistic description through Markov process, Markovian jump systems are well suited to model changes induced by external causes, for example, random faults, unexpected events, and uncontrolled configuration changes; see [1–5]. Noticeable achievements have been made in the past three decades on stability analysis and controller design of linear Markovian jump systems (see [1, 2, 6–11] and the references therein). Reference [7] has investigated the problem of control for discrete time-delay linear systems with Markovian jump parameters. References [10, 11] discussed the sliding mode control problems for Markovian jump linear singular systems. Meanwhile, many authors have considered the results for linear Markovian jump time-delay systems; see [7, 12–15] and the references therein.

On the other hand, many authors have turned to study the stability and stabilization problems of Markovian jump nonlinear systems. Reference [16] especially, has established the framework of stability analysis for Markovian jump nonlinear system. Reference [17] has proposed the Kalman-Yacubovitch-Popov (KYP) Lemma for the passivity of Markovian jump nonlinear system. [18] discussed the control design for Markovian jump nonlinear system. Reference [19] has discussed the stabilization problems for interconnected Markovian jump nonlinear system from the viewpoint of dissipativity theory. Reference [20] has discussed the stabilization problem for a class of Markovian jump nonlinear systems in the special canonical form. All these works extended results for Markovian jump nonlinear system from the traditional nonlinear control theory, such as [21–26].

The purpose of this paper is to fill some gaps on the geometric control theory for Markovian jump nonlinear systems. It is well known that the geometric control theory plays an important role in the stabilization of nonlinear systems; see [23, 25, 26]. However, as to the Markovian jump systems, there is still no related research work on this topic. The difficulty concretes on how to transform the Markovian jump nonlinear system into the canonical form? Motivated by this point, this paper investigates the linearization and stabilizing control design problems for Markovian jump nonlinear systems. More concretely, the main contribution of this paper contains the following aspects.(i)The definition of relative degree set is proposed for Markovian jump nonlinear systems. Because there exist many nonlinear subsystems corresponding to different jump mode, it would be more appropriate to define the relative degrees of the system in terms of set. (ii)The full-state linearization method for Markovian jump nonlinear system is proposed. For every subsystem, the corresponding diffeomorphism can be constructed to transform the system into the triangle form, which implies that all the subsystems can be transformed to the common triangle form, but in different coordinates. (iii)The backstepping technique is applied for the stabilizing control design of the transformed triangle form of Markovian jump nonlinear system.

The rest of this paper is organized as follows. Section 2 discusses the feedback linearization of Markovian jump systems. According to the proposed relative degree set definition, the appropriate coordinate is adopted under which the system can be transformed into the canonical form followed with the Markovian switchings. Section 3 discusses the stabilizing control design through applying the backstepping technique on the canonical form of Markovian jump nonlinear systems. Section 4 presents a numerical example to illustrate the effectiveness of our results. Section 5 concludes this paper.

For convenience, we adopt the following notation: is the transpose of the corresponding matrix . () is the positive semi-definite (positive-definite) matrix. is -dimensional Euclidean space. is 2-norm of a vector . is the family of all increasing functions , such that , for . is the family of all functions with .

#### 2. Feedback Linearization

Consider the following controlled Markovian jump nonlinear system in a fixed complete probability space , where is the state vector, is the controlled output, and is the control input. is the continuous-time Markov process taking values in a finite set , which represents the switching between the different modes and its dynamics are described by the following transitions probabilities: where is the transition rate from mode to with when and and is such that . The Markovian switching parameter process is assumed to be completely measurable at any time instant. For simplicity of notations, take for when and so forth. , , and are Lipschitz satisfying a linear growth condition, which guarantees that the system (1) has a unique strong solution [1].

Motivated by the nonlinear control theory for the deterministic systems (see [25, 26] and the references therein), we present the following definition related to the relative degree for Markovian jump nonlinear systems.

*Definition 1 (relative degree set). *The Markovian jump nonlinear system (1) is said to have the relative degree set , if for every , the corresponding system is with the relative degree , that is,
where .

Obviously, the above definition is a generalization of the relative degree definition in [25, 26]. Here, the relative degree set contains all the relative degree, of all the subsystem for every system mode , which is determined by the characteristic of Markovian jump nonlinear systems.

Note that we start off with the case when all the subsystems are SISO, because it gives more insight into computations and helps understanding the concepts which can be generalized to multivariable systems. Moreover, we consider the system (1) with the relative degree set , which satisfies the following condition according to Definition 1:

Now, let us consider a set of new coordinates which indeed stands for the following coordinates:

Take the new coordinate variables as follows:

For every , if the above and its inverse are both smooth functions, is called a diffeomorphism; see [25, 26]. Under this assumption, we have Due to the fact that , we can set the control law as then the system (8) is feedback equivalent to the following linearized form: where which can be regarded as the canonical form for Markovian jump nonlinear system.

Through the above discussion, we have transformed the Markovian jump system into the triangle form corresponding to different -coordinate, respectively. Hence, we have established the relationship between the proposed relative degree set definition and the full-state linearization for Markovian jump nonlinear systems as follows.

Theorem 2. *If the system (1) has a relative set , then the system is full-state feedback linearizable.*

*Remark 3. *The above result can be regarded as a generalized work from deterministic nonlinear control theory to Markovian jump nonlinear system. The key point concentrates on taking the appropriate coordinate changes followed with the Markovian switchings. In this way, we can transform the subsystems into the canonical form (10), which have the same triangle structure but within different coordinates.

Following with the update of the Markovian jump mode , we can transform the -system into the corresponding -system, which also works for the stability conditions. Considering the system (1), for any nonnegative functions , with , , we have where is the infinitesimal generator of the system; see [1, 17]. Through the coordinate transformation, denoting and we have

Due to the fact that the stability of the system (1) is equivalent to the system (10), the stability condition for the system (1) in [1] can be transformed with respect to the system (10) as follows.

Lemma 4. *The unforced system (10) is globally asymptotically stable in probability (GASP), if there is a set of positive-definite functions with as , , , such that
*

*Proof. *According to Definition 5.34 and Theorem 5.36 of [16], the asymptotical stability of the system can be guaranteed by
Then, considering the transformation of (14), the above condition can be represented in the form of (16). The proof of Lemma 4 is completed.

Obviously, the above results also hold for the closed-loop system under the control law. Although with the relative degree set , the Markovian jump nonlinear system (1) can be feedback equivalent to the triangle form (10), but how to construct the control such that the -system can be stabilized following with the Markovian switchings, which is an interesting problem and will be discussed in the next section.

#### 3. Stabilizing Control Design

In this section, we consider the backstepping control design of the Markovian jump nonlinear system (1). Through the discussion in Section 2, the system (1) can be transformed into the following -system:

Now, we continue to take the following coordinate change: where the known function is smooth and satisfying , , . Equivalently, we have

Furthermore, for every , between any two of the following coordinates or it can be found that there exists the corresponding inverse transformation, which is also a diffeomorphism. For simplicity of notations, take , then we have Denote

As follows, we discuss the control design for the system (18). Firstly, for every , taking the following set of Lyapunov functions

Motivated by (16), the infinite small operator for the system (18) is given as follows: Using Young's inequality, we have where are designed parameters. Then, (26) reduces to Taking where are also designed parameters. Note that, the final value of the designed control can be regulated through adjusting the parameters and , which can benefit many practical control design requirements. With fixed appropriate and , the transformation of (19) and (23) can be constructed directly.

Considering the last term of (29), through the transformation (22), we have Denote then we have Moreover, repeating this procedure, we have Note that

Finally, we have

Through the above discussion on the coupled term, we can have

Through updating we can get the control as follows: Moreover, by (9), we can design the original control as follows:

Combined with the above discussion, we get to the following theorem.

Theorem 5. *If the system (1) has a relative set , then the closed-loop system under the control is GASP.*

*Proof. *Based on Lemma 4 and (37), sufficient condition (16) for the closed-loop system reduces to
where . According to Theorem 5.37 in [16], for every , the function belongs to -function, then (42) indicates the system (1) to be GASP. The proof of this theorem is completed.

*Remark 6. *Obviously, the difficulty of applying the backstepping technique on Markovian jump nonlinear system is that the coupled term in the Lyapunov inequality (16) is determined by the characteristic of the system. However, this work has provided the above line to settle this problem. Future work could be concentrated on reducing the computing complexity, which is mainly caused by the following two aspects. Firstly, we need to check the relative degree set of the system through Definition 1. Secondly, we need to calculate the backstepping coefficients containing the terms caused by the additional term (16). Both show the complexity of geometric control theory of Markovian jump nonlinear systems.

*Remark 7. *The above results only consider the case of Markovian jump nonlinear system with the relative degree set . Indeed, we have discussed the full-state linearization problem for every subsystem corresponding to the jump mode , respectively. However, if the subsystem has arbitrary relative degree set, that is, , the Markovian jump nonlinear system cannot be full-state linearized, and we need to study the zero-output dynamics of the system. Hence, how to solve the input-output linearization and stabilization problems is very interesting and requires further studies.

#### 4. Simulation Results

In this section, we present a numerical example for the nonlinear Markovian jump system (1). Let be a right-continuous Markov chain taking values in with the generator Consider the following Markovian jump nonlinear system: Firstly, based on Definition 1, we discuss the relative set of the above system. Obviously, the above conditions satisfy the assumption in Definition 1, that is, the relative degree set is , which implies that system (44) and (45) can be, respectively, transformed into the following canonical form: From (29), taking , , , and , we have

Moreover, we can construct the relationship (22) between the following coordinates: which implies the following diffeomorphism between and : Now, we discuss the coupled terms From (34), we have that Then, from (40), we can construct the control law as follows: Moreover, by (9), we can design the original control as follows: which guarantee the asymptotically stability of the closed-loop system.

Given initial values and , the simulation results of the above discussion are presented as follows. Figure 1 shows the states of Markovian switchings. Correspondingly, the trajectories of and are shown in Figures 2–3, respectively. Obviously, the control law asymptotically stabilizes the closed-loop system.

#### 5. Conclusion

This paper has discussed the linearization and stabilization problems for a class of general Markovian jump nonlinear systems. Following with the Markovian switchings, the appropriate coordinate is adopted under which the system can be transformed into the canonical form corresponding to the relative degree set. Then, the backstepping technique is applied in the stabilizing control design of Markovian jump nonlinear systems. Further efforts could be concentrated on the study of the linearization and stabilization of Markovian jump nonlinear systems with arbitrary relative degree set .

#### Acknowledgment

This work is partially supported by the National Basic Research Program of China (973 Program) (Grant no. 2012CB215203), the National Natural Science Foundation of China (no. 61203043 and no. 51036002) and the Fundamental Research Funds for the Central Universities.

#### References

- M. M. Mahmoud, J. Jiang, and Y. Zhang,
*Active Fault Tolerant Control Systems*, vol. 287 of*Lecture Notes in Control and Information Sciences*, Springer, New York, NY, USA, 2003. View at Zentralblatt MATH · View at MathSciNet - M. Mariton,
*Jump Linear Systems in Automatic Control*, Marcel Dekker, New York, NY, USA, 1990. - R. C. Tsaur, “A fuzzy time series-Markov chain model with an application to forecast the exchange rate between the Taiwan and US dollar,”
*International Journal of Innovative Computing, Information and Control*, vol. 8, no. 7, pp. 4931–4942, 2012. View at Google Scholar - F. Kojima and J. S. Knopp, “Inverse problem for electromagnetic propagation in a dielectric medium using Markov chainMonte Carlo method,”
*International Journal of Innovative Computing, Information and Control*, vol. 8, no. 3, pp. 2339–2346, 2012. View at Google Scholar - Q. Ahmed, A. Iqbal, I. Taj, and K. Ahmed, “Gasoline engine intake manifold leakage diagnosis/prognosis using hidden Markov model,”
*International Journal of Innovative Computing, Information and Control*, vol. 8, no. 7, pp. 4661–4674, 2012. View at Google Scholar - P. Shi, E.-K. Boukas, and R. K. Agarwal, “Kalman filtering for continuous-time uncertain systems with Markovian jumping parameters,”
*IEEE Transactions on Automatic Control*, vol. 44, no. 8, pp. 1592–1597, 1999. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - P. Shi, E.-K. Boukas, and R. K. Agarwal, “Control of Markovian jump discrete-time systems with norm bounded uncertainty and unknown delay,”
*IEEE Transactions on Automatic Control*, vol. 44, no. 11, pp. 2139–2144, 1999. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - Z. Wang, H. Qiao, and K. J. Burnham, “On stabilization of bilinear uncertain time-delay stochastic systems with Markovian jumping parameters,”
*IEEE Transactions on Automatic Control*, vol. 47, no. 4, pp. 640–646, 2002. View at Publisher · View at Google Scholar · View at MathSciNet - J. Lam, Z. Shu, S. Xu, and E.-K. Boukas, “Robust ${H}_{\infty}$ control of descriptor discrete-time Markovian jump systems,”
*International Journal of Control*, vol. 80, no. 3, pp. 374–385, 2007. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - L. Wu, X. Su, and P. Shi, “Sliding mode control with bounded ${L}_{2}$ gain performance of Markovian jump singular time-delay systems,”
*Automatica*, vol. 48, no. 8, pp. 1929–1933, 2012. View at Publisher · View at Google Scholar · View at MathSciNet - L. Wu, P. Shi, and H. Gao, “State estimation and sliding-mode control of Markovian jump singular systems,”
*IEEE Transactions on Automatic Control*, vol. 55, no. 5, pp. 1213–1219, 2010. View at Publisher · View at Google Scholar · View at MathSciNet - X. Su, P. Shi, L. Wu, and Y. Song, “A novel approach to filter design for T-S fuzzy discrete-time systems with time-varying delay,”
*IEEE Transactions on Fuzzy Systems*, vol. 20, no. 6, pp. 1114–1129, 2012. View at Google Scholar - R. Yang, H. Gao, and P. Shi, “Novel robust stability criteria for stochastic Hopfield neural networks with time delays,”
*IEEE Transactions on Systems, Man, and Cybernetics B*, vol. 39, no. 2, pp. 467–474, 2009. View at Publisher · View at Google Scholar · View at Scopus - R. Yang, P. Shi, G.-P. Liu, and H. Gao, “Network-based feedback control for systems with mixed delays based on quantization and dropout compensation,”
*Automatica*, vol. 47, no. 12, pp. 2805–2809, 2011. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - Z. Fei, H. Gao, and P. Shi, “New results on stabilization of Markovian jump systems with time delay,”
*Automatica*, vol. 45, no. 10, pp. 2300–2306, 2009. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - X. Mao and C. Yuan,
*Stochastic differential equations with Markovian switching*, Imperial College Press, London, UK, 2006. View at MathSciNet - M. D. S. Aliyu, “Passivity and stability of nonlinear systems with Markovian jump parameters,” in
*Proceedings of the American Control Conference (ACC '99)*, pp. 953–957, June 1999. View at Scopus - Z. W. Lin, Y. Lin, and W. H. Zhang, “A unified design for state and output feedback ${H}_{\infty}$ control of nonlinear stochastic Markovian jump systems with state and disturbance-dependent noise,”
*Automatica*, vol. 45, no. 12, pp. 2955–2962, 2009. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - Z. W. Lin, J. Z. Liu, W. H. Zhang, and Y. G. Niu, “Stabilization of interconnected nonlinear stochastic Markovian jump systems via dissipativity approach,”
*Automatica*, vol. 47, no. 12, pp. 2796–2800, 2011. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - Z.-J. Wu, X.-J. Xie, P. Shi, and Y.-Q. Xia, “Backstepping controller design for a class of stochastic nonlinear systems with Markovian switching,”
*Automatica*, vol. 45, no. 4, pp. 997–1004, 2009. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - J. C. Willems, “Dissipative dynamical systems. I. General theory,”
*Archive for Rational Mechanics and Analysis*, vol. 45, pp. 321–393, 1972. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - D. J. Hill and P. J. Moylan, “The stability of nonlinear dissipative systems,”
*IEEE Transactions on Automatic Control*, vol. 21, no. 5, pp. 708–711, 1976. View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - C. I. Byrnes, A. Isidori, and J. C. Willems, “Passivity, feedback equivalence, and the global stabilization of minimum phase nonlinear systems,”
*IEEE Transactions on Automatic Control*, vol. 36, no. 11, pp. 1228–1240, 1991. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - W. Lin and T. Shen, “Robust passivity and feedback design for minimum-phase nonlinear systems with structural uncertainty,”
*Automatica*, vol. 35, no. 1, pp. 35–47, 1999. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - A. Isidori,
*Nonlinear Control System*, Springer, Berlin, Germany, 1994. - H. K. Khalil,
*Nonlinear Systems*, Prentice Hall, New York, NY, USA, 2002.