Abstract

This paper investigates the linearization and stabilizing control design problems for a class of SISO Markovian jump nonlinear systems. According to the proposed relative degree set definition, the system can be transformed into the canonical form through the appropriate coordinate changes followed with the Markovian switchings; that is, the system can be full-state linearized in every jump mode with respect to the relative degree set . Then, a stabilizing control is designed through applying the backstepping technique, which guarantees the asymptotic stability of Markovian jump nonlinear systems. A numerical example is presented to illustrate the effectiveness of our results.

1. Introduction

Markovian jump systems have been studied since the pioneering work on quadratic control of linear jump systems in the 1960s. It switches from one mode to another in a random way, and the switching between the modes is governed by a Markov process with discrete and finite state space. Due to the advantage of the probabilistic description through Markov process, Markovian jump systems are well suited to model changes induced by external causes, for example, random faults, unexpected events, and uncontrolled configuration changes; see [15]. Noticeable achievements have been made in the past three decades on stability analysis and controller design of linear Markovian jump systems (see [1, 2, 611] and the references therein). Reference [7] has investigated the problem of control for discrete time-delay linear systems with Markovian jump parameters. References [10, 11] discussed the sliding mode control problems for Markovian jump linear singular systems. Meanwhile, many authors have considered the results for linear Markovian jump time-delay systems; see [7, 1215] and the references therein.

On the other hand, many authors have turned to study the stability and stabilization problems of Markovian jump nonlinear systems. Reference [16] especially, has established the framework of stability analysis for Markovian jump nonlinear system. Reference [17] has proposed the Kalman-Yacubovitch-Popov (KYP) Lemma for the passivity of Markovian jump nonlinear system. [18] discussed the control design for Markovian jump nonlinear system. Reference [19] has discussed the stabilization problems for interconnected Markovian jump nonlinear system from the viewpoint of dissipativity theory. Reference [20] has discussed the stabilization problem for a class of Markovian jump nonlinear systems in the special canonical form. All these works extended results for Markovian jump nonlinear system from the traditional nonlinear control theory, such as [2126].

The purpose of this paper is to fill some gaps on the geometric control theory for Markovian jump nonlinear systems. It is well known that the geometric control theory plays an important role in the stabilization of nonlinear systems; see [23, 25, 26]. However, as to the Markovian jump systems, there is still no related research work on this topic. The difficulty concretes on how to transform the Markovian jump nonlinear system into the canonical form? Motivated by this point, this paper investigates the linearization and stabilizing control design problems for Markovian jump nonlinear systems. More concretely, the main contribution of this paper contains the following aspects.(i)The definition of relative degree set is proposed for Markovian jump nonlinear systems. Because there exist many nonlinear subsystems corresponding to different jump mode, it would be more appropriate to define the relative degrees of the system in terms of set. (ii)The full-state linearization method for Markovian jump nonlinear system is proposed. For every subsystem, the corresponding diffeomorphism can be constructed to transform the system into the triangle form, which implies that all the subsystems can be transformed to the common triangle form, but in different coordinates. (iii)The backstepping technique is applied for the stabilizing control design of the transformed triangle form of Markovian jump nonlinear system.

The rest of this paper is organized as follows. Section 2 discusses the feedback linearization of Markovian jump systems. According to the proposed relative degree set definition, the appropriate coordinate is adopted under which the system can be transformed into the canonical form followed with the Markovian switchings. Section 3 discusses the stabilizing control design through applying the backstepping technique on the canonical form of Markovian jump nonlinear systems. Section 4 presents a numerical example to illustrate the effectiveness of our results. Section 5 concludes this paper.

For convenience, we adopt the following notation: is the transpose of the corresponding matrix . () is the positive semi-definite (positive-definite) matrix. is -dimensional Euclidean space. is 2-norm of a vector . is the family of all increasing functions , such that , for . is the family of all functions with .

2. Feedback Linearization

Consider the following controlled Markovian jump nonlinear system in a fixed complete probability space , where is the state vector, is the controlled output, and is the control input. is the continuous-time Markov process taking values in a finite set , which represents the switching between the different modes and its dynamics are described by the following transitions probabilities: where is the transition rate from mode to with when and and is such that . The Markovian switching parameter process is assumed to be completely measurable at any time instant. For simplicity of notations, take for when and so forth. , , and are Lipschitz satisfying a linear growth condition, which guarantees that the system (1) has a unique strong solution [1].

Motivated by the nonlinear control theory for the deterministic systems (see [25, 26] and the references therein), we present the following definition related to the relative degree for Markovian jump nonlinear systems.

Definition 1 (relative degree set). The Markovian jump nonlinear system (1) is said to have the relative degree set , if for every , the corresponding system is with the relative degree , that is, where .

Obviously, the above definition is a generalization of the relative degree definition in [25, 26]. Here, the relative degree set contains all the relative degree, of all the subsystem for every system mode , which is determined by the characteristic of Markovian jump nonlinear systems.

Note that we start off with the case when all the subsystems are SISO, because it gives more insight into computations and helps understanding the concepts which can be generalized to multivariable systems. Moreover, we consider the system (1) with the relative degree set , which satisfies the following condition according to Definition 1:

Now, let us consider a set of new coordinates which indeed stands for the following coordinates:

Take the new coordinate variables as follows:

For every , if the above and its inverse are both smooth functions, is called a diffeomorphism; see [25, 26]. Under this assumption, we have Due to the fact that , we can set the control law as then the system (8) is feedback equivalent to the following linearized form: where which can be regarded as the canonical form for Markovian jump nonlinear system.

Through the above discussion, we have transformed the Markovian jump system into the triangle form corresponding to different -coordinate, respectively. Hence, we have established the relationship between the proposed relative degree set definition and the full-state linearization for Markovian jump nonlinear systems as follows.

Theorem 2. If the system (1) has a relative set , then the system is full-state feedback linearizable.

Remark 3. The above result can be regarded as a generalized work from deterministic nonlinear control theory to Markovian jump nonlinear system. The key point concentrates on taking the appropriate coordinate changes followed with the Markovian switchings. In this way, we can transform the subsystems into the canonical form (10), which have the same triangle structure but within different coordinates.

Following with the update of the Markovian jump mode , we can transform the -system into the corresponding -system, which also works for the stability conditions. Considering the system (1), for any nonnegative functions , with , , we have where is the infinitesimal generator of the system; see [1, 17]. Through the coordinate transformation, denoting and we have

Due to the fact that the stability of the system (1) is equivalent to the system (10), the stability condition for the system (1) in [1] can be transformed with respect to the system (10) as follows.

Lemma 4. The unforced system (10) is globally asymptotically stable in probability (GASP), if there is a set of positive-definite functions with as , , , such that

Proof. According to Definition 5.34 and Theorem 5.36 of [16], the asymptotical stability of the system can be guaranteed by Then, considering the transformation of (14), the above condition can be represented in the form of (16). The proof of Lemma 4 is completed.
Obviously, the above results also hold for the closed-loop system under the control law. Although with the relative degree set , the Markovian jump nonlinear system (1) can be feedback equivalent to the triangle form (10), but how to construct the control such that the -system can be stabilized following with the Markovian switchings, which is an interesting problem and will be discussed in the next section.

3. Stabilizing Control Design

In this section, we consider the backstepping control design of the Markovian jump nonlinear system (1). Through the discussion in Section 2, the system (1) can be transformed into the following -system:

Now, we continue to take the following coordinate change: where the known function is smooth and satisfying , , . Equivalently, we have

Furthermore, for every , between any two of the following coordinates or it can be found that there exists the corresponding inverse transformation, which is also a diffeomorphism. For simplicity of notations, take , then we have Denote

As follows, we discuss the control design for the system (18). Firstly, for every , taking the following set of Lyapunov functions

Motivated by (16), the infinite small operator for the system (18) is given as follows: Using Young's inequality, we have where are designed parameters. Then, (26) reduces to Taking where are also designed parameters. Note that, the final value of the designed control can be regulated through adjusting the parameters and , which can benefit many practical control design requirements. With fixed appropriate and , the transformation of (19) and (23) can be constructed directly.

Considering the last term of (29), through the transformation (22), we have Denote then we have Moreover, repeating this procedure, we have Note that

Finally, we have

Through the above discussion on the coupled term, we can have

Through updating we can get the control as follows: Moreover, by (9), we can design the original control as follows:

Combined with the above discussion, we get to the following theorem.

Theorem 5. If the system (1) has a relative set , then the closed-loop system under the control is GASP.

Proof. Based on Lemma 4 and (37), sufficient condition (16) for the closed-loop system reduces to where . According to Theorem 5.37 in [16], for every , the function belongs to -function, then (42) indicates the system (1) to be GASP. The proof of this theorem is completed.

Remark 6. Obviously, the difficulty of applying the backstepping technique on Markovian jump nonlinear system is that the coupled term in the Lyapunov inequality (16) is determined by the characteristic of the system. However, this work has provided the above line to settle this problem. Future work could be concentrated on reducing the computing complexity, which is mainly caused by the following two aspects. Firstly, we need to check the relative degree set of the system through Definition 1. Secondly, we need to calculate the backstepping coefficients containing the terms caused by the additional term (16). Both show the complexity of geometric control theory of Markovian jump nonlinear systems.

Remark 7. The above results only consider the case of Markovian jump nonlinear system with the relative degree set . Indeed, we have discussed the full-state linearization problem for every subsystem corresponding to the jump mode , respectively. However, if the subsystem has arbitrary relative degree set, that is, , the Markovian jump nonlinear system cannot be full-state linearized, and we need to study the zero-output dynamics of the system. Hence, how to solve the input-output linearization and stabilization problems is very interesting and requires further studies.

4. Simulation Results

In this section, we present a numerical example for the nonlinear Markovian jump system (1). Let be a right-continuous Markov chain taking values in with the generator Consider the following Markovian jump nonlinear system: Firstly, based on Definition 1, we discuss the relative set of the above system. Obviously, the above conditions satisfy the assumption in Definition 1, that is, the relative degree set is , which implies that system (44) and (45) can be, respectively, transformed into the following canonical form: From (29), taking , , , and , we have

Moreover, we can construct the relationship (22) between the following coordinates: which implies the following diffeomorphism between and : Now, we discuss the coupled terms From (34), we have that Then, from (40), we can construct the control law as follows: Moreover, by (9), we can design the original control as follows: which guarantee the asymptotically stability of the closed-loop system.

Given initial values and , the simulation results of the above discussion are presented as follows. Figure 1 shows the states of Markovian switchings. Correspondingly, the trajectories of and are shown in Figures 23, respectively. Obviously, the control law asymptotically stabilizes the closed-loop system.

5. Conclusion

This paper has discussed the linearization and stabilization problems for a class of general Markovian jump nonlinear systems. Following with the Markovian switchings, the appropriate coordinate is adopted under which the system can be transformed into the canonical form corresponding to the relative degree set. Then, the backstepping technique is applied in the stabilizing control design of Markovian jump nonlinear systems. Further efforts could be concentrated on the study of the linearization and stabilization of Markovian jump nonlinear systems with arbitrary relative degree set .

Acknowledgment

This work is partially supported by the National Basic Research Program of China (973 Program) (Grant no. 2012CB215203), the National Natural Science Foundation of China (no. 61203043 and no. 51036002) and the Fundamental Research Funds for the Central Universities.