#### Abstract

This paper investigates the stabilization problem for a class of discrete-time stochastic non-affine nonlinear systems based on T-S fuzzy models. Based on the function approximation capability of a class of stochastic T-S fuzzy models, it is shown that the stabilization problem of a stochastic non-affine nonlinear system can be solved as a robust stabilization problem of the stochastic T-S fuzzy system with the approximation errors as the uncertainty term. By using a class of piecewise dynamic feedback fuzzy controllers and piecewise quadratic Lyapunov functions, robust semiglobal stabilization condition of the stochastic non-affine nonlinear systems is formulated in terms of linear matrix inequalities. A simulation example illustrating the effectiveness of the proposed approach is provided in the end.

#### 1. Introduction

In recent years, Takagi-Sugeno (T-S) type dynamic fuzzy model [1] based control methodologies have attracted great attention from control community. T-S fuzzy models describe a nonlinear system by the “blending” of a set of local linear dynamic models. This relatively simple structure facilitates the systematic stability analysis and controller design of T-S fuzzy control systems in view of the powerful linear systems control theory [2–13]. By using a common quadratic Lyapunov function and LMI techniques, control design of T-S fuzzy systems can be formulated in a convex optimization problem, which can be effectively solved by various tools. However, common Lyapunov functions (CLFs) tend to be conservative and even might not exist for many highly complex nonlinear systems [3]. In order to reduce the conservatism of approaches based on CLFs, some results based on piecewise Lyapunov functions (PLFs) have been proposed [12, 13]. For the most recent advances on relevant topics, readers please refer to the book and the survey paper [2, 3] and the references therein for details.

Control design of nonlinear systems based on T-S fuzzy models can be typically summarized into two steps: (i) for a given nonlinear system, find its approximate T-S fuzzy model; and (ii) design a controller for the obtained T-S fuzzy model. It has been shown that T-S fuzzy models are universal function approximators in the sense that they are able to approximate any smooth nonlinear functions to any degree of accuracy in any convex compact region [14–16], which provides a theoretical foundation for utilizing the T-S fuzzy modeling method as an alternative approach to describing complex nonlinear systems approximately. However, it has been proved in [16] that the commonly used T-S fuzzy models where the control variables are not included in the premise variables are only able to approximate affine nonlinear systems to any degree of accuracy on any compact set. This implies that only the control design of affine nonlinear systems can be solved based on the commonly used T-S fuzzy models. To deal with more general nonlinear systems, that is, non-affine nonlinear systems, recently the coauthors proposed a class of generalized T-S fuzzy models which are universal function approximators of non-affine nonlinear systems [17, 18].

On another fruitful research frontier, stochastic control systems have been extensively studied because stochastic modeling plays a very important role in many branches of science and engineering [19–22]. Although many valuable results on stability analysis and controller synthesis of stochastic linear systems have been reported, most of the existing results on stochastic nonlinear control systems do not provide any systematic way of control design due to the difficulty in searching for suitable Lyapunov functions, especially for highly complex stochastic nonlinear systems. Motivated by the deterministic T-S fuzzy model based control techniques, the T-S fuzzy models have been extended to the stochastic case, where the local models are stochastic linear dynamic models instead of deterministic ones [23–26]. Especially, to deal with stochastic non-affine nonlinear systems (SNNS), the so-called generalized stochastic T-S fuzzy models were proposed in [26] by the co-authors.

In [26], the stabilization problem of continuous-time SNNS was studied based on the generalized stochastic T-S fuzzy models. However, it is noted that the approach proposed in [26] is based on common Lyapunov functions, which is very conservative. In this paper, we investigate the stabilization problem of discrete-time SNNS based on discrete-time generalized stochastic T-S fuzzy models. By using a piecewise Lyapunov function and a class of piecewise dynamic feedback fuzzy controllers, it is shown that the robust semiglobal stabilization condition of discrete-time SNNS can be formulated in terms of a set of linear matrix inequalities (LMIs) that are numerically efficient with commercially available software.

The rest of this paper is structured as follows. Section 2 is devoted to model description and problem formulation. In Section 3, robust controller design result for discrete-time stochastic non-affine nonlinear systems is presented. Simulation results are provided in Section 4 to demonstrate the effectiveness of the proposed approach. Conclusions are given in Section 5.

*Notations. *The notations used in this paper are fairly standard. The notation is used to indicate the terms that can be induced by symmetry. represents vector or matrix transpose. and are used to denote the identity matrix and the zero matrix, respectively. The subscripts and are omitted when the size is not relevant or can be determined from the context. means that matrix is real, symmetric, and positive definite. For a matrix , is the eigenvalue of . Let be the mathematical expectation operator with respect to the given probability measure , and let be a complete probability space with a natural filtration .

#### 2. Model Description and Problem Formulation

##### 2.1. T-S Fuzzy Model Description of SNNS

In this paper, we consider the following discrete-time stochastic non-affine nonlinear system: where , , is a compact set on containing the origin, and is a -dimensional Wiener process defined on a complete probability space with Moreover, the noise processes , the system state, and the control input are independent. It is assumed in this paper that the mappings and both vanish at zero, that is, and . It is also assumed that and satisfy the usual linear growth and local Lipschitz conditions for existence and uniqueness of solutions to (2.1).

Our objective is to develop an approach to controlling the SNNS in (2.1) via T-S fuzzy modeling. In order to approximate the SNNS in (2.1), the following discrete-time generalized stochastic T-S fuzzy model is employed.

*Plant rule ***IF** is AND AND is ; is AND AND is ; **THEN**
where denotes the thrule, the total number of rules, and the fuzzy sets, the state vector, the input vector, and the matrices of the th local model.

Under the center-average defuzzifier, product inference, and singleton fuzzifier, the T-S fuzzy system in (2.3) can be expressed globally as with where are the so-called normalized fuzzy membership functions satisfying and .

In the co-authors’ recent work [26], the continuous-time counterpart of the stochastic T-S fuzzy models in (2.4) has been proved to be the universal function approximator to continuous-time SNNS. It has been also shown in [26] that the function approximation capability also holds for the discrete-time case, which is summarized in the following lemma.

Lemma 2.1 (see [26]). *For any given SNNS described by (2.1) and any two positive constants and , there exist a set of fuzzy basis functions and constant matrices , , , and , , such that
*

*where*

*with*

From (2.6) in Lemma 2.1, an SNNS described by (2.1) can be exactly expressed in a compact set by a generalized stochastic T-S fuzzy model in (2.4) with the approximation errors as some norm-bounded uncertainties as follows: where

Therefore, one can easily conclude that the stabilization of an SNNS given in (2.1) can be actually solved as a robust stabilization problem of its corresponding stochastic generalized T-S fuzzy model with the approximation errors as the uncertainty terms.

##### 2.2. System Formulation and Dynamic Fuzzy Controllers

It is noted that fuzzy system (2.4) induces a polyhedral partition of the premise space, which is dependent on both the system state and control input . As a result, the global fuzzy system can be viewed as a number of subsystems in a number of individual regions.

In this paper, the premise space is divided into a set of crisp regions and fuzzy regions. Denote the partitioned regions as with as the set of region indices and define the indices of fired rules in each region , then the crisp regions and fuzzy regions can be defined respectively by where .

Based on such a partition method, the fuzzy model (2.4), or the original SNNS (2.1), in each region can be rewritten by a blending of subsystems,

In order to stabilize the nonlinear system in (2.12), we employ the following piecewise dynamic state feedback fuzzy controller:

*Remark 2.2. *As it has been argued in [17], because the premise variables of the generalized stochastic T-S fuzzy system in (2.12) contain the system control input, the commonly used parallel distributed compensation (PDC) scheme cannot be directly applied. Instead, the dynamic fuzzy controller in (2.13) is proposed. It is noted that by using the dynamic state feedback controller in (2.13), the closed-loop control system can be expressed in the summation of one index which is different from the traditional static state feedback case where indices are used. This will lead to much less number of LMIs in controller design which will be shown subsequently.

*Remark 2.3. *When the local gains of the piecewise dynamic fuzzy controller (PDFC) in (2.13) are equal, that is, , for , the fuzzy controller in (2.13) reduces to the so-called piecewise dynamic crisp controller (PDCC). It will be shown in Section 4 that the fuzzy controller in (2.13) achieves better performance than the piecewise dynamic state feedback controller.

Then the closed-loop control system consisting of (2.12) and (2.13) is given by
where , and are defined in (2.10), and

In addition, we define a new set that represents all possible state transitions among regions of the closed-loop T-S fuzzy system in (2.15) as follows:

In the case of and , the state trajectories evolve in the same region at the time . Otherwise, the state trajectories will transit from the region to at that time.

#### 3. Robust Controller Design for SNNS

In this section, an LMI approach will be developed to solve the stabilization problem of the SNNS in (2.1) based on the generalized stochastic T-S fuzzy models in (2.4).

The following definitions are introduced first.

*Definition 3.1. *The closed-loop control system in (2.14) is said to be stochastically asymptotically stable in the mean square sense, if for any initial conditions , the solution of (2.14) exists for all and .

*Definition 3.2. *The closed-loop control system in (2.14) is said to be stochastically exponentially stable in the mean square sense, if there exist a set of positive constants , and , such that given any initial states , the solution of (2.14) exists for all and .

Denote and . For the sake of simplicity, we denote , , , and as , , , and , respectively.

Suppose that the upper bounds of the uncertainties and are given by respectively.

Then the stochastic stability analysis result for the closed-loop control system (2.14) is provided in the following theorem.

Theorem 3.3. *The closed-loop stochastic fuzzy control system (2.14) is stochastically asymptotically stable in the mean square sense if there exist a set of positive definite matrices , , two sets of positive constants and , and a positive constant such that the following matrix inequalities hold for all , ,
**
where
*

*Proof. *Consider the following piecewise Lyapunov function candidate:
For a given set of given positive definite matrices , from (2.2) one has

Based on Lemmas A.1 and A.2, one has that

Then one has that along the system trajectories of (2.14),

Therefore one has that if

Denote . Then it can be seen that the inequality (3.8) is equivalent to
where is defined in (3.3).

The upper bounds defined in (3.1) can be rewritten, respectively, as

Then by applying Lemma A.3 (S-procedure) in the appendix, one can conclude that (3.8) holds if there exist two sets of positive constants and such that (3.2) holds.

Therefore, if (3.2) holds, one has that

Taking expectation of both sides of (3.11) yields
which implies

Then one has that . From Definition 3.1, the closed-loop fuzzy system (2.14) is stochastically asymptotically stable in the mean square sense. The proof is thus completed.

Corollary 3.4. *Under the conditions of Theorem 3.3, the closed-loop stochastic fuzzy control system (2.14) is also stochastically exponentially stable in the mean square sense.*

*Proof. *From (3.4) one has that
where and .

Then from (3.12), one has
which implies

Thus one has that , where and . From Definition 3.2, one can conclude that the closed-loop fuzzy control system (2.14) is stochastically exponentially stable in the mean square sense. The proof is thus completed.

*Remark 3.5. *It is noted that represents the convergence rate of the closed-loop control system.

Based on Theorem 3.3, the following controller design results can be obtained.

Theorem 3.6. *The SNNS (2.1) can be semiglobally stochastically asymptotically stabilized in the mean square sense by the dynamic fuzzy controller in (2.13), if there exist a set of positive definite matrices , , two sets of positive constants and , and a positive constant such that the following matrix inequalities hold for all , ,
**Moreover, the controller gain matrices are given by .*

*Proof. *It is noted that the SNNS (2.1) can be expressed by the generalized stochastic T-S fuzzy model in any compact set. It is also noted that the system (4.2) can be expressed by (2.12) in each local region of interest. Thus if the system (2.12) can be stochastically asymptotically stabilized in the mean square sense by the controller (2.13), with the bounded initial condition on the state and the control , the original SNNS (2.1) can be shown to be semi-globally stochastically asymptotically stabilized in the mean square sense.

By using Schur’s complement, (3.2) is equivalent to

By matrix inverse lemma, (3.18) becomes

Multiplying from both sides to (3.19), one has
which is equivalent to (3.17) by using Schur’s complement with the fact that and .

Thus it follows from Theorem 3.3 that the closed-loop fuzzy system (2.14) is stochastically asymptotically stable in the mean square sense. Thus one has shown that the original SNNS (2.1) can be semi-globally stochastically asymptotically stabilized by the controller in (2.13). Thus the proof is completed.

*Remark 3.7. *From (3.19), one can see that the LMIs in (3.17) are not easy to be satisfied if the upper bounds of the approximation errors, that is, and , are too large. In order to achieve better approximation performance one has to use larger number of fuzzy rules, which, based on Theorems 3.3 and 3.6, leads to much higher computation cost of control design. However, this problem can be lessened to some extent due to the robustness of the proposed approach. In other words, the smaller number of fuzzy rules can be chosen since the robustness of the proposed approach allows larger approximation errors.

*Remark 3.8. *Theorems 3.3 and 3.6 are based on a piecewise quadratic Lyapunov function. When the positive definite matrices are chosen as common ones, that is, , , then the results of Theorems 3.3 and 3.6 reduce to those based on common Lyapunov functions. It will be shown in Section 4 that the results based on piecewise Lyapunov functions (FLPs) are less conservative than those based on common Lyapunov functions (CLFs).

#### 4. Simulation Studies

In this section, to show the performance of the proposed controller design results, we consider the balancing problem of an inverted pendulum on a cart. The following discretized inverted pendulum plant with non-affine mathematical model [26] is used:
where , , denotes the angle of pendulum from the vertical, and is the angular velocity. m/s^{2} is the gravity constant, is the mass of pendulum, is the mass of the cart, , sis the sampling time in this study, and is the length of the pendulum. Note that the input force is given by with an amplifier of gain connected. In this simulation, we choose kg, kg, and m.

We linearize the plant around the following operating points, , , , and , respectively, and consider the approximation errors between the linearized local model and the original nonlinear models as norm-bounded uncertainties. Then the following uncertain discrete-time dynamic T-S fuzzy model can be obtained: where the membership functions are shown in Figure 1,

As it has been defined in Section 2, the indices of fired rules in each local region are given in Table 1.

It is noted that the exact or tightest upper bounds of the approximation errors are difficult to identify. However, one can apply the method shown in [26] to obtain the approximate upper bounds, which are and , respectively. Then by applying Theorem 3.6, the controller gains with respect to each partitioned regions are obtained as

To illustrate the performance of the approach proposed in this paper, the state trajectories and control input of the closed-loop system under initial condition along 10 individual Wiener process paths are shown in Figures 2 and 3, respectively. One can observe that both the means of the system states and control input converge to zero as time approaches infinity.

To compare the proposed approach with results based on piecewise dynamic controller and piecewise/common Lyapunov functions, respectively, the convergence rates under different cases are presented in Table 2. It can be observed from Table 2 that the approaches based on piecewise quadratic Lyapunov functions are less conservative than those based on common Lyapunov functions, and the piecewise dynamic *fuzzy* controller (PDFC) has better performance than the piecewise dynamic *crisp* controller.

#### 5. Conclusion

In this paper, T-S fuzzy model based control design of discrete-time stochastic non-affine nonlinear systems (SNNS) has been investigated. By using a piecewise Lyapunov function, it is shown that a discrete-time SNNS can be stochastically asymptotically stabilized in the mean square sense by solving a set of linear matrix equalities. Simulation results are provided to demonstrate the effectiveness of the approaches proposed in this paper. Some interesting future topics include filtering design and fault detection problems for complex discrete-time *SNNS* based on piecewise Lyapunov functions.

#### Appendix

Lemma A.1. *Given a set of independent stochastic processes satisfying
**
a set of vectors , and a symmetric matrix , one has that
*

*Proof. *One has

Lemma A.2 (see [27]). *For any real matrices and with compatible dimensions, then
**
where , , are nonnegative scalars with .*

Lemma A.3 (S-procedure [28]). *Let be symmetric matrices. Then the following condition on **
such that
**
holds if there exists
*

#### Acknowledgment

The work described in this paper was supported by the National Natural Science Foundation of China under Grant 11001005.