Research Article  Open Access
Chonghui Song, "Optimal Control Algorithm of Constrained Fuzzy System Integrating Sliding Mode Control and Model Predictive Control", Mathematical Problems in Engineering, vol. 2015, Article ID 897853, 13 pages, 2015. https://doi.org/10.1155/2015/897853
Optimal Control Algorithm of Constrained Fuzzy System Integrating Sliding Mode Control and Model Predictive Control
Abstract
The sliding mode control and the model predictive control are connected by the value function of the optimal control problem for constrained fuzzy system. New conditions for the existence and stability of a sliding mode are proposed. Those conditions are more general conditions for the existence and stability of a sliding mode. When it is applied to the controller design, the design procedures are different from other sliding mode control (SMC) methods in that only the decay rate of the sliding mode motion is specified. The obtained controllers are statefeedback model predictive control (MPC) and also SMC. From the viewpoint of SMC, sliding mode surface does not need to be specified previously and the sliding mode reaching conditions are not necessary in the controller design. From the viewpoint of MPC, the finite time horizon is extended to the infinite time horizon. The difference with other MPC schemes is that the dependence on the feasibility of the initial point is canceled and the control schemes can be implemented in real time. Pseudosliding mode model predictive controllers are also provided. Closed loop systems are proven to be asymptotically stable. Simulation examples are provided to demonstrate proposed methods.
1. Introduction
The modeling and control of fuzzy systems is a very active research area [1–9]. In the optimal control of fuzzy systems, the value functions for deterministic and uncertain systems satisfy the first order HamiltonJacobiBellman (HJB) equations and the first order HamiltonJacobiIsaac (HJI) equations, respectively. References [10, 11] tried to solve the optimal control problem of fuzzy systems by linear system methods. References [12, 13] solved HJB equations in the optimal control of constrained fuzzy systems by dynamic programming. References [14, 15] solved HJI equations in the optimal control of uncertain constrained fuzzy systems by differential game. Usually, such equations are difficult to be solved in closed form due to their high nonlinearity. Some numerical methods with convergence proofs [13–21] are proposed to solve the value function. For the development of the above mentioned numerical methods, refer to [13, 14] and the references therein. References [22–25] use the adaptive dynamic programming to approximate the value function by neural networks. The finite difference approximation with sigmoidal transformation (FDAST) algorithms [13–16] is proposed to solve HJB equations arising in receding horizon control (MPC) schemes and HJI equations arising in robust receding horizon control (MPC) schemes, respectively.
Model predictive control (MPC), also known as receding horizon control, is a powerful tool to integrate the control and optimization of constrained nonlinear systems. Many MPC schemes have been developed [13, 16, 26–38]. The development and limitations of traditional MPC schemes are summarized in [13, 16]. Variable structure systems (VSS) first appeared in the late 1950s. Variable structure control (VSC) is an important control method for nonlinear systems [39]. Since VSC has been proposed, it has undergone great development [40]. The dominant role in VSS theory is played by sliding modes, and the core idea of designing VSC algorithms consists of enforcing this type of motion in some manifolds of the system state space into the sliding mode surface. The design of the sliding mode surface generally takes the artificially selected linear equation form [41, 42]. This form facilitates the design of variable structure controllers and the discussion of the stability region. However, artificially selected sliding mode surface due to the restriction of the sliding mode reaching condition will limit the stable region of the closedloop system. Furthermore, the design of sliding mode surface and control is still a difficult problem for constrained uncertain nonlinear systems and often uses the local linearization method. The results obtained are locally stable, and there are no discussions on global stability and semiglobal stability of constrained uncertain nonlinear systems under SMC. The relationship between the optimal control and the sliding mode was not discussed in the literatures.
In this paper, we present the connection between the optimal control and the sliding mode via the value function. We briefly present the FDAST algorithm to solve HJB equations for constrained fuzzy systems. Then, new conditions for the existence and the stability of the sliding mode are proposed. Those conditions are constructed by the optimal value function and the system equation. They integrate the sliding mode existence criteria and the stability criteria for constrained fuzzy systems. This leads to some big variations in the SMC design. Then, sliding mode model predictive control (SMMPC) and pseudosliding mode model predictive control (PSMMPC) schemes are proposed for some kind of constrained fuzzy systems. Those controllers are MPC and also SMC. From the viewpoint of SMC, the sliding mode surface does not need to be specified previously in the SMC design. Sliding mode reaching conditions are not necessary in the controller design, since the closedloop stability of the trajectory, which cannot reach the sliding mode surface, is guaranteed by MPC schemes. Therefore, it can cancel limitations on the stable zone due to the selection of the sliding mode surface and the sliding mode reaching condition. The closedloop system is globally stable. From the viewpoint of MPC, those controllers are statefeedback (SF) which is very easy to be adjusted. The finite time horizon is extended to the infinite time horizon which guaranteed the global stability without added terminal penalties and constraints. The value function is used to design a controller instead of using the optimal control as the current control action. The dependence on the feasibility of the initial point is canceled and the online repeated optimization in MPC can be avoided. Therefore, the control schemes can be implemented in real time.
This paper is organized as follows. Section 2 begins with a description of HJB equations which includes MPC schemes for fuzzy systems. A brief review of the FDAST algorithm is given. Section 3 gives new conditions for the existence and the stability of a sliding mode. Section 4 gives the SMMPC design for some kind of constrained fuzzy systems by using the value function as a design parameter. Those controllers integrate MPC and SMC. Section 5 provides simulations to demonstrate the proposed method. Section 6 concludes the paper with some further remarks.
2. Problem Formulation and Preliminary Results
We consider following constrained fuzzy systems: where is the state, is the input, is a nonempty compact convex subset including the original point , is the premise variable and is some function of and , denotes the th rule of the fuzzy model, is the number of fuzzy rules, and are input fuzzy terms in the th rule.
Assume that is continuous. The origin is assumed to be the balance point of the global model of system (1); that is, if system (1) is assembled into the global expression by using singleton fuzzifier, product inference, and centeraverage defuzzifier, then . In the following, when the context is clear, the time label will be omitted.
Define the cost functional where if and only if .
The value functional in the optimal control of (1) is
The optimal control problem (1) and (4) satisfies the following HJB equation:
Remark 1. For the detailed derivation of (5), please refer to [14, 15]. Such HJB equation (5) covers MPC of constrained fuzzy systems.
Remark 2. Throughout the rest of this paper, we use the following notations. For a scalar , sign function is and the saturation function is where and .
For a vector and , the vector sign function is defined as , the vector saturation function is defined as , and is defined as For the function and the function vector and , is defined as (Isidori [43])
3. New Conditions for the Existence and Stability of a Sliding Mode
Since we vary for the closedloop system (27) and (36) in simulations, the closedloop trajectories produce the sliding mode motion. This directly motivates us to consider the reason why the sliding mode motion exists. But we find it impossible to apply the commonly used conditions to judge the sliding mode motion. We first give the two commonly used conditions for the sliding mode existence and then discuss the reason why they cannot work. First, define the sliding mode plane and some notations by Then, the two most commonly used conditions for the existence of a sliding mode are or Generally, is chosen by the designer as
The reasons why the commonly used conditions cannot work are as follows.(i)Since the sliding mode surface is not selected by the designer previously, this means that the sliding mode surface equation is unknown. But in conventional SMC, is a known function selected by the designer. This means the commonly used condition (12) for the existence of a sliding mode does not work.(ii)Since is unknown, the gradient is unknown. This means the commonly used condition (13) does not work.(iii)The stability of the sliding mode motion in the conventional SMC depends on the analysis of the equivalent control and the mean motion on the sliding mode surface . Since is unknown, the analysis of the equivalent control and the mean motion can not proceed.(iv)The controller design and the attraction region in the conventional SMC depend on the reaching condition. Since is unknown, the reaching condition cannot be obtained.
To deal with this encountered situation, the new conditions of the existence and the stability of the sliding mode for general constrained uncertain fuzzy systems are constructed by system (1) and the value function (4).
Theorem 3 (new conditions for the existence and stability of a sliding mode). Suppose that the system is (1), is (4), and is a hyperplane. For , is chosen as Define For , define The conditions for the existence and the stability of a sliding mode are
Proof. First, we need to prove . Since
we get
That is, .
From (17) and (20) and referring to Figure 1, the vector is a vector starting at and pointing to the space . For and , if (18) is satisfied, the projection of the vector onto the vector has the same direction as the vector . This means that moves from the inside of the space toward the sliding mode plane . For and , if (18) is satisfied, the projection of the vector onto the vector has the opposite direction to the vector . This means that moves from the inside of the space toward the sliding model plane . From the basic sliding mode principle (i.e., the trajectory of the system in the vicinity of the sliding mode plane moves from the inside toward the sliding mode plane), we know the hyperplane is the sliding mode plane.
From (15) and referring to Figure 1, the projections of and onto have the opposite direction to the vector . This means that moves from the higher level surface of the value function toward the lower level surface, so the sliding mode motion is stable. That completes the proof.
Remark 4. It must be emphasized that condition (18) indicates that the sliding mode motion is a common existing motion in the closedloop system under an appropriate Lyapunov function and control. This is why some closedloop systems chatter even though they are not designed via SMC methods.
Remark 5. The value function is one of the candidates of the global Lyapunov function. Other global Lyapunov functions can also play this role if they can be obtained. If the local Lyapunov function is used in the conditions, it limits the stable zone.
Remark 6. Since the value function is the optimal result of the constrained fuzzy system, condition (18) can deal with constrained fuzzy systems.
Theorem 7 (new sliding mode surface equations). The hyperplane satisfying one of the equations and the conditions in Theorem 3 are the sliding mode surface of (1).
Proof. Condition (21) has been proven in Theorem 3. Condition (22) can be obtained by some basic manipulations of (21).
Since
we get
The above is (22). Since , we get (23). Since , we get (24). That completes the proof.
Remark 8. The sliding mode motion on the sliding mode surface, commonly analyzed by the more complicated equivalent control and the mean motion method, has a specified decay ratio. This ratio is , which can be designed by the designer. It has been illustrated in (23) and (24).
Remark 9. Conditions (12) or (13) are only a special case of condition (18) for the sliding mode existence. If , condition (18) covers conditions (12) or (13) for the sliding mode existence. But condition (18) meanwhile includes the stability.
4. Sliding Mode Robust Receding Horizon Control for Uncertain Constrained Fuzzy Systems
Consider the controlled uncertain constrained fuzzy systems where definitions of and refer to (1) and and are matrices with proper dimensions.
The value function of system (27) is defined as where and are positivedefinite, symmetric weighting matrices.
The setup of the SMC design in this paper is different from conventional ones. First, choose the sliding mode motion’s decay rate . Then construct the global Lyapunov function, that is, the value function , for constrained fuzzy systems. Third, solve . Finally, construct sliding mode control . Coincidentally, this procedure is compatible with MPC schemes.
For those states outside the sliding mode surface, which can be forced into the sliding mode surface, they move along the sliding mode surface to the origin. For those states, which cannot reach the sliding mode surface, they can be stabilized by some form of the optimal control. Thus, the reaching condition and the attraction region are no longer necessary in the SMC design. This idea is illustrated in the following controller design.
4.1. Sliding Mode Model Predictive Control (SMMPC)
Based on Theorems 3 and 7, the sliding mode model predictive controller is designed for the fuzzy system (27) according to the steps listed below.
Step 1. Choose the needed decay rate of the sliding mode motion where is the decay constant.
Step 2. Choose positivedefinite, symmetric matrices and , where Here is the smallest eigenvalue of .
Step 3. Design the running cost
Step 4. Construct the value function (28) according to model predictive control scheme with the infinite horizon:
Step 5. Solve by the FDAST algorithm.
Step 6. Construct the sliding mode model predictive controller by .
For a concise expression, define
where and is the fuzzy membership of . Further, let
Then
Theorem 10. System (27) under the statefeedback sliding mode model predictive controller (36) is stable: where and .
Proof. The first step is to show whether the value function , obtained by solving the optimal control problem (28), can work as a Lyapunov function. Since
we get that , when and . From the above, can work as a Lyapunov function.
It is obvious that the control law (36) satisfies the constraint .
Define . and are defined in (11) where . satisfying (15)–(18) is the sliding mode surface. Consider now the closedloop system of (27) and (36). Evaluating the time derivative of the Lyapunov function along the closedloop trajectory, we obtain
From Theorems 3 and 7, the hyperplane satisfying (21) is the sliding mode plane. Now we classify the points in the state space into two subsets. One is the point belonging to the sliding mode plane. The other is the points outside of the sliding mode plane.
For the subset (i.e., is on the sliding mode plane), since the sliding mode plane cannot be expressed analytically, the commonly used methods such as the equivalent control method cannot work. But we can directly use the Lyapunov method (39) to judge its stability:
Noticing that is the value function, we have
Since , let
For the subset , the following two cases are considered. For the case , we have
Before studying another case, first define
and index sets
Define two parts of the function vector by
For the case and noticing that is the solution to the optimization problem (28), we have
Substituting (41) and (46) into (38), we have
Summarizing all the cases, we have
Then the closedloop system is asymptotically stable. That completes the proof.
Remark 11. The stability of the closedloop system does not depend on whether the state can reach the sliding mode plane or not. From the whole closedloop system view, no matter what states can reach or not reach the sliding mode surface, the closedloop system is stable if and only if the state on the sliding mode plane is stable and the state outside the sliding mode plane is stable. The reaching conditions of the sliding mode plane, which are often used in the stability analysis and the controller design of SMC, do not need to be considered. From another view, the optimal result has integrated the sliding mode motion and the global stability.
4.2. Pseudosliding Mode Model Predictive Controller (PSMMPC)
To keep the features of the optimal control outside the vicinity of the sliding mode surface, a boundary layer (BL) is introduced.
Theorem 12. Consider system (27) under the following bounded nonlinear feedback controller: where is a very small positive number. Then the closedloop system is stable.
Proof. When , the analysis procedures of closedloop stability have been given in Theorem 10. When , the analysis procedures of closedloop stability are the special cases of Theorem 10 when . That completes the proof.
Remark 13. Commonly in literatures, the boundary layer is introduced to eliminate chattering caused by the sliding mode control. But from Theorem 12, the obtained controller (49) is still a sliding mode controller. The chattering problem can be solved by the second introduction of the boundary layer and the system can be stabilized to a specified degree ( is the boundary layer’s width). But motivated by the principle of MPC, we have a more appreciable controller form to avoid chattering without stabilizing errors in the following content.
Since controllers (36) and (49) involved infinite times fast switches in the sliding plane, they cannot be directly applied to practical systems except in the theoretical analysis and in the simulation. Here we briefly recall the basic MPC principle to introduce the nochattering SMMPC/PSMMPC. In general, convectional MPC schemes are formulated as solving online a finite horizon openloop optimal control problem subject to system dynamics and constraints and repeating this procedure at the new sample time. In the sense of conventional MPC schemes, the closedloop control is defined as where is a solution to the openloop optimal control problem. Updating with the new measurement of , the optimization will be solved again to find a new input profile. The exact statefeedback control in conventional MPC is However, from the viewpoint of computation, requires infinite times optimization on the infinite numbers of discrete points in the time interval and only makes sense in the theoretic analysis. For a numerical implementation, the input profile is generally parameterized in a stepshaped manner [29]. This means that the applicable version of conventional MPC is .
Define controllers (36) and (49) as where and , respectively. The applicable version of in the vicinity of the sliding mode plane should have a similar form to . This idea is expressed in Theorem 14.
Theorem 14. Define controllers (36) and (49) as where and , respectively. Define . Nochattering PSMMPC has the following form: where , and . Under the same conditions of Theorems 10 and 12, when , closedloop system (27) and (52) is stable.
Proof. Let For and , it is obvious that That completes the proof.
Remark 15. Theorem 14 means that if we select a suitable small time interval , the controller (52) can keep the stability property of (36) and (49) and at the same time avoid chattering in the sliding mode plane.
Remark 16. Control strategies defined in (36), (49), and (52) are not directly implementable since they involve the exact solution of the value function . Generally speaking, the value function and the optimal control for constrained fuzzy systems cannot be solved analytically except for some special demos. If numerical methods are used to solve , the solution is discrete. Since is involved in the controller design, an implementable strategy could be that is approximated by some continuous interpolation of . The interpolation procedures can refer to the corresponding part of [13, 16], so they are omitted.
5. Simulation
In this section, we apply the FDAST algorithm to solve HJB equations and use the value function to implement SMMPC/ PSMMPC for constrained fuzzy systems.
Example 1. The nonlinear system in [29, 35] is where .
System (55) can be modeled by the following TS type constrained fuzzy system in the zone : The zone is divided into four cells: , and , where , , , and . The triangle membership functions on and are Parameters in fuzzy rules are shown in Table 1 and are as follows:

The decay constant of the sliding mode motion is set to . Then, choose and . Now suppose the optimal zone is . Choose , , , , and in optimization. Figures 2 and 3 show the numerical solution to with the indicated unstabilized zone in and its contour, respectively.
Choose to implement . Initial states are , , , and .
Figure 4 shows closedloop trajectories under SMMPC (36) with and . Figure 5 shows closedloop trajectories under SMMPC (36) with and . Comparing Figure 4 with Figure 5, it is easy to identify the sliding mode surface labeled in Figure 5.
Figure 6 shows closedloop trajectories under SMMPC (36) with and . Figure 7 shows closedloop trajectories under PSMMPC (52) with , , , and . Comparing Figure 6 with Figure 7, it is shown that the chattering is avoided in Figure 7.
Example 2. The inverted pendulum system in [3] can be formulated as where is the acceleration due to gravity, , is the mass of cart, is the mass of pole, is the half length of pole, and is the applied force (control).
According to the study in [3], the nonlinear system can be described by the following TS type fuzzy system:
The fuzzy rules are Here, , , , and are fuzzy sets and The membership functions on fuzzy sets are and for the values of , , , , , , , and , please refer to [3] pages 14–23.
The decay constant of the sliding mode motion is set to . Then, choose and . Now suppose that the optimal zone is . Choose , , and in optimization. Figures 8 and 9 show in and its contour, respectively. The unstabilized zones are indicated in Figure 9.
Initial states are , , , and . Figure 10 shows closedloop trajectories under SMMPC (36) with and . Figure 11 shows closedloop trajectories under SMMPC (36) with and . The sliding mode surface is indicated in Figure 11.
Figure 12 shows closedloop trajectories under SMMPC (36) with and . Figure 13 shows closedloop trajectories under PSMMPC (52) with , , , and . The chattering is avoided in Figure 13.
6. Conclusion
In this paper, the optimal control problem of constrained fuzzy systems is connected to the sliding mode control by the optimal value function. New conditions for the existence and the global stability of a sliding mode are proposed for constrained fuzzy systems. The new conditions not only cover current conditions for the existence of a sliding mode but also integrate the stability. They can be used in the SMMPC and PSMMPC designs. In the design procedure, the value function solved by the FDAST algorithm is used as a design parameter. Those controllers are statefeedback MPC and also SMC. From the viewpoint of SMC, the setup is different from other SMC. The sliding mode surface need not be selected previously. Only the decay rate needs to be specified. Sliding mode reaching conditions are not necessary in the SMC design. The obtained controllers are globally stable. Therefore, they can avoid limitations on the stable zone due to selections of the sliding mode surface and sliding mode reaching conditions. From the viewpoint of MPC, they are infinite time horizon MPC schemes. The terminal constraints and penalties, which are manually added to guarantee the stability, are removed. The closedloop stability does not depend on the feasibility of the initial point. Those control schemes are real time.
Current researches focus on a further reduction on the computational burden in optimization, on adaptive control schemes for constrained fuzzy systems, and on controller structures of more general fuzzy systems.
Conflict of Interests
The author declares that there is no conflict of interests regarding the publication of this paper.
Acknowledgments
The author would like to thank the reviewers for their constructive comments and the financial support given by the National Natural Science Foundation of China (nos. 61273010 and 60974141).
References
 L. X. Wang, A Course in Fuzzy Systems and Control, Printice Hall, Upper Saddle River, NJ, USA, 1997.
 H. G. Zhang, M. Li, J. Yang, and D. D. Yang, “Fuzzy modelbased robust networked control for a class of nonlinear systems,” IEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans, vol. 39, no. 2, pp. 437–447, 2009. View at: Publisher Site  Google Scholar
 K. Tanaka and H. O. Wang, Fuzzy Control Systems Design and Analysis: A Linear Matrix Inequality Approach, John Wiley & Sons, New York, NY, USA, 2001.
 L.X. Wang and J. M. Mendel, “Fuzzy basis functions, universal approximation, and orthogonal leastsquares learning,” IEEE Transactions on Neural Networks, vol. 3, no. 5, pp. 807–814, 1992. View at: Publisher Site  Google Scholar
 H. G. Zhang, Y. Wang, and D. Liu, “Delaydependent guaranteed cost control for uncertain stochastic fuzzy systems with multiple time delays,” IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 38, no. 1, pp. 126–140, 2008. View at: Publisher Site  Google Scholar
 S. G. Cao, N. W. Rees, and G. Feng, “Analysis and design for a class of complex control systems. I. Fuzzy modelling and identification,” Automatica, vol. 33, no. 6, pp. 1017–1028, 1997. View at: Publisher Site  Google Scholar  MathSciNet
 H. G. Zhang and X. P. Xie, “Relaxed stability conditions for continuoustime TS fuzzycontrol systems via augmented multiindexed matrix approach,” IEEE Transactions on Fuzzy Systems, vol. 19, no. 3, pp. 478–492, 2011. View at: Publisher Site  Google Scholar
 Y. Wang, H. G. Zhang, X. Y. Wang, and D. S. Yang, “Networked synchronization control of coupled dynamic networks with timevarying delay,” IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 40, no. 6, pp. 1468–1479, 2010. View at: Publisher Site  Google Scholar
 H. G. Zhang, S. X. Lun, and D. Liu, “Fuzzy ${\mathrm{H}}_{\infty}$ filter design for a class of nonlinear discretetime systems with multiple time delays,” IEEE Transactions on Fuzzy Systems, vol. 15, no. 3, pp. 453–469, 2007. View at: Publisher Site  Google Scholar
 S. J. Wu and C. T. Lin, “Optimal fuzzy controller design: local concept approach,” IEEE Transactions on Fuzzy Systems, vol. 8, no. 2, pp. 171–185, 2000. View at: Publisher Site  Google Scholar
 S. J. Wu and C. T. Lin, “Optimal fuzzy controller design in continuous fuzzy system: global concept approach,” IEEE Transactions on Fuzzy Systems, vol. 8, no. 6, pp. 713–729, 2000. View at: Publisher Site  Google Scholar
 C. H. Song and T. Y. Chai, “Comment on ‘Discretetime optimal fuzzy controller design: global concept approach’,” IEEE Transactions on Fuzzy Systems, vol. 13, no. 2, pp. 285–286, 2005. View at: Publisher Site  Google Scholar
 C. H. Song, J. C. Ye, D. R. Liu, and Q. Kang, “Generalized receding horizon control of fuzzy systems based on numerical optimization algorithm,” IEEE Transactions on Fuzzy Systems, vol. 17, no. 6, pp. 1336–1352, 2009. View at: Publisher Site  Google Scholar
 C. H. Song, C. Y. Bian, X. Zhang, and C. L. Shi, “Numerical optimization method for HJI equations derived from robust receding horizon control schemes and controller design,” Science China. Information Sciences, vol. 55, no. 1, pp. 214–227, 2012. View at: Publisher Site  Google Scholar  MathSciNet
 C. H. Song and J. C. Ye, “Robust receding horizon control of uncertain fuzzy systems,” Neural Computing and Applications, vol. 22, no. 2, pp. 237–247, 2013. View at: Publisher Site  Google Scholar
 C. H. Song, “Numerical optimization method for HJB equations with its application to receding horizon control schemes,” in Proceedings of the 48th IEEE Conference on Decision and Control Held Jointly with the 28th Chinese Control Conference (CDC/CCC '09), pp. 333–338, Shanghai, China, December 2009. View at: Publisher Site  Google Scholar
 G. Barles and P. E. Souganidis, “Convergence of approximation schemes for fully nonlinear second order equations,” Asymptotic Analysis, vol. 4, no. 3, pp. 271–283, 1991. View at: Google Scholar  MathSciNet
 J. C. Ye, Optimal life insurance purchase, consumption and portfolio under an uncertain life [Ph.D. Dissertation], Department of Mathematics, Statistics and Computer Science, University of Illinois at Chicago, Chicago, Ill, USA, 2006.
 H. J. Kushner and P. Dupuis, Numerical Methods for Stochastic Control Problems in Continuous Time, Springer, New York, NY, USA, 2nd edition, 2001.
 Q. S. Song, “Convergence of Markov chain approximation on generalized HJB equation and its applications,” Automatica, vol. 44, no. 3, pp. 761–766, 2008. View at: Publisher Site  Google Scholar  MathSciNet
 W. Fleming and H. Soner, Controlled Markov Processes and Viscosity Solutions, Springer, New York, NY, USA, 2nd edition, 2006. View at: MathSciNet
 H. G. Zhang, F. S. Yang, X. D. Liu, and Q. L. Zhang, “Stability analysis for neural networks with timevarying delay based on quadratic convex combination,” IEEE Transactions on Neural Networks and Learning Systems, vol. 24, no. 4, pp. 513–521, 2013. View at: Publisher Site  Google Scholar
 F.Y. Wang, H. G. Zhang, and D. Liu, “Adaptive dynamic programming: an introduction,” IEEE Computational Intelligence Magazine, vol. 4, no. 2, pp. 39–47, 2009. View at: Publisher Site  Google Scholar
 H. Zhang, Y. Luo, and D. Liu, “Neuralnetworkbased nearoptimal control for a class of discretetime affine nonlinear systems with control constraints,” IEEE Transactions on Neural Networks, vol. 20, no. 9, pp. 1490–1503, 2009. View at: Publisher Site  Google Scholar
 H. Zhang, Q. Wei, and Y. Luo, “A novel infinitetime optimal tracking control scheme for a class of discretetime nonlinear systems via the greedy HDP iteration algorithm,” IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 38, no. 4, pp. 937–942, 2008. View at: Publisher Site  Google Scholar
 C. E. García, D. M. Prett, and M. Morari, “Model predictive control: theory and practice—a survey,” Automatica, vol. 25, no. 3, pp. 335–348, 1989. View at: Publisher Site  Google Scholar
 R. R. Bitmead, M. Gevers, and V. Wertz, Adaptive Optimal Control: The Thinking Man's GPC, Prentice Hall, Englewood Cliffs, NJ, USA, 1990.
 M. Morari and J. H. Lee, “Model predictive control: past, present and future,” Computers and Chemical Engineering, vol. 23, no. 45, pp. 667–682, 1999. View at: Publisher Site  Google Scholar
 H. Chen and F. Allgöwer, “A quasiinfinite horizon nonlinear model predictive control scheme with guaranteed stability,” Automatica, vol. 34, no. 10, pp. 1205–1217, 1998. View at: Publisher Site  Google Scholar  MathSciNet
 J. B. Rawlings and K. R. Muske, “The stability of constrained receding horizon control,” IEEE Transactions on Automatic Control, vol. 38, no. 10, pp. 1512–1516, 1993. View at: Publisher Site  Google Scholar  MathSciNet
 J. Rawling, E. Meadows, and K. Muske, “Nonlinear model predictive control: a tutorial and survey,” in Proceeding of the International Symposium on Advanced Control of Chemical Processes (IFAC ADCHEM '94), pp. 185–197, 1994. View at: Google Scholar
 J. Richalet, A. Rault, J. L. Testud, and J. Papon, “Model predictive heuristic control: applications to industrial processes,” Automatica, vol. 14, no. 5, pp. 413–428, 1978. View at: Publisher Site  Google Scholar
 J. Richalet, “Industrial applications of model based predictive control,” Automatica, vol. 29, no. 5, pp. 1251–1274, 1993. View at: Publisher Site  Google Scholar  MathSciNet
 E. Polak and T. H. Yang, “Moving horizon control of linear systems with input saturation and plant uncertainty. I. Robustness,” International Journal of Control, vol. 58, no. 3, pp. 613–638, 1993. View at: Publisher Site  Google Scholar  MathSciNet
 D. Q. Mayne and H. Michalska, “Receding horizon control of nonlinear systems,” IEEE Transactions on Automatic Control, vol. 35, no. 7, pp. 814–824, 1990. View at: Publisher Site  Google Scholar  MathSciNet
 H. Michalska and D. Q. Mayne, “Robust receding horizon control of constrained nonlinear systems,” IEEE Transactions on Automatic Control, vol. 38, no. 11, pp. 1623–1633, 1993. View at: Publisher Site  Google Scholar  MathSciNet
 P. Mhaskar, N. H. ElFarra, and P. D. Christofides, “Predictive control of switched nonlinear systems with scheduled mode transitions,” IEEE Transactions on Automatic Control, vol. 50, no. 11, pp. 1670–1680, 2005. View at: Publisher Site  Google Scholar  MathSciNet
 M. A. Henson, “Nonlinear model predictive control: current status and future directions,” Computers & Chemical Engineering, vol. 23, no. 2, pp. 187–202, 1998. View at: Publisher Site  Google Scholar
 V. I. Utkin, “Variable structure systems with sliding modes,” IEEE Transactions on Automatic Control, vol. 22, no. 2, pp. 212–222, 1977. View at: Google Scholar  MathSciNet
 V. I. Utkin, “Sliding mode control design principles and applications to electric drives,” IEEE Transactions on Industrial Electronics, vol. 40, no. 1, pp. 23–36, 1993. View at: Publisher Site  Google Scholar
 K. D. Young, V. I. Utkin, and Ü. Özgüner, “A control engineer's guide to sliding mode control,” IEEE Transactions on Control Systems Technology, vol. 7, no. 3, pp. 328–342, 1999. View at: Publisher Site  Google Scholar
 Y. Cao and W. Ren, “Distributed coordinated tracking with reduced interaction via a variable structure approach,” IEEE Transactions on Automatic Control, vol. 57, no. 1, pp. 33–48, 2012. View at: Publisher Site  Google Scholar  MathSciNet
 A. Isidori, Nonlinear Control Systems: An Introduction, Springer, New York, NY, USA, 2nd edition, 1989.
Copyright
Copyright © 2015 Chonghui Song. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.