Robust Control with Engineering ApplicationsView this Special Issue
Robust Adaptive Control for Nonlinear Discrete-Time Systems by Using Multiple Models
Back propagation (BP) neural network is used to approximate the dynamic character of nonlinear discrete-time system. Considering the unmodeling dynamics of the system, the weights of neural network are updated by using a dead-zone algorithm and a robust adaptive controller based on the BP neural network is proposed. For the situation that jumping change parameters exist, multiple neural networks with multiple weights are built to cover the uncertainty of parameters, and multiple controllers based on these models are set up. At every sample time, a performance index function based on the identification error will be used to choose the optimal model and the corresponding controller. Different kinds of combinations of fixed model and adaptive model will be used for robust multiple models adaptive control (MMAC). The proof of stability and convergence of MMAC are given, and the significant efficacy of the proposed methods is tested by simulation.
Due to the strong ability of approximation, neural network has been widely used in the identification of nonlinear system. It is also a very useful tool for prediction, pattern recognition, and control . The network structure comprises the interconnected group of nodes and the weight. There are many kinds of neural networks such as back propagation (BP), radial basis function (RBF), cerebellar model articulation controller (CMAC). As the most effective learning algorithm for feedforward networks , BP neural network has been the research focus for many years [3–6].
Adaptive control of nonlinear systems using neural network has been an active research area for over two decades [7–9]. The controller will be set up by adjusting the weights of the neural network [10, 11]. But adaptive control using neural network still has the same shortcomings as conventional adaptive control; it is extensively studied in time-invariant system with unknown parameters or time-variant system with slow drifting parameters [12, 13]. While the system has abrupt changes in parameters, the algorithm cannot find the exact identification model and will respond slowly to system parameter variations. To solve this kind of problem, MMAC has been a very useful tool in recent years.
Since MMAC was presented in 1970s, it has attracted a lot of attention of experts [14–17]. MMAC is an effective approach to solve problems such as time variations and uncertainties. It has the ability to improve the transient responses and the control performance. According to the dynamic character of controlled plant, multiple models are set up to cover the uncertainty of parameter. Much research has been done on continuous-time and discrete-time linear systems [18, 19]. For nonlinear system, only a few results have been given. In recent years, the MMAC based on neural network has been considered by some researchers [20, 21]. But in these papers, the nonlinear system has been modeled by the combination of linear model (the main part) and neural network model (the unmodeled dynamics). The multiple models are still multiple linear models with different parameters, and neural network is used only to compensate for the modeling error of linear model. In this case, the nonlinear system should not be very complex, and too big modeling error between the system and linear model is forbidden. The parameter and structure uncertainty of a relatively complex nonlinear system cannot be modeled by this method. This kind of MMAC with neural network still follows the main ideas of linear MMAC.
In this paper, a kind of robust MMAC is proposed for nonlinear system. Multiple BP neural networks with different weights will be used to cover the uncertainty of the parameters of the system. A performance index function based on the identification errors will be used to choose the best model and the corresponding controller. Considering the unmodeling error of neural network, a dead-zone recursive algorithm will be used, and the proof of robust property and stability of the MMAC are given. Different combinations of adaptive models and fixed models will be used for MMAC, and the effectiveness of the proposed method has been tested in simulations.
2. Robust Adaptive Control Using Neural Network
The single-input/single-output nonlinear discrete-time system can be represented as follows: where and are infinitely differentiable functions of where is the output, is the input, , is the relative degree of the system, and is bounded away from zero. The arguments of and are real variables.
Due to the existence of noncausal problem, normally state transformation should be made first , and a causal system as follows can be given: Assumptions 1 and 2 in  about and minimum phase assumption should still be satisfied.
As Assumption 3 in , there exist the weights , of neural network; the functions and can approximate the functions and with any accuracy .
Plant (3) can be modeled by the neural network.
Consider The functions and depend on the structure of the neural network and the number of neurons. For example, if and are three-layer neural networks with and hidden neurons, respectively, then they can be expressed as where is a hyperbolic tangent function.
Let and denote the estimates of and at time . Rewrite (3) and (4) as follows: We have the estimated plant output as: Define as If the neural network could approximate the nonlinear system with zero error; that is, , the following weight updating rule can be used: where and is the reference command. One has Due to the existence of unmodeling dynamics , the design of robust adaptive controller should be considered. A dead-zone algorithm will be used instead of (9) for updating the weights. Therefor, where will be the function of which can be seen in proof procedure of the Theorem 1.
The output of the dead-zone function is used in the following updating rule: Define the parameter error as and give the control as follows: We have Theorem 1 for the feedback control system.
Theorem 1 (see ). Suppose for all . Given any constant and any small constant , there exist positive constants , , , and such that if Assumptions 1 and 3 are satisfied on , with , Assumption 2 is satisfied on , , and , then(1) the and are bounded for all ,(2) will be monotonically nonincreasing, and will converge to zero,(3),(4) the tracking error between the plant output and the reference command will converge to a ball of radius centered at the origin.
3. Robust Multiple Model Adaptive Control
The conventional adaptive control systems are usually based on a fixed or slowly adaptive model. It cannot react quickly to abrupt changes and will result in large transient errors before convergence. For this kind of problem, MMAC algorithm is presented as a useful tool. The rationale for using MMAC is to ensure that there is at least one model with parameters sufficiently close to those of the unknown plant. By the switching rule, the control strategy is to determine the best model for the current environment at every instant and activate the corresponding controller. The structure of the multiple model adaptive control is shown in Figure 1.
3.1. Architecture of the Control System
Multiple adaptive models can be regarded as an extension of conventional indirect adaptive control. The objective is to make the control error tend to zero, where is the desired output. The control system contains identification models, denoted by , according to (7), operating in parallel. Consider the following: where The identification error between the output of and of the plant is denoted as . Corresponding to each is a parameterized controller which achieves the control objective for . The output of is denoted by .
One has where , and is the reference command.
At every instant, one of the models is selected by a switching rule, and the corresponding control input is used to control the plant.
Given prior knowledge of the different possible environments, the control problem is to determine suitable rules for switching and tuning these parameters to yield the best performance for the given objective while assuring stability.
3.2. Choice of Multiple Models
The following three different combinations have been considered .
3.2.1. Adaptive Models
adaptive models with different initial parameter values can be viewed as an extension of conventional indirect adaptive control. When the parameters of the plant change abruptly, the change can be detected by identification error. Then, the parameters of models are reset to initial values, and the model with the smallest error is selected. Hence, we can construct multiple adaptive models with different initial parameters which adjust dynamically in any instant. The method was considered in detail in [8, 19].
3.2.2. Fixed Models and One Adaptive Model
The previous method reveals that massive calculation may be produced because each adaptive model needs to adjust dynamically. Hence, if the models are fixed, the same strategy can be used in stationary and time-varying environments. However, fixed models can represent exactly only a finite number of environments. Thus, parallel fixed model and one adaptive model are combined, and the efficiency can be improved by the multiple fixed models and the accuracy can be increased by the adaptive model.
3.2.3. Fixed Models, One Free Running Adaptive Model, and One Reinitialized Adaptive Model
It is commonly accepted that the convergence time of an adaptive model will be large for large initial parametric errors. Hence, in the configuration described above, a large number of fixed models may be needed to keep the transient response under control until the adaptive model has converged. If the fixed model, which is the closest to the given plant, is assumed to be known, faster convergence can be obtained by initiating a new adaptive model from the location of the former. The same objective can be achieved on-line by starting adaptation from the location of each different fixed model that is successively chosen by the switching scheme.
The reinitialized adaptive model included is introduced, and its parameters are determined as follows: if a fixed model , , is activated by the switching rule at any instant , then the parameters of are reinitialized to the value of . Thereafter, this adaptive model will be left to adapt until the next reinitialization.
3.3. Choice of the Switching Rule
A natural way to decide when and to which controller one should switch is to determine performance cost indexes for each controller , , and switch to the one with the minimum index at every instant. However, since only one control input can be used at any instant, the performance of any candidate controller can be evaluated only after it has been used. On the other hand, the performance of all the identification models can be evaluated in parallel at every instant. Hence, the indexes must be based on the performance of the models rather than the controllers, that is, using identification errors rather than the control error . From an adaptive control point of view, this rationale extends the principle of certainty equivalence from tuning to switching.
Considering the unmodeling error of neural network and robustness of the adaptive controller, the specific performance index proposed has the form where .
The switching scheme consists of monitoring the performance indexes at every instant. After every switching, the controller corresponding to the model with the minimum index is chosen (switched) to control the plant.
Theorem 2. Suppose for all . Given any constant , for all the model (adaptive model or fixed model), if , , , and the conditions in Theorem 1 are satisfied, then when index switching (19) is used,(1)all the signals in the system are bounded,(2)the tracking error between and
3.4. Proof of the Multiple Models Stability
3.4.1. Adaptive Model
At time , th adaptive model will be selected, .
The control input From Theorem 1, if , , with control input (21), we can have that and are bounded, for all , and Then, the control error at time is given by Let one of controller be chosen at random, for any instant of time and any model chosen; then (24) holds.
So we have all the signals in the system bounded, and(1),(2).
3.4.2. Fixed Model and One Adaptive Model
Consider the following index function: At every instant , model , will be selected.
Proof. From Theorem 1, we have that, for adaptive model,
For the fixed models , is either bounded or , if the performance index tends to ; there exist a time , , , which implies that the adaptive model will be selected finally.
If is bounded, then If the fixed model is selected, the relationship of ,, in Theorem 1 is satisfied; the proof procedure will be similar to that of multiple adaptive controller. We also have the following:(1) all the signals in the system are bounded,(2),(3).
3.4.3. Fixed Model, One Free Running Adaptive Model, and One Reinitialized Adaptive Model
The introduction of the reinitialized adaptive model will not affect the stability of the whole system, and the proof of the stability will be similar to the case of fixed model and one adaptive model.
4.1. The Problem
PH neutralization is a very important procedure in the chemical industry. Usually, we use the logarithmic behavior to present pH characteristic; the existing nonlinearity always makes the identification and control of pH neutralization more difficult. A strong acid flows into a tank and is thoroughly mixed with a strong base whose inward rate of flow is controlled in such a way to produce a neutral outward flow from the tank. Because the acid and the base are strong, they are completely dissociated, and also the dissociation of the water can be disregarded . The equation describing this model is where is the distance from neutrality, volume of the tank, rate of flow of the acid, concentration of the acid, rate of flow of the base, concentration of the base.Note that pH value can be determined from the , pH by the following nonlinear transformation: where water equilibrium constant .
We suppose that and are fixed and known, that can be measured online, and that can be given assigned values within certain limits.
An approximate discrete-time model can be developed, incorporating measurement and input actuator errors, as follows: The following values were adopted for the various quantities of interest: Then our goal is to control the plant as follows: where is the variable parameter. And the single-input/single-output nonlinear discrete-time system represented as (1) can be modeled by where and are the output of neural network.
The neural networks and are 3 layered with 4 neurons in each hidden layer. Based on the error between the plant output and the model output , the network parameters and are updated to and using the standard back propagation algorithm.
Adaptive Model Only. In the process of parameter identification, let , , , , the reference command (according to (31), ), and . The initial weights and are given a random number in the range. The identification results are shown in Figure 2.
|(a) System output pH|
|(b) Control input|
After 300 sample times, the weights will converge to the following values: Now, we consider a worse case of the plant where abruptly changing parameters appear: Given the initial weights as the convergent weights of and in (36).
As the parameters change at and , the overshoot of the system is big and the settling time is long. The nonlinear system cannot track the reference trajectory in time (Figure 3). When MMAC is used, the following simulation results can be obtained.
|(a) System output pH|
|(b) Control input|
4.2.1. Three Adaptive Models
Three adaptive models , , and are established. According to the three different values of obtained, each group of weights can be got using the same method as that in (36). One has
The multiple models based on neural networks are chosen as in (16). Figures 4(a) and 4(b) present the responses of the plant. Switching sequence of controllers is shown in Figure 4(c). Obviously, this method can track the reference trajectory fast and improve the transient response. According to the index function, the system can choose an approximate model to identify the unknown plant. Once the parameters change, the weights and the index functions of neural network models will be initialized and the system will choose the optimal model again to conduct identification. In this way, the overshoot of the system can be decreased and the reference trajectory can be tracked fast at the same time.
|(a) System output pH|
|(b) Control input|
(c) Switching scheme
4.2.2. Three Fixed Models and One Adaptive Model
In this case, three fixed models , , and are used to improve the transient response, and one adaptive model is used to guarantee the stability. The initial weights of the three fixed models are the same as those of the three adaptive models, and the weights of one adaptive model are equal to those of.
In the process of parameter identification, this method could improve the transient response compared with the conventional adaptive control (Figures 5(a) and 5(b)). Switching sequence of controllers is shown in Figure 5(c). Once the parameter changes abruptly at 100 or 200, the controller will switch to the nearest fixed model , to reduce the error. When the adaptive model gradually converges to the true value, the system will switch to the adaptive model . Multiple fixed models play a transitional role in the process of identification. This method can reduce massive calculation compared with the case of three adaptive models, but it produces a larger overshoot compared with Figures 4(a) and 4(b).
|(a) System output pH|
|(b) Control input|
(c) Switching scheme
4.2.3. Three Fixed Models, One Free Running Adaptive Model, and One Reinitialized Adaptive Model
In this case, we establish three fixed models , , and with different initial weights; is the free adaptive model and is the reinitialized adaptive model. The reinitialized adaptive model can achieve the initial weights by choosing a set of fixed models based on the past performance of the plant. If at any instant one of them is determined to be the best, the reinitialized adaptive model can be adapted from this model.
From the simulation, we can see that this method can improve the control quality dramatically (Figures 6(a) and 4(b)). Switching sequence of controllers is shown in Figure 6(c). Compared with the other algorithm proposed before, this method show perfect performance in reducing the overshoot and tracking the reference trajectory, and computation time is reduced greatly.
|(a) System output pH|
|(b) Control input|
(c) Switching scheme
In this paper, multiple models are used to establish robust multiple models adaptive controller for a class of nonlinear discrete-time systems by using neural networks. Three kinds of combinations of adaptive model and fixed model are used to make the multiple model set, and a switching law is suitably defined to make the decision of the best model. The principal contribution of this paper is the proof of stability of robust MMAC by using neural networks. Multiple neural network models with different weights represent different dynamical characters of the plant when it operates in different environments, which can be described by a mount of input and output data. So the design of the model set can also be regarded as a kind of data driven problem [24, 25]. How to divide the region of data into suitable numbers of subregions which can be represented by multiple neural network models will decide the accuracy of MMAC. A moving or dynamically optimal model set will be an important problem that needs to be solved in the future.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
This work was supported by the Fundamental Research Funds for the Central Universities under Grant FRF-TP-12-005B, the Program for New Century Excellent Talents in Universities under Grant NCET-11-0578, and the National Natural Science Foundation of China under Grant 61074055.
M. Arvaneh, C. Guan, K. K. Ang, and C. Quek, “Optimizing spatial filters by minimizing within-class dissimilarities in electroencephalogram-based brain—computer interface,” IEEE Transactions on Neural Networks and Learning Systems, vol. 24, no. 4, pp. 610–619, 2013.View at: Publisher Site | Google Scholar
K. J. Astrom and B. Wittenmark, Adaptive Control, Addison-Wesley, Longman Publishing, Boston, Mass, USA, 1995.
K. S. Narendra and A. Annaswamy, Stable Adaptive Systems, Prentice-Hall, Englewood Cliffs, NJ, USA, 1989.
P. A. Ioannou and J. Sun, Robust Adaptive Control, Prentice-Hall, Upper Saddle River, NJ, USA, 1996.
W. Wang and X. L. Li, Multiple Model Adaptive Control, Science Press, Beijing, China, 2001.
M. Athans, D. Castanon, K.-P. Dunn et al., “The stochastic control of the F-8C aircraft using a multiple model adaptive control (MMAC) method—part I: equilibrium flight,” IEEE Transactions on Automatic Control, vol. 22, no. 5, pp. 768–780, 1977.View at: Google Scholar
G. C. Goodwin and K. S. Sin, Adaptive Filtering Prediction and Control, Prentice-Hall, Englewood Cliffs, NJ, USA, 1984.