- About this Journal
- Abstracting and Indexing
- Aims and Scope
- Annual Issues
- Article Processing Charges
- Articles in Press
- Author Guidelines
- Bibliographic Information
- Citations to this Journal
- Contact Information
- Editorial Board
- Editorial Workflow
- Free eTOC Alerts
- Publication Ethics
- Reviewers Acknowledgment
- Submit a Manuscript
- Subscription Information
- Table of Contents
Abstract and Applied Analysis
Volume 2013 (2013), Article ID 684642, 13 pages
Stability Analysis of High-Order Iterative Learning Control for a Class of Nonlinear Switched Systems
1School of Electrical Engineering & Automation, Henan Polytechnic University, Jiaozuo 454003, China
2Henan Provincial Open Laboratory for Control Engineering Key Discipline, Henan Polytechnic University, Jiaozuo 454003, China
Received 22 March 2013; Revised 18 June 2013; Accepted 18 June 2013
Academic Editor: Josef Diblík
Copyright © 2013 Xuhui Bu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
This paper considers the stability of high-order PID-type iterative learning control law for a class of nonlinear switched systems with state delays and arbitrary switched rules, which perform a given task repeatedly. The stability condition for the proposed high-order learning control law is first established, and then the stability is analyzed based on contraction mapping approach in the sense of norm. It is shown that the proposed iterative learning control law can guarantee the asymptotic convergence of the tracking error for the entire time interval through the iterative learning process. Two examples are given to illustrate the effectiveness of the proposed approach.
A switched system is a hybrid dynamical system, which consists of a family of continuous-time or discrete-time subsystems and a rule that orchestrates the switching between them. During the past decades, switched systems have been widely studied, and many interesting results have been reported in the literature, for instance [1–3] and the references therein. The motivation to study switched systems is mainly in twofold. First of all, many engineering systems can be represented by switched systems, such as networked control systems (NCS) [4, 5], traffic control , automotive engine control, and aircraft control . Secondly, the idea of controller switching is introduced in order to overcome the shortcomings of the single controller and improve system performance [8, 9]. Some methods have been used in the study of switched systems such as the multiple Lyapunov functions [10, 11], the concept of average dwell time , and piecewise quadratic Lyapunov functions .
Recent researches in switched system typically focus on the analysis of dynamic behaviors, such as stability , controllability, reachability [15, 16], and observability  aiming to design controllers with guaranteed stability and performance [18, 19]. Besides the aforementioned problem, designing a controller to achieve tracking for switched systems is a challenging problem [20–22]. In , the tracking control problem for switched linear systems with time-varying delays is investigated, and the average dwell time approach and piecewise Lyapunov functional methods are utilized to the stability analysis and controller design. In , an observer-based tracking control approach is proposed for switched linear time-varying delay systems with unavailable states. The single Lyapunov-Krasovskii functional method is utilized to the stability analysis and controller design. In , the tracking control problem for switched nonlinear systems subject to an output constraint is considered. It is worth pointing out that most of these approaches are given based on the accurate model of nonlinear switched systems, and thus their control performances depend on the accuracy of the models. In addition, various unmodelled dynamics and uncertainties always exist in practical systems. The above-mentioned model-based control approaches for switched systems may lead to bad performance or cause closed-loop system unstable in practice. Therefore, it is necessary and practical to design tracking control methods for switched systems requiring less knowledge about the system dynamics.
Fortunately, for repetitive systems, iterative learning control (ILC) offers a systematic design that can improve the tracking performance by iterations in a fixed time interval. The key feature of this technique is to use information from the previous operation in order to enable the controlled system to perform better progressively from operation to operation. It seems that the main advantage of the iterative learning control strategy is to require less a priori knowledge about the system dynamics and less computational effort than many other types of control strategies. Hence, iterative learning control for repetitive dynamical systems has received considerable attention, and it has made significant progresses over the past two decades (see [23–30] and references therein). However, to the best of our knowledge, no one has been studied the iterative learning control for switched systems. This observation motivates the present study.
In practice, some switched systems are in general repeated, such as traffic system and batch process with multiprocedure. The traffic system can be viewed as a switched system . We may easily find that traffic flow patterns in two consecutive days, or the same weekday of two consecutive weeks, are very close. Ruling out the occasional occurrence of accidents, the routine traffic flow on freeway in the macroscopic level will show inherent repeatability every day. Likely we can find the similarities on a monthly basis, or even a yearly basis . For the batch process with multiprocedure, the system can also be considered as a switched system, and the different procedures represent the different subsystems. If the product is batch processing, then the switched system is operated repetitively. In this paper, the problem of iterative learning control for a class of nonlinear switched systems with arbitrary switched rules is considered. Despite much progress, significant research remains to be done in the direction of linear switched systems, especially since the majority of practical switched systems exhibit inherently nonlinear dynamics and delays [31–33]. Hence, we are focusing on ILC for nonlinear switched systems with time delay.
Most of the existing ILC schemes are based on the first-order updating laws; that is, only the information of one previous iteration is employed.  used a high-order ILC law for tracking control of nonlinear systems, where, to form the control in current iteration, the information of several previous learning iterations, including control functions, tracking errors as well as their derivatives, is used. It is demonstrated that high-order ILC schemes have potential to give a better convergence performance than the first-order ILC schemes. Therefore, it is beneficial to investigate high-order ILC schemes for the tracking control of nonlinear switched systems.
The rest of this paper is organized as follows. In Section 2, the problem formulation is described. In Section 3, a sufficient condition which guarantees the stability of high-order PID-type ILC for the nonlinear switched ILC system is given. In Section 4, two examples are presented to validate the theoretical results. Finally, some conclusions are given in Section 5.
2. Problem Formulation
Consider a nonlinear switched system with time delay, which performs a given task repeatedly, as follows: where denotes the th repetitive operation of the system. is the state vector, is the input vector, and is the output vector. is the finite time interval, and are known time delay. is a switching signal, that is, a piecewise constant function. is the number of models (called subsystems) of the switched system. The vector nonlinear function , , and matrix function have appropriate dimensions. In this paper, we assume is an arbitrary switched rule on the time domain, and it is invariable on the iteration domain, that means the functions ( and ) are allowed to take values, at an arbitrary discrete time, in the finite set In this case, the nonlinear switched system (1) can be described as
Basic assumptions for the nonlinear switched system are given as follows.
Assumption 1. For a desired trajectory , it exists and satisfying where is the desired input and is the desired state.
Assumption 2. The nonlinear function , , is uniformly globally Lipschitz in on interval , that is, for all , constants such that for any pair , where .
Assumption 3. The resetting condition is satisfied for all the iteration; that is, where and is the desired initial function.
Remark 4. From Assumption 1, since exists uniquely, the uniform convergence of the control profile to implies that the state and output tracking errors will vanish. Assumption 2 is a basic condition for switched systems which means that system states are continuous, even for structure switches.
Remark 5. Assumption 3 means for all , which is the identical initial condition for ILC system. For a switched system, even though the dynamic behavior is changing between different subsystems, the initial condition reset is often satisfied in many practical systems. For instance, when a product is processed by several different procedures, then the system can be considered as a switched system, and the different procedures represent the different subsystems. If the product is batch processing, then the switched system is operated repetitively. Even though the processing is changing between different procedures, the initial state of the product is identical.
Remark 6. The switched rule in system (1) is an arbitrary switched rule on the time domain, and it is invariable on the iteration domain. One may argue that the problem considered in this paper is similar to the ILC for time varying nonlinear system. However, there are some crucial differences. The time varying system admits a family of solutions that can be parameterized solely by the initial condition, whereas the switched system admits a family of solutions that is parameterized both by the initial condition and the switching signal. Besides, the switched system has sudden transient at some time instants.
The control target is to find a control input sequence , such that converges to as ; that is, as the learning iteration repeats, the system output converges to the desired trajectory.
Now, the following high-order ILC updating law for the system (3) is proposed which uses the , , and information of tracking errors: where is the tracking error, integer is the order of the ILC law. , , , and are learning gain matrices. The learning operators , , and are chosen to be bounded, and their upper bounds denoted by , , and , respectively, are defined by As usual, it is assumed that and for .
The -norm will be used in this paper. It is defined by for a vector function .
For the sake of brevity, the following notations will be used: where represents a function concerned. The partial derivatives of are denoted by Let be the Lipschitz constant of the function with respect to in . Then it is easy to see that
3. Main Result
Note that the is an arbitrary switching rule during the finite time interval , which is different from the aforementioned studies [14–19]. The switching rule can be described as where is the initial time instant, by default . is the terminal time instant with . denote the switching instants, and the pair which represents subsystem is active during the interval . is the dwell time of the subsystem . Clearly, the control input of overall systems is a piecewise function, and the discontinuity points are those switching instants.
Without loss of generality, we can assume that the arbitrary switching rule is given as Switched sequence (14) implies each subsystem only operated once during the whole interval .
To proof the main result, we first give the following lemmas.
Lemma 7. Suppose that a real positive series satisfies where , and Then the following holds:
Proof. Let be an index number such that . Then, from (15), we have
Similarly, let such that
where and are positive integers. If is chosen such that , then , and therefore when . Let , and then
This completes the proof of Lemma 7.
Lemma 8 ((Bellman-Gronwall lemma) ). Assume that functions are continuous and nonnegative function in . If the following holds: then Now, we can give the following result.
Theorem 9. Consider the nonlinear switched system (3) with switching rule (14), and Assumptions 1–3 are satisfied. If and there exist positive numbers satisfying then the system output converges to the desired output; that is, is ensured as for all .
Proof. Denote , and the ILC law (7) can be rewritten as
From (3), we have where , and where Now, by using ILC updating law (29) and condition (27), we have Taking norms yields where Denoting , from Assumption 3, we have which implies .
Performing the -norm operation for (34) and considering , we can obtain where .
(1) When . In this case, the subsystem is active. From (3) and Assumption 1, we can obtain
Taking norms yields Since , then . From (36) and (39), we have Defining , using Lemma 8 for (40), we have Taking -norm yields where . Combing (37) and (42) yields where By condition (28) in Theorem 9, one can find a sufficiently large such that and . Then, according to Lemma 7, it can be concluded that From (42) and , we can observe that the tracking errors and both tend to zero for when .
(2) When . In this case, the subsystem 2 is active. The state error has the following expression: Taking norms yields Due to the fact that , , we have Using Lemma 8 for (40) and taking -norm yield where . Combing (37) and (49) yields where By condition (28) in Theorem 9, one can find a sufficiently large such that and .
Note that (50) can be rewritten as where .
Let be an iteration number such that Then, from (50), it is easy to see that Similarly, let such that then therefore In general, where and are positive integers. If is chosen such that , then therefore when . Let , then where . Note that means , . From (45), we know that , it also means . Taking for (60) gives Considering and , (61) implies From (49) and , we can also observe that the tracking errors and both tend to zero for when .
In this analogy, , , and can also be obtained for . Hence, for the whole time interval , we have .
This completes the proof.
Remark 10. Theorem 9 is given for the nonlinear switched system with the switched sequence (14), which assumes each subsystem only operated once during the whole interval , and the active sequence for subsystems is . From the proof process of Theorem 9, we know that the result can also be extended to the arbitrary switch sequence with more times active for each subsystem.
Remark 11. High-order ILC updating law utilizes the past experiences comprehensively and has more flexibilities in choosing learning operators and parameters. Hence, the better ILC performance can be expected. If the system dynamics is totally unknown, like the selection of learning parameters in traditional ILC laws, the order selection is also based on a trial-and-error method, which should be also in an iterative learning way. In practice, should normally be chosen to be less than or equal to 3.
Remark 12. In many practical systems, stochastic disturbances are unavoidable [36–38]. In this case, the nonlinear switched system (1) can be described by where and are state disturbances and output disturbances, respectively. If the disturbances are bounded in the sense of and for all , where , and are positive constants, from the proof of Theorem 9, it is easy obtained that, when the PID ILC law (7) is used for system (63), if the conditions in Theorem 9 are guaranteed, then the system output converges to the desired output with a bounded error. The error bound depends on the and . The similar results can also be founded in ILC for general nonlinear systems with disturbances [39, 40].
4. Simulation Illustrations
In this section, we consider two illustrative examples.
Example 1 (SISO nonlinear switched system). In this simulation test, let us consider the following SISO nonlinear switched system with two subsystems:
The nonlinear switched system is operated during the two subsystems with arbitrary switched law in time domain, and the desired output is given as , and . For the initial state, it is assumed that for all . The ILC law (7) is applied by adopting the zero initial control input for all . In simulation, we produces a random sequence with the value is 1 and 2, as shown in Figure 1. If , the system (64) is ; otherwise, if , the system (64) is .
To check the tracking performance, we consider the following second-order ILC law where , , , and . Note that the nonlinear functions are both uniformly globally Lipschitz in and uniformly bounded for all and . It is obvious that and are also bounded. Checking the condition in Theorem 9, we have then, . From Theorem 9, we know that the nonlinear switched ILC system is asymptotically stable. Figures 2, 3, and 4 give simulation results for system output trajectories at 5th, 10th, and 30th iterations. In these figures, we plot the system output in solid line and the desired output trajectory in dashed line. It can be observed that the better tracking performance can be obtained after 30th iteration. Intuitively, this result can be understood in the following way: although the switched system has an arbitrary switched rule on the time domain, the arbitrary switched rule is invariable on the iteration domain. If we update the control signals on the repetitive iteration domain, the perfect tracking performance can be obtained eventually.
To further check the effectiveness of high-order ILC law, we also did simulation tests using first-order ILC given as , and the control input at the first iteration is also given as for all . The tracking errors for second-order ILC and first order ILC are given in Figure 5. Clearly, the high-order ILC scheme can be faster convergence than the first-order one.
Example 2 (MIMO nonlinear switched system with state delay). In this example, let us consider the following MIMO nonlinear switched system with time delay:
where . The switched system is also operated during the two subsystems with arbitrary switched law in time domain, and the desired trajectories are given as
For the initial state, it is assumed that for all . The ILC law is applied by adopting the zero initial control input , for all . In simulation, we produces a random sequence , and with the value is 1 and 2, as shown in Figure 6, If , the system (67) is ; otherwise, if , the system (67) is . We consider the following second order ILC law: where , , , and . Note that the nonlinear system only contains nonlinear argument , , and they are both uniformly globally Lipschitz in and uniformly bounded for all . To guarantee the ILC convergence, should be less than one. It is easy to obtain that the previous choices of , clearly satisfy the convergence condition. The simulation results for system output trajectories at 5th, 10th, and 30th iterations are shown in Figures 7, 8, and 9. In these figures, we plot the system output in solid line and the desired output trajectory in dashed line. It can be observed that the switched ILC system is asymptotically stable, and the better tracking performance can be obtained after 30th iteration for the whole time interval. We also did simulation tests using first order ILC given as , and the control input at the first iteration is also given as , for all . The simulation results of tracking errors for second order ILC and first order ILC are shown in Figure 10. It is presented to illustrate the effectiveness of high-order ILC law over the conventional first-order one.
The stability of high-order ILC law for nonlinear switched systems with state delays is analyzed. It is shown that the asymptotic convergence of the tracking error can be guaranteed under some conditions, and the perfect tracking performance can be obtained during the entire time interval. This result can be understood in the following way: although the switched system has an arbitrary switched rule on the time domain, the arbitrary switched rule is invariable on the iteration domain. If we update the control signals on the repetitive iteration domain, the perfect tracking performance can be obtained eventually.
In the previous works [20–22], the asymptotic convergence of tracking control is only guaranteed in the time domain; that is, the system output tracking errors converge to 0 when . When the ILC is considered for switched systems, the perfect tracking performance can be obtained during the entire time interval. ILC can use the previous operation information of the switched systems, and then the tracking can be performed better progressively from operation to operation. It also requires less a priori knowledge about the system dynamics and less computational effort than many other kinds of control approaches. In future work, we will consider the stability of nonlinear switched systems with arbitrary switched rule on the iteration domain.
This work is supported by the Program of NSFC (no. 61203065, no. 61240049), the Program of Open Laboratory Foundation of Control Engineering Key Discipline of Henan Provincial High Education (KG 2011-10), and the Program of Key Young Teacher of Henan Polytechnic University.
- D. Liberzon and A. S. Morse, “Basic problems in stability and design of switched systems,” IEEE Control Systems Magazine, vol. 19, no. 5, pp. 59–70, 1999.
- D. Liberzon, Switching in Systems and Control, Systems & Control: Foundations & Applications, Birkhäuser, Boston, Mass, USA, 2003.
- Z. Sun and S. S. Ge, Switched Linear Systems: Control and Design, Springer, New York, NY, USA, 2005.
- D. K. Kim, P. Park, and J. W. Ko, “Output-feedback control of systems over communication networks using a deterministic switching system approach,” Automatica, vol. 40, no. 7, pp. 1205–1212, 2004.
- H. Lin and P. J. Antsaklis, “Stability and persistent disturbance attenuation properties for a class of networked control systems: switched system approach,” International Journal of Control, vol. 78, no. 18, pp. 1447–1458, 2005.
- R. Horowitz and P. Varaiya, “Control design of an automated highway system,” Proceedings of the IEEE, vol. 88, no. 7, pp. 913–925, 2000.
- P. Antsaklis, “Special issue on hybrid systems: theory and applications-a brief introduction to the theory and applications of hybrid systems.,” Proceedings of the IEEE, vol. 88, no. 7, pp. 887–897, 2000.
- J. P. Hespanha and A. S. Morse, “Switching between stabilizing controllers,” Automatica, vol. 38, no. 11, pp. 1905–1917, 2002.
- H. Ishii and B. A. Francis, “Stabilizing a linear system by switching control with dwell time,” IEEE Transactions on Automatic Control, vol. 47, no. 12, pp. 1962–1973, 2002.
- M. S. Branicky, “Multiple Lyapunov functions and other analysis tools for switched and hybrid systems,” IEEE Transactions on Automatic Control, vol. 43, no. 4, pp. 475–482, 1998.
- A. N. Michel, “Recent trends in the stability analysis of hybrid dynamical systems,” IEEE Transactions on Circuits and Systems. I, vol. 46, no. 1, pp. 120–134, 1999.
- D. Liberzon, J. P. Hespanha, and A. S. Morse, “Stability of switched systems: a Lie-algebraic condition,” Systems & Control Letters, vol. 37, no. 3, pp. 117–122, 1999.
- J. Zhao and G. M. Dimirovski, “Quadratic stability of a class of switched nonlinear systems,” IEEE Transactions on Automatic Control, vol. 49, no. 4, pp. 574–578, 2004.
- H. Lin and P. J. Antsaklis, “Stability and stabilizability of switched linear systems: a survey of recent results,” IEEE Transactions on Automatic Control, vol. 54, no. 2, pp. 308–322, 2009.
- Z. Ji, L. Wang, and X. Guo, “Design of switching sequences for controllability realization of switched linear systems,” Automatica, vol. 43, no. 4, pp. 662–668, 2007.
- D. Cheng, “Controllability of switched bilinear systems,” IEEE Transactions on Automatic Control, vol. 50, no. 4, pp. 511–515, 2005.
- J. P. Hespanha, D. Liberzon, D. Angeli, and E. D. Sontag, “Nonlinear norm-observability notions and stability of switched systems,” IEEE Transactions on Automatic Control, vol. 50, no. 2, pp. 154–168, 2005.
- Z. Sun and S. S. Ge, “Analysis and synthesis of switched linear control systems,” Automatica, vol. 41, no. 2, pp. 181–195, 2005.
- H. Liu and Y. Shen, “Asynchronous finite-time stabilisation of switched systems with average dwell time,” IET Control Theory & Applications, vol. 6, no. 9, pp. 1213–1219, 2012.
- Q.-K. Li, J. Zhao, and G. M. Dimirovski, “Tracking control for switched time-varying delays systems with stabilizable and unstabilizable subsystems,” Nonlinear Analysis: Hybrid Systems, vol. 3, no. 2, pp. 133–142, 2009.
- Q.-K. Li, J. Zhao, X.-J. Liu, and G. M. Dimirovski, “Observer-based tracking control for switched linear systems with time-varying delay,” International Journal of Robust and Nonlinear Control, vol. 21, no. 3, pp. 309–327, 2011.
- B. Niu and J. Zhao, “Tracking control for output-constrained nonlinear switched systems with a barrier Lyapunov function,” International Journal of Systems Science, vol. 44, no. 5, pp. 978–985, 2013.
- S. Arimoto, S. Kawamura, and F. Miyazaki, “Bettering operation of robots by learning.,” Journal of Robotic Systems, vol. 1, no. 2, pp. 123–140, 1984.
- H. S. Ahn, Y. Chen, and K. L. Moore, “Iterative learning control: brief survey and categorization.,” IEEE Transactions on Systems, Man, and Cybernetics Part C, vol. 37, no. 6, pp. 1099–1121, 2007.
- R. Chi, Z. Hou, and J. Xu, “Adaptive ILC for a class of discrete-time systems with iteration-varying trajectory and random initial condition,” Automatica, vol. 44, no. 8, pp. 2207–2213, 2008.
- M. Sun and D. Wang, “Initial shift issues on discrete-time iterative learning control with system relative degree,” IEEE Transactions on Automatic Control, vol. 48, no. 1, pp. 144–148, 2003.
- Z. Hou, J.-X. Xu, and J. Yan, “An iterative learning approach for density control of freeway traffic flow via ramp metering,” Transportation Research Part C, vol. 16, no. 1, pp. 71–97, 2008.
- W. Chen, J. Li, and J. Li, “Practical adaptive iterative learning control framework based on robust adaptive approach,” Asian Journal of Control, vol. 13, no. 1, pp. 85–93, 2011.
- W. Chen and L. Zhang, “Adaptive Iterative learning control for nonlinearly parameterized systems with unknown time-varying delays,” International Journal of Control, Automation and Systems, vol. 8, no. 2, pp. 177–186, 2010.
- X. Bu, F. Yu, Z. Hou, and F. Wang, “Iterative learning control for a class of nonlinear systems with random packet losses,” Nonlinear Analysis: Real World Applications, vol. 14, no. 1, pp. 567–580, 2013.
- S. Andrei, J. Diblik, K. Denys, and M. Ruzickova, “Stabilization of Lur'e-type nonlinear control systems by Lyapunov-Krasovskii functionals,” Advances in Difference Equations, vol. 2012, 9 pages, 2012.
- I. A. Dzhalladova, J. Baštinec, J. Diblík, and D. Y. Khusainov, “Estimates of exponential stability for solutions of stochastic control systems with delay,” Abstract and Applied Analysis, vol. 2011, Article ID 920412, 14 pages, 2011.
- J. Diblík, D. Ya. Khusainov, and M. Růžičková, “Controllability of linear discrete systems with constant coefficients and pure delay,” SIAM Journal on Control and Optimization, vol. 47, no. 3, pp. 1140–1149, 2008.
- Y. Chen, Z. Gong, and C. Wen, “Analysis of a high-order iterative learning control algorithm for uncertain nonlinear systems with state delays,” Automatica, vol. 34, no. 3, pp. 345–353, 1998.
- T. M. Flett, Differential Analysis, Cambridge University Press, Cambridge, UK, 1980.
- Y. Shen and J. Wang, “Noise-induced stabilization of the recurrent neural networks with mixed time-varying delays and Markovian-switching parameters,” IEEE Transactions on Neural Networks, vol. 18, no. 6, pp. 1857–1862, 2007.
- Y. Shen and J. Wang, “Almost sure exponential stability of recurrent neural networks with Markovian switching,” IEEE Transactions on Neural Networks, vol. 20, no. 5, pp. 840–855, 2009.
- Y. Shen and J. Wang, “Robustness analysis of global exponential stability of recurrent neural networks in the presence of time delays and random disturbances,” IEEE Transactions on Neural Network, vol. 23, no. 1, pp. 87–96, 2012.
- S. S. Saab, W. G. Vogt, and M. H. Mickle, “Learning control algorithms for tracking “slowly” varying trajectories,” IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 27, no. 4, pp. 657–670, 1997.
- D. Wang, “Convergence and robustness of discrete time nonlinear systems with iterative learning control,” Automatica, vol. 34, no. 11, pp. 1445–1448, 1998.