- About this Journal ·
- Abstracting and Indexing ·
- Advance Access ·
- Aims and Scope ·
- Annual Issues ·
- Article Processing Charges ·
- Articles in Press ·
- Author Guidelines ·
- Bibliographic Information ·
- Citations to this Journal ·
- Contact Information ·
- Editorial Board ·
- Editorial Workflow ·
- Free eTOC Alerts ·
- Publication Ethics ·
- Reviewers Acknowledgment ·
- Submit a Manuscript ·
- Subscription Information ·
- Table of Contents
Abstract and Applied Analysis
Volume 2014 (2014), Article ID 450241, 12 pages
Robust Monotonically Convergent Iterative Learning Control for Discrete-Time Systems via Generalized KYP Lemma
Key Laboratory of Advanced Process Control for Light Industry (Ministry of Education), Jiangnan University, Wuxi 214122, China
Received 24 January 2014; Accepted 12 May 2014; Published 29 May 2014
Academic Editor: Chengjian Zhang
Copyright © 2014 Jian Ding and Huizhong Yang. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
This paper addresses the problem of P-type iterative learning control for a class of multiple-input multiple-output linear discrete-time systems, whose aim is to develop robust monotonically convergent control law design over a finite frequency range. It is shown that the 2 D iterative learning control processes can be taken as 1 D state space model regardless of relative degree. With the generalized Kalman-Yakubovich-Popov lemma applied, it is feasible to describe the monotonically convergent conditions with the help of linear matrix inequality technique and to develop formulas for the control gain matrices design. An extension to robust control law design against systems with structured and polytopic-type uncertainties is also considered. Two numerical examples are provided to validate the feasibility and effectiveness of the proposed method.
The well-known iterative learning control (ILC) algorithm can effectively improve the transient responses and tracking performance for systems that execute the same task over a finite duration repetitively, the key idea of which is to iteratively reduce the tracking error by refining the control input signal based on the information from previous trials . As demonstrated in survey papers [2–6], ILC has attracted considerable research attention in many areas during the past few decades. Extensive applications of ILC have been used for many practical problems coming from, for example, batch processes [7–9], point-to-point control [10, 11], and positioning control [12–15].
In fact, among all types of ILC research issues, both theoretical and practical, robustness and monotonic convergence have been studied as two major topics. Many uncertain factors such as model uncertainties, variable initial conditions, stochastic noises, and packet dropout need to be taken into consideration with regard to robust ILC design. For example, a kind of so-called adaptive ILC has been developed for local Lipschitz continuous (LLC) uncertain nonlinear systems with unknown parameters, and composite energy function (CEF) is usually constructed to facilitate the convergence analysis . Considering the inherent two-dimensional (2 D) structure of every ILC process, 2 D system theory has been developed to design ILC based on linear repetitive processes [16–18], Roesser model [19, 20], and Fornasini-Marchsini model [21, 22]. Moreover, the robust ILC has been particularly extended to networked control system [23, 24] and switched systems [25, 26].
To achieve good learning transients, the monotonic convergence is particularly important in ILC design problems. For example, first-order and second-order P-type ILC schemes are used for continuous linear time-invariant (LTI) systems, where the monotonic convergence of tracking error is guaranteed in the sense of Lebesgue-p norm . It is also noticed that the so-called super-vector formulation for discrete-time ILC has been prevalent for monotonic convergence analysis under different appropriate norm topology. In , the monotonic convergence analysis for interval ILC systems is presented for discrete-time systems. A gradient-based optimal ILC scheme is proposed for ensuring robust monotonic convergence . A new semisliding window ILC algorithm is developed for discrete-time LTI systems . Recently, by integrating the technique of linear matrix inequality (LMI), the well-established norm has been used for deriving monotonical convergence conditions that can be described as LMIs and formulas for the control law design, and the tracking error can be ensured to converge monotonically in the sense of norm [31–34].
However, the aforementioned monotonically convergent ILC works treat control law design over the complete frequency range which is not practical in many cases. In particular, the reference signal and design specification are often given for a certain frequency range of relevance. This viewpoint motivates the present study. In this paper, an integrated ILC framework is developed for multiple-input multiple-output (MIMO), LTI discrete systems with a relative degree, and the frequency design can be specified over a finite range. This benefits from the well-established generalized Kalman-Yakubovich-Popov (KYP) lemma that can tie together a frequency domain inequality (FDI) over finite frequency range and an LMI. It is shown that monotonic convergence conditions can be described in terms of LMIs, as well as formulas obtained for the control law design. Furthermore, this approach is extended to handling the robust issues for the systems with norm-bounded and polytopic-type uncertainties.
Briefly, the paper is organized as follows. Section 2 introduces several useful LMIs. The problem formulation is supplied in Section 3. The convergence performance of the proposed scheme is analyzed in Section 4. Section 5 provides two illustrative examples. Finally, some concluding remarks are given in Section 6.
Throughout this paper, the following notations are employed. denotes the set of nonnegative integers. For a matrix , its transpose, complex conjugate transpose, and orthogonal complement are denoted by , , and , respectively. and are the identity matrix and the zero matrix with appropriate dimensions, respectively. and denote positive definiteness and negative definiteness, respectively. The symbol represents the transposed elements in a symmetric matrix and denotes the spectral radius of its matrix argument. For matrices and , denotes the Kronecker product. is a forward shift operator along the discrete-time axis; that is, .
2. Preliminary Knowledge
Before presenting the main results, the following well-known results are briefly introduced in this section.
Lemma 1 (Schur complement, ). Given a symmetric matrix , and are square, and then the following inequalities are equivalent:(1)(2) and (3) and .
Lemma 2 (see ). Assume , , and are real matrices with appropriated dimensions. Then for any matrix satisfying , the following inequality: holds if and only if there exists a scalar such that
Lemma 3 (see ). Assume , , and are real matrices with appropriated dimensions. There exists a matrix such that the following inequality: holds if and only if the following two inequalities with respect to are satisfied:
Lemma 4 (generalized KYP lemma, ). For a discrete LTI system with transfer function and frequency response matrix , the following statements are equivalent:
(1) the frequency domain inequality or holds for all , where is a given real symmetric matrix and where and denotes the frequency ranges specified by as shown in Table 1.
(2) There exists Hermitian matrices , such that and
3. Problem Formulation
3.1. System Description
Consider the following MIMO discrete-time LTI system over : where is the iteration number, which denotes the th repetitive operation of the system. The task interval is finite and discretized in a set that consists of sampled instances . is the state vector, is the control input vector, and is the output vector. are constant matrices of appropriate dimensions. is the initial condition for each iteration. The relative degree of system (9) can be defined by (1) if ;(2) if it holds that(a);(b) and for all .
Let denote the reference vector, and then the tracking error on iteration is
The control target is to design appropriate control signal and present some LMI conditions such that the system output can converge monotonically to the reference trajectory over a finite frequency range when the iteration number tends to infinity, even if there exist system uncertainties.
In order to complete the above control task, the following assumptions are imposed on system (9).
Assumption 5. The initial resetting condition is satisfied; that is, , . Without loss of generality, it is considered that .
Remark 6. Obviously, the transfer function matrix from to can be expressed as where is usually obtained by discretizing the original continuous-time domain model using a sampling mechanism that consists of a sampler with the sampling interval and a zero-order hold.
Remark 7. The relative degree is exactly the steps of delay in the output in order to have the control input appearing. Note that the relative degree of one, that is, and , is usually considered in the literature for discrete-time ILC .
3.2. Design of ILC
In this section, the ILC law is introduced as follows: where denotes an polynomial gain operator to be designed.
4. Convergence Analysis
4.1. Super-Vector Approach
Using the lifting approach, system (9) and ILC law (13) can be described respectively as where , , and , , are the supervectors which are lifted to contain sampled points, and and are two lower triangular block Toeplitz matrices. The elements of are the system Markov parameters (or the pulse response coefficients).
From (17), the monotonic convergence condition can be simply defined in an appropriate norm topology
Remark 8. Clearly, when the state-space model matrices , , , and have structured and polytopic-type uncertainties, it is difficult to derive learning gain matrix from condition (18).
4.2. Frequency Domain Approach
The following proposition will be helpful for developing frequency-domain monotonic convergence condition.
Proposition 9 (see ). Assume is stable and causal, if and then ; that is, the monotonic convergence of tracking error can be accomplished in norm.
With Proposition 9, there exist matrices , , , and such that can be expressed by
It is seen that the condition (19) can be resolved by combining a robust control theory and the LMI technique. However, condition (19) requires control law design over the entire frequency and is a very strict condition. By utilizing the generalized KYP Lemma, this paper develops monotonically convergent ILC design restricted within a finite frequency range. Accordingly, (19) is replaced by following condition: where denotes a finite frequency range.
Moreover, condition (21) is replaced with
However, in this case, inequality (22) is no longer a standard problem. To this end, we denote for scalars and . Then if holds, follows immediately, and at the same time (22) equivalently becomes where .
Now with controlled system (15), let us further consider how to solve the condition (24) under the generalized KYP Lemma framework. Consider the frequency response matrix and choose the matrix of Lemma 4 as
We can get
4.2.1. Zero Relative Degree
Consider first that system (9) has a zero relative degree, resulting in
Accordingly, the ILC law (13) is applied with the following gain operator: where is an matrix to be determined.
Moreover, it is easy to see that and satisfy (20) because it can be modeled by
Theorem 10. Consider the ILC system (9) and (13) satisfying and Assumption 5, and the gain operator matrix is defined by (28). Then, converges monotonically to zero over the low frequency range when , if there exist scalars , and matrices , , , satisfying (23) and the following LMI:
Proof. Applying Lemma 4 gives that condition (26) holds if there exist symmetric matrices and such that and
where , , , , , and is the only matrix whose block entries depend on the chosen frequency range. Without loss of generality, the low frequency range is considered; that is, , which gives that
Then, (32) becomes
The condition of (34) cannot, however, be directly applied to control law design since it involves product terms and .
To separate the matrices and from the process model matrices, rewrite (34) as
To apply the result of Lemma 3, we can set , , , , .
Then we can have
The above inequality holds if and only if the diagonal blocks satisfy
Hence is required. Moreover, is equivalent to , which is naturally set up according to asymptotic convergence of the ILC system.
Next, application of Lemma 3 gives that (35) and (36) are feasible if there exists a matrix satisfying
Applying the Schur’s complement to (38) and inserting , , , and give that
pre- and postmultiplying this last inequality by and to obtain
Finally, introduce the change of variables: giving immediately that (40) is equivalent to the LMI of (30) and the proof is complete.
Next it will be shown that Theorem 10 can be further developed to address system (9) with structured uncertainty matrices of the form: where , , , and represent admissible uncertainties which are assumed to satisfy where , , , and are known matrices of appropriate dimensions, and is an unknown matrix satisfying
In this case, the following robust result can be presented.
Corollary 11. Consider the ILC system (9) and (13) satisfying and Assumption 5. Assume that the plant has uncertain matrices described by (43) and (44), and the gain operator matrix is defined by (28). Then, converges monotonically to zero over the low frequency range when , if there exist scalars , , and matrices , , and , satisfying (23) and the following LMI:
Proof. With Theorem 10 applied, this proof can be expressed as the requirement that
With Lemma 2 applied, one has that (46) holds for all satisfying if and only if there exists a scalar such that
It is noted that the above inequality can be rewritten to obtain
Using the Schur complement Lemma, one knows that (49) is equivalent to
Now pre- and post-multiplying (50) by result in (45). This proof is completed.
The following result enables robust ILC design when the model matrices of system (9) belong to a polytope-type uncertain domain .
Corollary 12. Consider the ILC system (9) and (13) satisfying and Assumption 5. Assume that the plant matrices have polytope uncertainty described by (51), and the gain operator matrix is defined by (28). Then, converges monotonically to zero over the low frequency range when , if there exist scalars , and matrices , , , satisfying (23) and the following LMIs:
Proof. For all systems of the type of (9) falling within , let , . Then the LMI of (30) can be achieved from the set of LMIs in (52). The remaining of this proof is omitted since it can follow the same lines of the proof of Theorem 10.
4.2.2. Higher-Order Relative Degree
In order to compensate for the influence of , the ILC law (13) is considered with an anticipatory gain operator of the form: where is an matrix.
Moreover, and can still satisfy (20) as shown in the following:
Remark 13. Using the fact that or repetitively yields that can be expressed as
Then can be derived as or
Theorem 14. Consider the ILC system (9), (13), and (55) satisfying and Assumption 5, and the gain operator matrix is defined by (54). Then, converges monotonically to zero over the low frequency range when , if there exist scalars , , and matrices , , , and satisfying (23) and the following LMI:
Proof. This proof is omitted since it follows identical steps to that of Theorem 10.
Even if a higher-order relative degree exists, LMIs of (23) and (61) can still be obtained to achieve the monotonic convergence. Since LMI (61) contains product of matrices of the plant , Theorem 14 cannot be extended like that done in Corollaries 11 and 12. However, it is noted that, for the case , the results of Theorem 14 are feasible to deal with the norm-bounded and polytopic-type uncertainties.
Next let us consider only the case where the uncertain model is of the form:
The matrices and represent admissible uncertainties that are assumed to satisfy where , , and are known constant matrices, and is an unknown matrix satisfying . Now the effects of norm-bounded uncertainty can be addressed via the following result.
Corollary 15. Consider the ILC system (9), (13), and (55) satisfying and Assumption 5. Assume that the plant has uncertain matrices described by (63) and (64), and the gain operator matrix is defined by (54). Then, converges monotonically to zero over the low frequency range when , if there exist scalars , , and matrices , , , satisfying (23) and the following LMI:
Proof. This proof is omitted since it follows in an identical manner to that of Corollary 11.
Furthermore, the matrices and are known to lie within an uncertainty polytope where
The following result is able to address the problems of polytope-type uncertainty.
Corollary 16. Consider the ILC system (9), (13), and (55) satisfying and Assumption 5. Assume that the plant matrices have polytope uncertainty described by (66), and the gain operator matrix is defined by (54). Then, converges monotonically to zero over the low frequency range when , if there exist scalars , and matrices , , , satisfying (23) and the following LMIs:
Proof. This proof is omitted since it follows identical steps to that of Corollary 12.
Theorem 18. Consider the ILC system (9), (13), and (56) satisfying and Assumption 5, and the gain operator matrix is defined by (54). Then, converges monotonically to zero over the low frequency range when , if there exist scalars , , and matrices , , , and satisfying (23) and the following LMI:
5. Simulation Examples
Example 1. Consider the following SISO system given by :
Obviously, the considered system has a relative degree of one. Each iteration duration is 1.5 s and the sampling frequency is set to 100 Hz. The reference trajectory is shown in Figure 1(a) and associated frequency spectrum in Figure 1(b). Inspecting the amplitudes in the frequency spectrum, it is shown that significant harmonics in the range from 0 to 10 Hz, which can be taken as the low frequency range. And hence is chosen as .
Example 2. In this example, the system is considered with matrices given by where and are uncertain parameters in the form of . Here, , , and , and and are uncertain variables lying in the interval .
The simulation condition is performed identically to Example 1. Then apply Corollary 16 to such a system and solve LMIs (23) and (67) to obtain . The simulation results are shown in Figures 5, 6, and 7, from which it is seen that the tracking error also decays monotonically to zero along the iteration axis.
This paper deals with tracking problem of uncertain MIMO discrete-time systems with a relative degree. Based on the idea of generalized Kalman-Yakubovich-Popov lemma, the proposed ILC scheme achieves robust monotonically convergent control law design over a finite frequency range, and sufficient conditions in terms of LMIs have been developed. The effectiveness of the controller design is validated through two numerical examples.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
This work was supported by the National Natural Science Foundation of China (nos. 61273070 and 61203092).
- S. Arimoto, S. Kawamura, and F. Miyazaki, “Bettering operation of robotics by learning,” Journal of Robotic Systems, vol. 12, no. 2, pp. 123–140, 1984.
- J. X. Xu, “A survey on iterative learning control for nonlinear systems,” International Journal of Control, vol. 84, no. 7, pp. 1275–1294, 2011.
- H. S. Ahn, Y. Q. Chen, and K. L. Moore, “Iterative learning control: Brief survey and categorization,” IEEE Transactions on Systems, Man and Cybernetics C: Applications and Reviews, vol. 37, no. 6, pp. 1099–1121, 2007.
- Y. Wang, F. Gao, and F. J. Doyle III, “Survey on iterative learning control, repetitive control, and run-to-run control,” Journal of Process Control, vol. 19, no. 10, pp. 1589–1600, 2009.
- D. A. Bristow, M. Tharayil, and A. G. Alleyne, “A survey of iterative learning control: A learning-based method for high-performance tracking control,” IEEE Control Systems Magazine, vol. 26, no. 3, pp. 96–114, 2006.
- X. E. Ruan, K. H. Park, and Z. Z. Bien, “Retrospective review of some iterative learning control techniques with a comment on prospective long-term learning,” Control Theory and Applications, vol. 29, no. 8, pp. 966–973, 2012.
- J. Li, Y. Tian, and C. Minsen, “An integrated iterative learning control strategy with model identification and dynamic R-parameter for batch processes,” Journal of Process Control, vol. 23, no. 9, pp. 1332–1341, 2013.
- H. Ahn, K. Lee, M. Kim, and J. Lee, “Control of a reactive batch distillation process using an iterative learning technique,” Korean Journal of Chemical Engineering, vol. 31, no. 1, pp. 6–11, 2014.
- X. Yu, Z. Xiong, D. Huang, and Y. Jiang, “Model-based iterative learning control for batch processes using generalized hinging hyperplanes,” Industrial and Engineering Chemistry Research, vol. 52, no. 4, pp. 1627–1634, 2013.
- C. T. Freeman, “Constrained point-to-point iterative learning control with experimental verification,” Control Engineering Practice, vol. 20, no. 5, pp. 489–498, 2012.
- C. T. Freeman and Y. Tan, “Iterative learning control with mixed constraints for point-to-point tracking,” IEEE Transactions on Control Systems Technology, vol. 21, no. 3, pp. 604–616, 2013.
- B. E. Helfrich, C. Lee, D. A. Bristow et al., “Combined -feedback control and iterative learning control design with application to nanopositioning systems,” IEEE Transactions on Control Systems Technology, vol. 18, no. 2, pp. 336–351, 2010.
- G. Parmar, K. Barton, and S. Awtar, “Large dynamic range nanopositioning using iterative learning control,” Precision Engineering, 2013.
- J. X. Xu, D. Huang, V. Venkataramanan, and T. C. T. Huynh, “Extreme precise motion tracking of piezoelectric positioning stage using sampled-data iterative learning control,” IEEE Transactions on Control Systems Technology, vol. 21, no. 4, pp. 1432–1439, 2013.
- D. Huang, J. X. Xu, V. Venkataramanan, and C. T. Huynh, “High-performance tracking of piezoelectric positioning stage using current-cycle iterative learning control with gain scheduling,” IEEE Transactions on Industrial Electronics, vol. 61, no. 2, pp. 1085–1098, 2014.
- L. Hladowski, K. Galkowski, Z. Cai, E. Rogers, C. T. Freeman, and P. L. Lewin, “Experimentally supported 2D systems based iterative learning control law design for error convergence and performance,” Control Engineering Practice, vol. 18, no. 4, pp. 339–348, 2010.
- P. Dabkowski, K. Galkowskiy, E. Rogers, Z. Cai, C. T. Freeman, and P. L. Lewin, “Iterative learning control based on relaxed 2-D systems stability criteria,” IEEE Transactions on Control Systems Technology, vol. 21, no. 3, pp. 1016–1023, 2013.
- W. Paszke, E. Rogers, K. Gałkowski, and Z. Cai, “Robust finite frequency range iterative learning control design and experimental verification,” Control Engineering Practice, vol. 21, no. 10, pp. 1310–1320, 2013.
- T. Liu and Y. Wang, “A synthetic approach for robust constrained iterative learning control of piecewise affine batch processes,” Automatica, vol. 48, no. 11, pp. 2762–2775, 2012.
- Y. Wang, Y. Yang, and Z. Zhao, “Robust stability analysis for an enhanced ILC-based PI controller,” Journal of Process Control, vol. 23, no. 2, pp. 201–214, 2013.
- L. Wang and W. Dong, “Optimal iterative learning fault-tolerant guaranteed cost control for batch processes in the 2D-FM model,” Abstract and Applied Analysis, vol. 2012, Article ID 748981, 21 pages, 2012.
- L. Wang, X. Chen, and F. Gao, “An LMI method to robust iterative learning fault-tolerant guaranteed cost control for batch processes,” Chinese Journal of Chemical Engineering, vol. 21, no. 4, pp. 401–411, 2013.
- R. Wang, X. Ma, and X. Bu, “Robust iterative learning control for a class of linear systems with data dropouts,” Mathematical Problems in Engineering, vol. 2013, Article ID 747053, 9 pages, 2013.
- L. X. Huang and Y. Fang, “Convergence analysis of wireless remote iterative learning control systems with dropout compensation,” Mathematical Problems in Engineering, vol. 2013, Article ID 609284, 9 pages, 2013.
- X. Bu, F. Yu, Z. Fu, and F. Wang, “Stability analysis of high-order iterative learning control for a class of nonlinear switched systems,” Abstract and Applied Analysis, vol. 2013, Article ID 684642, 13 pages, 2013.
- X. Bu, Z. Hou, F. Yu, and Z. Fu, “Iterative learning control for a class of non-linear switched systems,” IET Control Theory & Applications, vol. 7, no. 3, pp. 470–481, 2013.
- X. Ruan, Z. Z. Bien, and Q. Wang, “Convergence characteristics of proportional-type iterative learning control in the sense of Lebesgue- norm,” IET Control Theory & Applications, vol. 6, no. 5, pp. 707–714, 2012.
- H. S. Ahn, K. L. Moore, and Y. Chen, “Stability analysis of discrete-time iterative learning control systems with interval uncertainty,” Automatica, vol. 43, no. 5, pp. 892–902, 2007.
- D. H. Owens, J. J. Hatonen, and S. Daley, “Robust monotone gradient-based discrete-time iterative learning control,” International Journal of Robust and Nonlinear Control, vol. 19, no. 6, pp. 634–661, 2009.
- A. Madady and H. R. Reza-Alikhani, “A guaranteed monotonically convergent iterative learning control,” Asian Journal of Control, vol. 14, no. 5, pp. 1299–1316, 2012.
- D. Meng, Y. Jia, J. Du, and F. Yu, “Robust learning controller design for MIMO stochastic discrete-time systems: an -based approach,” International Journal of Adaptive Control and Signal Processing, vol. 25, no. 7, pp. 653–670, 2011.
- D. Meng, Y. Jia, J. Du, and F. Yu, “Monotonically convergent ILC systems designed using bounded real lemma,” International Journal of Systems Science: Principles and Applications of Systems and Integration, vol. 43, no. 11, pp. 2062–2071, 2012.
- D. Meng, Y. Jia, J. Du, and F. Yu, “Robust design of a class of time-delay iterative learning control systems with initial shifts,” IEEE Transactions on Circuits and Systems I: Regular Papers, vol. 56, no. 8, pp. 1744–1757, 2009.
- D. Meng, Y. Jia, J. Du, and F. Yu, “Data-driven control for relative degree systems via iterative learning,” IEEE Transactions on Neural Networks, vol. 22, no. 12, pp. 2213–2225, 2011.
- S. Boyd, L. Ghaoui, E. Feron, and V. Balakrishnan, Linear Matrix Inequalities in System and Control Theory, SIAM, Philadelphia, Pa, USA, 1994.
- L. Xie, “Output feedback control of systems with parameter uncertainty,” International Journal of Control, vol. 63, no. 4, pp. 741–750, 1996.
- P. Gahinet and P. Apkarian, “A linear matrix inequality approach to control,” International Journal of Robust and Nonlinear Control, vol. 4, no. 4, pp. 421–448, 1994.
- T. Iwasaki and S. Hara, “Generalized KYP lemma: unified frequency domain inequalities with design applications,” IEEE Transactions on Automatic Control, vol. 50, no. 1, pp. 41–59, 2005.