Discrete Dynamics in Nature and Society

Volume 2014 (2014), Article ID 587323, 10 pages

http://dx.doi.org/10.1155/2014/587323

## ILC Design for Discrete Linear Systems with Packet Dropouts and Iteration-Varying Disturbances

^{1}School of Electrical Engineering & Automation, Henan Polytechnic University, Jiaozuo 454003, China^{2}Henan Provincial Open Lab for Control Engineering Key Discipline, Henan Polytechnic University, Jiaozuo 454003, China

Received 22 February 2014; Accepted 22 May 2014; Published 9 June 2014

Academic Editor: Wenwu Yu

Copyright © 2014 Bu Xuhui et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

An iterative learning controller is designed for networked systems with intermittent measurements and iteration-varying disturbances. By modeling the measurement dropout as a stochastic variable satisfying the Bernoulli random binary distribution, the design can be transformed into control of a 2D stochastic system described by Roesser model. A sufficient condition for mean-square asymptotic stability and disturbance attenuation performance for such 2D stochastic system is established by means of linear matrix inequality (LMI) technique, and formulas can be given for the control law design simultaneously. A numerical example is given to illustrate the effectiveness of the proposed results.

#### 1. Introduction

Iterative learning control (ILC) has been extensively studied with significant progress in theory and widely applied in many fields [1–3]. Most of the reported results are based on an implicit assumption that the communication between the physical plant and controller is perfect; that is, the signals transmitted from the plant will arrive at the controller simultaneously and perfectly. However, in many practical situations, the systems may have intermittent measurements, especially in networked systems, which are becoming more and more popular for the reason that they have several advantages over traditional systems, such as low cost, reduced weight and power requirements, simple installation and maintenance, and high reliability [4–6]. If network is introduced to ILC design, the data packet dropout phenomenon, which appears in a typical network environment, will naturally induce intermittent measurements from the plant to the controller.

There have already been a few results in this issue. In [7–9], some stability conditions for networked-based ILC systems are given. Key conclusions of these works are that the intermittent ILC systems can guarantee convergence even though there may be significant data dropout. In [10, 11], an optimal ILC controller is designed for linear intermittent systems. The proposed ILC schemes can compensate the packet dropout effectively in the iteration domain. In [12], an averaging ILC algorithm is proposed to overcome the random data dropout, and it is shown that such an ILC algorithm can perform well and achieve asymptotic convergence in ensemble average along the iteration axis.

optimization is a powerful tool that can be used to design a robust controller or filter [13–15], which has been proved to be one of the most important strategies for disturbance attenuation. In [16], an algebraic approach is introduced to design higher-order ILC for the plants that are subject to model uncertainties and iteration-varying disturbance. In [17], an ILC design approach is proposed for linear systems with iteration-varying disturbances. In [18], an ILC design is proposed for linear systems with intermittent measurement. A sufficient condition guaranteeing both exponentially mean-square stability of such ILC process and the desired performance in the iteration domain is presented. However, these designs are all based on lifted system representation. It does not address the computational complexity of the lifted ILC design method that might hamper their real-life application [19]. Alternatively, ILC design based on 2D system theory is an effective approach for linear systems. Recently, several ILC methods have been proposed to cope with parameter uncertainties in ILC systems based on the results of control for 2D system or repetitive system [20–25]. However, ILC design based on 2D system and linear repetitive process are only considered for systems without intermittent measurements. To the best of our knowledge, the problem of intermittent ILC design has not been investigated in the framework of 2D system or linear repetitive process, which motivates the present study.

In this paper, the 2D design approach is developed to treat the problem of ILC design with intermittent measurements and iteration-varying disturbance. For the ILC system to be stochastic instead of a deterministic one by considering intermittent measurement, a 2D stochastic Roesser system is established to describe the entire dynamics. To analyze the tracking performance of the 2D stochastic system, the definition of stochastic mean-square asymptotic stability is introduced. In this case, a sufficient condition can be established by means of LMI technique, and formulas can be given for the control law design simultaneously. Numerical example is also proposed to illustrate the effectiveness of theoretical results.

This paper is organized as follows. In Section 2, the mathematical description and design objectives of networked-based ILC system are presented, together with its transformation into an equivalent 2D stochastic Roesser system. In Section 3, a mean-square asymptotic stability condition for such 2D stochastic systems is derived, and an ILC design approach can be given by means of LMI technique. The effectiveness of the proposed method is illustrated by a numerical example in Section 4. Finally, the conclusions are given in Section 5.

#### 2. Problem Formulation

Consider the following linear discrete time system: where the subscript denotes iteration and denotes discrete time. , , , and are state, input, output variables, and iteration-varying disturbances. , , , are the system matrices with appropriate dimension. stands for the initial condition of the process in the th cycle. The system is operated repeatedly in the iteration domain with a desired output , .

In this paper, the ILC law is given as where is the tracking error and is gain matrix to be designed.

Assume the ILC scheme (2) is implemented via a networked control system, where the data is transferred from the remote plant to the ILC controller. In this process, the data may be missed due to the network transmission failure. In this case, ILC law (2) can be described as where stochastic parameter is a random Bernoulli variable taking the values of 0 and 1 with in which satisfying is a known constant.

The design objective of this paper can be described as follows. For an initial condition and packet dropout satisfying (4), design an ILC law (3) such that the ILC system is stable, and the influence of the iteration-varying disturbances should be as small as possible.

The ILC systems (1) and (3) are essentially a 2D system with evolution along two independent axes: time and iteration . We can use the 2D analysis approach to ILC to derive an expression for the tracking error and the state error. Using (1) and (3), we can obtain where , .

Next, from (1) and (3), the following can also be obtained: Equations (5) and (6) can be rewritten as follows:

Denoting , ; that is,

We know that system (8) is a typical 2D Roesser system. Hence, the synthetic for ILC system under the control law (3) is equivalent to synthetic of Roesser’s system in (8). Notice that the introduction of the stochastic variable renders the 2D system to be stochastic instead of a deterministic one. Before proceeding further, we need to introduce the following definition of stochastic stability for the 2D Roesser system (8), which will be essential for our derivation.

*Definition 1 (stochastic stability [26]). *The 2D stochastic system (8) is said to be mean-square asymptotically stable if for every bounded initial condition , , the following is satisfied:

*Definition 2 ( performance). *Given a scalar , the 2D stochastic system (8) is said to be mean-square asymptotically stable with an disturbance attenuation level , if it is mean-square asymptotically stable and under zero boundary conditions, , for all , where

To this end, the problem to be addressed in this paper can be transformed as follows. Consider the system in (1) with packet dropouts described in (4). Given a real number , design a controller in the form of (3) such that the 2D stochastic system (8) is mean-square asymptotically stable with an disturbance attenuation level .

*Remark 3. *Since , we can obtain that , and as a consequence, it follows that
Therefore, the objective of can be guaranteed by ensuring that the performance of 2D system (8) fulfills .

#### 3. Main Results

In this section, the stability analysis problem is first concerned. More specifically, we assume that the system matrices , , , in (8) are known, and we study the condition under which the 2D system in (8) is mean-square asymptotically stable with a guaranteed performance. Then, a feasible ILC controller gain matrix can be given based on the condition.

Define ; it is obvious that then the 2D system (8) can be rewritten as where

Theorem 4. *Consider the 2D system (13) and suppose the matrices , , are known. Then the system is mean-square asymptotically stable with a given disturbance attenuation level , if there exists positive definite matrices , satisfying
**
where
*

*Proof. *We first prove the stochastic stability of 2D system (13) with zero disturbance . In this case, the system (13) becomes
and condition (15) is

Define
where .

Consider the following index:

Substituting (17) into the index, we can obtain
where .

Since , it means that for all we have
where .

Notice that ; we have . From (22), it is also easy to see that . Hence, and it is independent of . Thus, we obtain , and taking expectation of both sides yields
that is,
Adding both sides of the inequality system (24) yields
Using this relationship iteratively, we can obtain
which implies
where

Now, denote ; then upon inequality (27) we have
Adding both sides of the inequalities yields
Since is satisfied for all in system (1), then
and is bounded; hence, the right side of inequality (30) is bounded, which means ; that is, . Then the 2D stochastic system (13) with is mean-square asymptotically stable.

Now, the performance for the 2D stochastic system (13) will be established. Assume zero initial and boundary conditions; that is, , for all . In this case, the index becomes

Define ; another index is introduced as
where
From condition (15), for any , we have ; that is,
Taking the expectation of both sides yields
Due to the relationship (36), it can be established that

Adding both sides of the inequality system, we have
Summing up both sides of these inequalities from to , we have
that is,
Considering the zero boundary conditions, (40) means

This completes the proof.

*Remark 5. *Theorem 4 provides a sufficient condition for the mean-square asymptotic stability of 2D discrete stochastic systems with intermittent measurement. If the communication links existing between the plant and the controller are perfect, that is, there is no data dropout during their transmission, then and . In this case, the condition in Theorem 4 becomes
which also can be easily obtained by the results in [25] for 2D discrete deterministic system. From this point of view, Theorem 4 can be seen as an extension of 2D discrete deterministic systems with intermittent measurement.

Theorem 4 only gives a mean-square asymptotic stability condition for system in (13) where the matrixes , , , and parameters are all known. However, our eventual purpose is to determine the controller matrix . In the following, we will give an approach to solve the controller design problem for 2D systems with stochastic intermittent measurement.

The following well-known lemma is needed in the proof of our main result.

Lemma 6 (Schur complement [27]). *Assume , , are given matrices with appropriate dimension, where and are positive definite symmetric matrices. Then
**
if and only if
**
or
*

Based on the above lemma, we can give our main result.

Theorem 7. *The 2D discrete stochastic closed system in (13) is mean-square asymptotically stable with a given performance , if there exist positive definite matrices , , and such that the following LMI holds:
**
Also, if this condition holds, a suitable gain matrix of ILC law (3) is defined by
*

*Proof. *The condition in Theorem 4 can be rewritten as
By applying Lemma 6, condition (48) is equivalent to the following LMI condition:
Substituting matrices , , into the LMI condition, we obtainDefining , , pro-, and postmultiplying for LMI condition (50) givesSet to obtain the LMI of (46) and the proof is complete.

*Remark 8. *Theorem 7 provides an LMI condition for the mean-square asymptotic stability and performance of 2D stochastic system in (13) which can be solved by LMI Toolbox. Then by (47), we also can give a suitable ILC law. The feasibility of the proposed method will be illustrated by the example given in Section 4.

*Remark 9. *For a fixed , the feasibility of (47) is a suboptimal ILC. When is not fixed, the minimization of that satisfies (47) can be searched. That is, the optimal performance index can be achieved. Thus, the optimal ILC design problem is equivalent to the following convex programming problem:

*Remark 10. *Even though we consider the ILC law (3) only uses the error information from the previous iteration in networked systems framework, the general tools used can be extended to other ILC laws such as containing state signal in [23–25]. All of these problems end up with the same 2D system formulation as in (13).

#### 4. Numerical Example

In this section, an example is given to illustrate the proposed results. Consider the following SISO linear system: where is an iteration-varying disturbance with . The desired repetitive reference trajectory is given as

For the initial state, it is assumed that for all . To perform the simulation, we consider the intermittent measurements . Obviously, it means that there is 20 percent missing measurements. By applying Theorem 7 and solving the optimization problem (52), the minimum disturbance attenuation level for the ILC system is based on feasibility of the corresponding LMIs. Meanwhile, we obtain and . Simulation results are shown in Figures 1, 2, 3, and 4, where the tracking error on iteration domain is plotted in Figure 1, and system outputs at 10th, 20th, and 50th iteration are plotted in Figures 2–4, respectively. It is observed that the tracking is worse and significant tracking errors exist in the start iteration due to the effect of significant measurement dropout. However, the tracking error can converge to zero after some iteration and the perfect tracking can be obtained. The ILC system is insensitive to intermittent measurement and iteration-varying disturbance.

#### 5. Conclusions

In this paper, the problem of ILC design for linear networked systems with intermittent measurements and iteration-varying disturbances has been investigated. A stochastic variable satisfying the Bernoulli random binary distribution is utilized to characterize the data missing phenomenon, and then the design of ILC law has been transformed into control problem of a 2D stochastic system. A sufficient condition of mean-square asymptotic stability is established by means of LMI technique. An example is given to demonstrate the effectiveness and feasibility of the proposed design methods. This paper gives a systematic design approach for stochastic ILC based on 2D system.

#### Conflict of Interests

There is no conflict of interests regarding the publication of the paper.

#### Acknowledgments

This work is supported by the Program of NSFC (no. 61203065 and no. 61340041), the program of Natural Science of Henan Provincial Education Department (12A510013), the program of Open Laboratory Foundation of Control Engineering Key Discipline of Henan Provincial High Education (KG 2011-10), the program of Key Young Teacher of Henan Polytechnic University, and the Doctoral Fund Program of Henan Polytechnic University (B2012-003).

#### References

- S. Arimoto, S. Kawamura, and F. Miyazaki, “Bettering operation of robots by learning,”
*Journal of Robotic Systems*, vol. 1, no. 2, pp. 123–140, 1984. View at Google Scholar - D. A. Bristow, M. Tharayil, and A. G. Alleyne, “A survey of iterative learning control: a learning-based method for high-performance tracking control,”
*IEEE Control Systems Magazine*, vol. 26, no. 3, pp. 96–114, 2006. View at Publisher · View at Google Scholar · View at Scopus - H.-S. Ahn, Y. Chen, and K. L. Moore, “Iterative learning control: brief survey and categorization,”
*IEEE Transactions on Systems, Man and Cybernetics C: Applications and Reviews*, vol. 37, no. 6, pp. 1099–1121, 2007. View at Publisher · View at Google Scholar · View at Scopus - T. C. Yang, “Networked control system: a brief survey,”
*IEE Proceedings: Control Theory and Applications*, vol. 153, no. 4, pp. 403–412, 2006. View at Publisher · View at Google Scholar · View at Scopus - J. P. Hespanha, P. Naghshtabrizi, and Y. G. Xu, “A survey of recent results in networked control systems,”
*Proceedings of the IEEE*, vol. 95, no. 1, pp. 138–162, 2007. View at Google Scholar - W. Zhang, M. S. Branicky, and S. M. Phillips, “Stability of networked control systems,”
*IEEE Control Systems Magazine*, vol. 21, no. 1, pp. 85–99, 2001. View at Google Scholar - X. H. Bu, Z. S. Hou, and F. S. Yu, “Stability of first and high order iterative learning control with data dropouts,”
*International Journal of Control, Automation and Systems*, vol. 9, no. 5, pp. 843–849, 2011. View at Publisher · View at Google Scholar · View at Scopus - X. H. Bu, F. S. Yu, Z. S. Hou, and F. Z. Wang, “Iterative learning control for a class of nonlinear systems with random packet losses,”
*Nonlinear Analysis: Real World Applications*, vol. 14, no. 1, pp. 567–580, 2013. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus - X.-H. Bu and Z.-S. Hou, “Stability of iterative learning control with data dropouts via asynchronous dynamical system,”
*International Journal of Automation and Computing*, vol. 8, no. 1, pp. 29–36, 2011. View at Publisher · View at Google Scholar · View at Scopus - H.-S. Ahn, Y. Chen, and K. L. Moored, “Intermittent iterative learning control,” in
*Proceedings of the IEEE International Symposium on Intelligent Control (ISIC '06)*, pp. 832–837, Munich, Germany, October 2006. View at Publisher · View at Google Scholar · View at Scopus - H.-S. Ahn, Y. Q. Chen, and K. L. Moore, “Discrete-time intermittent iterative learning controller with independent data dropouts,” in
*Proceedings of the 17th World Congress, International Federation of Automatic Control (IFAC '08)*, pp. 12442–12447, Seoul, South Korea, July 2008. View at Publisher · View at Google Scholar · View at Scopus - C. P. Liu, J. X. Xu, and J. Wu, “Iterative learning control for network systems with communication delay or data dropout,” in
*Proceedings of the 48th IEEE Conference on Decision and Control*, pp. 4858–4863, Shanghai, China, December 2009. View at Publisher · View at Google Scholar · View at Scopus - L. H. Xie, “Output feedback ${\text{H}}_{\infty}$ control of systems with parameter uncertainty,”
*International Journal of Control*, vol. 63, no. 4, pp. 741–750, 1996. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus - G. Pascal and A. Pierre, “A linear matrix inequality approach to ${H}_{\infty}$ control,”
*International Journal of Robust and Nonlinear Control*, vol. 4, no. 4, pp. 421–448, 1994. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus - Y. Zhao, Z. S. Duan, G. H. Wen, and G. R. Chen, “Distributed ${H}_{\infty}$ consensus of multi-agent systems: a performance region-based approach,”
*International Journal of Control*, vol. 85, no. 3, pp. 332–341, 2012. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus - K. L. Moore, H.-S. Ahn, and Y. Chen, “Iteration domain ${H}_{\infty}$-optimal iterative learning controller design,”
*International Journal of Robust and Nonlinear Control*, vol. 18, no. 10, pp. 1001–1017, 2008. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus - D. Y. Meng, Y. M. Jia, J. P. Du, and F. Yu, “${H}_{\infty}$-based design approach to discrete-time learning control systems with iteration-varying disturbances,” in
*Proceedings of the 48th IEEE Conference on Decision and Control*, pp. 4882–4887, Shanghai, China, December 2009. View at Publisher · View at Google Scholar · View at Scopus - X. H. Bu, Z. S. Hou, F. S. Yu, and F. Z. Wang, “${H}_{\infty}$ iterative learning controller design for a class of discrete-time systems with data dropouts,”
*International Journal of Systems Science*, 2013. View at Publisher · View at Google Scholar - A. Haber, R. Fraanje, and M. Verhaegen, “Linear computational complexity robust ILC for lifted systems,”
*Automatica*, vol. 48, no. 6, pp. 1102–1110, 2012. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus - C. Du, L. Xie, and C. Zhang, “${H}_{\infty}$ control and robust stabilization of two-dimensional systems in Roesser models,”
*Automatica*, vol. 37, no. 2, pp. 205–211, 2001. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus - E. Rogers, K. Galkowski, and D. H. Owens,
*Control Systems Theory and Applications for Linear Repetitive Processes*, vol. 349 of*Lecture Notes in Control and Information Sciences*, Springer, Berlin, Germany, 2001. View at MathSciNet - E. Rogers, K. Galkowski, A. Gramacki, J. Gramacki, and D. H. Owens, “Stability and controllability of a class of 2-D linear systems with dynamic boundary conditions,”
*IEEE Transactions on Circuits and Systems I: Fundamental Theory and Applications*, vol. 49, no. 2, pp. 181–195, 2002. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus - L. Hladowski, K. Galkowski, Z. Cai, E. Rogers, C. T. Freeman, and P. L. Lewin, “Experimentally supported 2D systems based iterative learning control law design for error convergence and performance,”
*Control Engineering Practice*, vol. 18, no. 4, pp. 339–348, 2010. View at Publisher · View at Google Scholar · View at Scopus - L. Hladowski, K. Galkowski, Z. Cai, E. Rogers, C. T. Freeman, and P. L. Lewin, “A 2D systems approach to iterative learning control for discrete linear processes with zero Markov parameters,”
*International Journal of Control*, vol. 84, no. 7, pp. 1246–1262, 2011. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus - J. Shi, F. Gao, and T.-J. Wu, “Robust design of integrated feedback and iterative learning control of a batch process based on a 2D Roesser system,”
*Journal of Process Control*, vol. 15, no. 8, pp. 907–924, 2005. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus - H. Gao, J. Lam, S. Xu, and C. Wang, “Stability and stabilization of uncertain 2-D discrete systems with stochastic perturbation,”
*Multidimensional Systems and Signal Processing*, vol. 16, no. 1, pp. 85–106, 2005. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus - S. Boyd, L. E. Ghaoui, E. Feron, and V. Balakrishnan,
*Linear Matrix Inequalities in System and Control Theory*, vol. 15 of*SIAM Studies in Applied Mathematics*, SIAM, Philadelphia, Pa, USA, 1994. View at Publisher · View at Google Scholar · View at MathSciNet