Mathematical Problems in Engineering

Volume 2013 (2013), Article ID 747053, 9 pages

http://dx.doi.org/10.1155/2013/747053

## Robust Iterative Learning Control for a Class of Linear Systems with Data Dropouts

School of Electrical Engineering & Automation, Henan Polytechnic University, Jiaozuo 454000, China

Received 26 March 2013; Accepted 10 July 2013

Academic Editor: Yingwei Zhang

Copyright © 2013 Wang Rui et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

A robust iterative learning control algorithm is proposed for a class of intermittent systems with disturbances and uncertain initial conditions. Based on the contraction mapping approach, the convergence condition for the proposed algorithm is first given, and then the bounds on control input and output trajectories can be obtained. It is shown that these bounds depend on bounds on the initial condition errors and disturbances, and the bounds are zero in the absence of these disturbances. A numerical example is also given to verify the theoretical result.

#### 1. Introduction

Iterative learning control (ILC) is an attractive technique when it comes to dealing with systems that execute the same task repeatedly over a finite time interval. The key feature of this technique is to use information from the previous (and/or current) operation (or iteration) in order to enable the controlled system to perform progressively better from operation to operation. This technique has been the center of interest of many researchers over the last two decades [1–6]. Robustness is an important issue for control approaches [7–9], especially in practical systems. Hence, the robustness for ILC has been discussed in several aspects [3, 4, 6].

On the other hand, networked control systems (NCSs) are also the focus of many research studies over the last few decades [10–13]. Compared to the conventional point-to-point system connection, NCSs have the advantages of easy installation and reduced setup, wiring, and maintenance costs. In NCSs, data can travel through the communication channels from the sensors to the controller and from the controller to the actuators. Data packet dropout (a kind of uncertainty) is a common problem in networked control systems and could happen due to node failures or network congestion. Because of random dropout, conventional methods for estimation and control cannot be used directly.

The data dropout problem in the context of ILC has been studied in [14–19], and such an ILC system is a call intermittent ILC system. In [14, 15], an optimal learning gain matrix is given for intermittent ILC systems. They considered the problem where each component in the multivariable output vector of the plant is subject to a dependent or independent dropout, respectively. In [16], an averaging ILC algorithm is proposed to overcome the random data dropout, and it is shown that such an ILC algorithm can perform well and achieve asymptotic convergence in ensemble average along the iteration axis. In [17], the convergence of first-order ILC and high-order ILC for linear intermittent ILC systems is considered. Using the super-vector technique, such an ILC system can be modeled as an asynchronous dynamical system with rate constraints on events in the iteration domain, and then the convergence condition can be provided by solving a binary linear matrix inequality. It is worth noting that the binary linear matrix inequality is difficult to be solved, especially for the high order ILC scheme. To avoid the problem, another convergence condition in the expectation sense is given in [18]. In [19], the issue of intermittent ILC is considered for a class of nonlinear systems. Key conclusions of these works are that the ILC systems can still guarantee convergence in the face of data dropout as long as there is not a 100% dropout.

All the aforementioned papers are considered intermittent ILC systems under the two common assumptions, identical initial condition and iteration-independent disturbances. However, in the practical implementation, the initial condition is often uncertain, and the disturbance is also stochastic, nonrepeating disturbances, such as measurement disturbance (or measurement noise). Hence, it is necessary to understand exactly how disturbances and uncertain initial conditions affect the intermittent ILC process and to develop ILC algorithms that are robust to their presence. This paper proposes a robust ILC design approach for intermittent ILC systems in the presence of both uncertain initial conditions and nonrepeating disturbances. After introducing a forgetting factor, the improved ILC algorithm can obtain a better performance in handling initial shifts and disturbances, while the P type ILC obtains the large tracking errors.

The remainder of this paper is organized as follows. In Section 2, the problem formulation is first described, and then a robust ILC law is proposed. In Section 3, a sufficient condition which guarantees the stability of the intermittent ILC system is given. In Section 4, an example is presented to validate the theoretical result. Finally, some conclusions are given in Section 5.

#### 2. Problem Formulation

Consider the following linear discrete-time system: where denotes the iteration number and is a finite time interval. is the state vector, is the input vector, and is the output vector, , , . are bounded state and output disturbance.

The following assumptions for the linear system (1) are given.

*Assumption 1. *For a given desired trajectory , there exists a desired control input such that
where is the desired state and is the desired input.

*Assumption 2. *The disturbances are bounded in sense of , , where , are positive constants.

*Assumption 3. *All operations start within a neighborhood of in the sense of , where is positive constant. This assumption is natural in many repetitive dynamic systems such as the repeatability in robot specifications.

The control target is to find a control input sequence , such that converges to as ; that is, as the learning iteration repeats, the system output converges to the desired trajectory. It is assumed that the ILC algorithm is implemented via a networked control system. That is, the sensor, actuator, and the linear system are remotely controlled by an iterative learning controller that interchanges output measurement and control signals through a communication network. In the sensor and controller sides, they are time driven, and in the actuator side it is event driven. The network can be modeled as a switch that opens and closes in a random manner. When a switch is open, its output is held at the previous value, and the data packet is lost. As mentioned in [10–13], there are two different types of data dropouts in networked control systems. This paper only considers the output measurement dropout. The system output is passed through the network, and there may be random dropouts. Thus, the current observation is the controller received output, which is the system output with the probability of . In the case of no new data, previous data will be used, so the previous data, , will be used with the probability of . These can be represented by the following relations:
here, the stochastic parameters consist of independent and identically distributed Bernoulli random variables taking the values of 0 or 1 with
where are known constants and stands for the mathematical expectation of . Obviously, is independent of , , and .

In this paper, we consider the following ILC algorithm:
where is the measurement error and is the learning gain matrix which is to be chosen. is a forgetting factor.

*Remark 4. *As stated in [20], the forgetting factor is introduced to prevent the input from wandering too much initially. In addition, it may be allowed to vary with the iteration to further improve performance. We leave it fixed for simplicity of presentation.

The -norm will be used in this paper. It is defined by
for a vector function .

#### 3. Convergence Analysis

Before giving the main results, we first give the following lemma [18].

Lemma 5. *Suppose a real positive series satisfies
**
where (), , and . Then the following holds:
*

*Proof. *The proof can be found in [21].

Then, the following theorem can be obtained which shows that the iterative learning control scheme given in (5) can guarantee the asymptotic convergence of the output error.

Theorem 6. *For the linear system (1), under Assumptions 1–3, when the ILC algorithm (5) is used, if
**
then as , the expectation of input and output errors is bounded. These bounds depend on the bound on the , , , and . As , , , and tend to zero, these bounds also tend to zero.*

*Proof. *Denote , notice that
then,

Similarily, we also can obtain
where .

Considering the control error at iteration and using (11) and (12), we have
Taking the norm of both sides of (13) and making use of the general properties of norms, we can obtain that
Taking expectation in both sides of (14), consider that is independent of , ; we have
where

For any positive integer , it can be calculated that
where is defined as , , ().

From (17), we can obtain
where .

From (15) and (18), the following can be easily obtained:
where , .

Multiplying both sides of (19) by (), we can obtain
where ; then
where , .

Obviously, since , we can find a sufficiently small such that
then, using Lemma 5 and the inequality (21), we have

From (12) and (18), we can obtain
where . That is,
and (24) and (25) mean that the expectation of input and output errors is bounded as ; these bounds depend on the bound on the , , , and . As , , , and tend to zero, these bounds also tend to zero.

This completes the proof.

*Remark 7. *In this paper, we consider the intermittent measurement for linear ILC systems. From the proof of Theorem 6, it is easy to see that the method proposed can be extended to solving problems in other frameworks such as sensor delay, input signal dropouts and and the system can also be extended to linear time varying systems. Besides, if the ILC algorithm is chosen as , the similar result can also be obtained.

*Remark 8. *In many applications, we desire to stop the process in a finite time, and we desire the error to be as small as possible. In this case, the forgetting factor is helpful, and varying operator as the iterations progress may improve performance. The bias term is initially useful to keep the input from wandering excessively. Once the input has converged fairly well, we may want to begin decreasing the learning gain to cause the input to average out random disturbances, thus improving the accuracy of the final input. It is easily seen that these modifications do not change the results of Theorem 6.

#### 4. Numerical Example

In this section, an example is given to verify our conclusions. Consider the following linear system: The desired trajectory is

We assume , and that means 25% packet dropouts. The learning gain in (5) is given as . To check the tracking performance of the ILC law, we consider the following three cases. Case 1: , , , . Case 2: , , , . Case 3: , , , .

Case 1 means that the intermittent ILC system does not contain any initial state error and disturbances. In this case, checking the condition in Theorem 6, we can obtain ; the intermittent ILC system is stable. Due to , , , , the tracking error satisfies . In order to obtain an estimate of , the simulation is repeated 50 times, and the expectation operator is implemented as a mean over the simulations. The simulation results are shown in Figures 1 and 2. As shown in Figure 1, the maximum tracking error goes to zero as iteration increases when no initial state error and disturbances exist. Figure 2 gives the system output profiles at different iterations. Obviously, the system tracking error converges from iteration to iteration. However, the convergence is not monotonic but is asymptotic. Case 2 means that the intermittent ILC system contains initial state error and disturbances. Simulation results for this case are shown in Figures 3 and 4. It is observed that the tracking error cannot converge to zero, and the bounded error is caused by initial state error and bounded disturbances. To improve the performance of the ILC system, the robust ILC with a forgetting factor is introduced in case 3. In this case, the condition of Theorem 6 is , and then the system is stable. Figures 5 and 6 give the tracking errors and system output profiles at different iterations, respectively. Comparing Figure 3 with Figure 5, we observe that the better tracking performance can be obtained when the robust ILC law is used.

#### 5. Conclusions

In this paper, the robust iterative learning control design for a class of intermittent systems with disturbances and uncertain initial conditions is considered. It is shown that the robust convergence of the intermittent ILC system can be guaranteed, and the asymptotic trajectory errors for the control input and output trajectories are bounded. These bounds depend on bounds on the initial condition errors and disturbances, and the bounds are zero in the absence of these disturbances. Simulation results show that the robust iterative learning control can attenuate these bounds effectively. In future work, we will discuss the proposed ILC algorithm for nonlinear systems and design robust learning gains to improve the transient behavior of the intermittent ILC systems.

#### Acknowledgments

This work was supported by the National Science Foundation of China (61203065), the Program of Natural Science of Henan Provincial Education Department (12A510013, 12B520020), and the Program of Open Laboratory Foundation of Control Engineering Key Discipline of Henan Provincial High Education (KG 2011-10).

#### References

- S. Arimoto, S. Kawamura, and F. Miyazaki, “Bettering operation of robots by learning,”
*Journal of Robotic Systems*, vol. 1, no. 2, pp. 123–140, 1984. View at Google Scholar - Z. Bien and J. X. Xu,
*Iterative Learning Control: Analysis, Design, Integration and Applications*, Kluwer Academic Publishers, Dordrecht, The Netherlands, 1998. - H.-S. Ahn, Y. Q. Chen, and K. L. Moore, “Iterative learning control: brief survey and categorization,”
*IEEE Transactions on Systems, Man and Cybernetics Part C*, vol. 37, no. 6, pp. 1099–1121, 2007. View at Publisher · View at Google Scholar · View at Scopus - D. A. Bristow, M. Tharayil, and A. G. Alleyne, “A survey of iterative learning control: a learning-based method for high-performance tracking control,”
*IEEE Control Systems Magazine*, vol. 26, no. 3, pp. 96–114, 2006. View at Publisher · View at Google Scholar · View at Scopus - R. Chi, Z. Hou, and J. Xu, “Adaptive ILC for a class of discrete-time systems with iteration-varying trajectory and random initial condition,”
*Automatica*, vol. 44, no. 8, pp. 2207–2213, 2008. View at Publisher · View at Google Scholar · View at Scopus - M. Sun and D. Wang, “Initial shift issues on discrete-time iterative learning control with system relative degree,”
*IEEE Transactions on Automatic Control*, vol. 48, no. 1, pp. 144–148, 2003. View at Publisher · View at Google Scholar · View at Scopus - T. Wang, S. Tong, and Y. Li, “Robust adaptive fuzzy control for nonlinear system with dynamic uncertainties based on backstepping,”
*International Journal of Innovative Computing, Information and Control*, vol. 5, no. 9, pp. 2675–2688, 2009. View at Google Scholar · View at Scopus - S. Tong, W. Wang, and L. Qu, “Decentralized robust control for uncertain T-S fuzzy large-scale systems with time-delay,”
*International Journal of Innovative Computing, Information and Control*, vol. 3, no. 3, pp. 657–672, 2007. View at Google Scholar · View at Scopus - S. Tong, C. Liu, and Y. Li, “Fuzzy-adaptive decentralized output-feedback control for large-scale nonlinear systems with dynamical uncertainties,”
*IEEE Transactions on Fuzzy Systems*, vol. 18, no. 5, pp. 845–861, 2010. View at Publisher · View at Google Scholar · View at Scopus - W. Zhang, M. S. Branicky, and S. M. Phillips, “Stability of networked control systems,”
*IEEE Control Systems Magazine*, vol. 21, no. 1, pp. 84–97, 2001. View at Publisher · View at Google Scholar · View at Scopus - P. Seiler and R. Sengupta, “An ${H}_{\infty}$ approach to networked control,”
*IEEE Transactions on Automatic Control*, vol. 50, no. 3, pp. 356–364, 2005. View at Publisher · View at Google Scholar · View at MathSciNet - J. Wu and T. Chen, “Design of networked control systems with packet dropouts,”
*IEEE Transactions on Automatic Control*, vol. 52, no. 7, pp. 1314–1319, 2007. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus - Q. Ling and M. D. Lemmon, “Power spectral analysis of networked control systems with data dropouts,”
*IEEE Transactions on Automatic Control*, vol. 49, no. 6, pp. 955–960, 2004. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus - H.-S. Ahn, Y. Chen, and K. L. Moored, “Intermittent iterative learning control,” in
*Proceedings of the IEEE International Symposium on Intelligent Control (ISIC '06)*, pp. 832–837, October 2006. View at Publisher · View at Google Scholar · View at Scopus - H.-S. Ahn, K. L. Moore, and Y. Chen, “Discrete-time intermittent iterative learning controller with independent data dropouts,” in
*Proceedings of the 17th World Congress, International Federation of Automatic Control (IFAC '08)*, pp. 12442–12447, July 2008. View at Publisher · View at Google Scholar · View at Scopus - C. Liu, J. Xu, and J. Wu, “Iterative learning control for network systems with communication delay or data dropout,” in
*Proceedings of the 48th IEEE Conference on Decision and Control*, pp. 4858–4863, China, December 2009. View at Publisher · View at Google Scholar · View at Scopus - X.-H. Bu and Z.-S. Hou, “Stability of iterative learning control with data dropouts via asynchronous dynamical system,”
*International Journal of Automation and Computing*, vol. 8, no. 1, pp. 29–36, 2011. View at Publisher · View at Google Scholar · View at Scopus - X. Bu, Z. Hou, and F. Yu, “Stability of first and high order iterative learning control with data dropouts,”
*International Journal of Control, Automation and Systems*, vol. 9, no. 5, pp. 843–849, 2011. View at Publisher · View at Google Scholar · View at Scopus - X. H. Bu, F. S. Yu, Z. S. Hou, and F. Z. Wang, “Iterative learning control for a class of nonlinear systems with random packet losses,”
*Nonlinear Analysis: Real World Applications*, vol. 14, no. 1, pp. 567–580, 2013. View at Google Scholar - G. Heinzinger, D. Fenwick, B. Paden, and F. Miyazaki, “Stability of learning control with disturbances and uncertain initial conditions,”
*IEEE Transactions on Automatic Control*, vol. 37, no. 1, pp. 110–114, 1992. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus - Y. Chen, Z. Gong, and C. Wen, “Analysis of a high-order iterative learning control algorithm for uncertain nonlinear systems with state delays,”
*Automatica*, vol. 34, no. 3, pp. 345–353, 1998. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet