Analysis of Iterative Learning Control for a Class of Linear Discrete-Time Switched Systems
An iterative learning control scheme is applied to a class of linear discrete-time switched systems with arbitrary switching rules. The application is based on the assumption that the switched system repetitively operates over a finite time interval. By taking advantage of the super vector approach, convergence is discussed when noise is free and robustness is analyzed when the controlled system is disturbed by bounded noise. The analytical results manifest that the iterative learning control algorithm is feasible and effective for the linear switched system. To support the theoretical analysis, numerical simulations are made.
A switched system consists of a family of subsystems described by differential equations or difference equations, whose switching rules are usually considered to be arbitrary. The switched systems belong to the hybrid systems and have attracted flourishing investigations in the latest decade [1–8]. The current study of the switched system focuses mainly on the analysis of the dynamic behaviors including stability, controllability, reachability, and observability [1–6]. In particular, the concept of finite time stochastic stability for switched stochastic systems under asynchronous switching assumption has been raised as shown in recent references [7, 8]. The basic reason for studying such systems comes mainly from the fact that the switched systems have been widely emerged in the field of control and engineering practice, such as chemical systems, process control, and automotive industry [9, 10]. Although the investigation on the switched systems is flourishing, the study on designing a controller for trajectory tracking of the switched system is still rare. On the other hand, in engineering practice, the dynamics of the plant model is usually unknown and some uncertain disturbance is unavoidable. These adverse effects together with random switching rules increase challenge of designing an efficacious controller for a tracking performance of a switched system.
Fortunately, there exists a kind of efficient control scheme, named as iterative learning control (ILC), which has also drawn increasing attention for its simple control structure and perfect learning performance. One of the advantages of ILC is that it requires less knowledge of the controlled system in the procedure of learning. It utilizes the tracking error information of the previous operations to compensate for the current control input so as to generate an upgraded control input for the next operation. By this successive learning process, the tracking performance of the controlled system is improved. In view of the above properties of ILC, it can be used in the switched systems for tracking a given target. However, to authors’ knowledge, there are few efforts on the study of the ILC strategies for the switched systems. So far, few literatures [9, 11, 12] have focused on the issue.
In literature , a P-type ILC scheme has been applied to a class of linear discrete-time switched systems. The convergence property for such an ILC system has been analyzed by super vector approach. However, the robustness of the ILC algorithm is not covered for the case when the controlled system is interfered by model uncertainty or external noise. As known, there exist two main criteria to measure the learning performance of an ILC scheme. One is convergence and the other is robustness. Since noise and uncertainty are inevitable in the engineering practice, it is necessary to analyze the robustness of an ILC algorithm.
In the literatures [11, 12], D-type ILC algorithms have been proposed for a class of discrete-time linear and nonlinear switched systems. The convergence conditions are derived in the sense of -norm. Yet, it has been commented that, in the literature , when using -norm, the impact of the system dynamics and the learning gains on the learning performance is extremely suppressed by the sufficiently larger parameter to ensure the convergence. Thus it is possible that an improper choice of the parameter may spoil a fair assessment of the tracking behaviors in practice . Also, the articles [11, 12] do not involve the robustness which is a key criterion of learning algorithm. Thus the study of ILC algorithms for the switched systems needs to be further expanded.
Motivated by the drawbacks of the literatures [9, 11, 12], the paper discusses the convergence and the robustness of a P-type ILC algorithm for a kind of discrete linear discrete time-invariant switched systems with a fixed arbitrary switching rule. The convergence and robustness are analyzed in the iteration domain using the super vector approach. Firstly, the sufficient condition of convergence is given and then, significantly, the robustness of the algorithm is analyzed when the control switched system is interfered by bounded measurement noise. In order to manifest the validity and effectiveness of the ILC algorithm, numerical simulation for a simple example is made.
The rest of the paper is organized as follows. Section 2 presents the fundamental problem. Section 3 exhibits the learning process description in the form of super vector and the learning performance analysis. In order to show the feasibility and effectiveness of the theoretical results, numerical simulations are given in Section 4 and the conclusion is drawn in the last section.
2. Fundamental Problem Description
Consider a class of linear discrete time-invariant single-input, single-output switched systems described as follows: Here, , , and are the state variable, the input variable, and the output variable, respectively. The set , , stands for the operation time duration each trial, ; denotes the time instant. The subscript , , denotes iteration number. The symbol represents random switching rule defined by with , . This implies that the matrices group can be taken as an arbitrary element of following finite set:
For a given desired trajectory , , the objective of an ILC for the system (1) is to generate an input sequence in a recursive mode by learning from the previous experience such that it can drive the system (1) to track the desired trajectory , , as precisely as possible, mathematically: where is the tracking error.
Analysis of this paper is basis of the following primary assumptions [9, 11].(A1)All operations start at identical initial state; that is, , for any . Without loss of generality, it is assumed that .(A2)The desired trajectory , , is iteration-invariant.(A3)For the given desired trajectory , , there exists a desired control input signal , , and a desired state vector , , such that
In this paper, a P-type ILC scheme is considered as where denotes the proportional learning gain.
3. Learning Performances Analysis
3.1. Super Vector Representation of ILC
Given an arbitrary , the outputs at time instants from to of the th trial can be, respectively, calculated as
For the sake of expression simplicity, the following “super vectors” are denoted as Then the system (6) can be equivalently represented as the following input-output response linear system: whereTaking assumption (A1) into account reduces . Considering and denoting , the system (8) becomes where and .
Remark 1. It is noted that the presentation in the form of super vector reflects the dynamical properties of the system (1) in the iteration domain. For the linear time-varying switched systems and some kinds of nonlinear switched systems, similar description can also be derived. Thus the results in this paper can be generalized to some linear time-varying switched systems and some classes of nonlinear switched systems.
Consequently, the control objective of ILC in the form of super vector can be equivalently described as searching such an input super vector sequence , that it can drive the system (10) to track the desired trajectory as precisely as possible as the iteration number tends to infinite; that is, Here, “” denotes some vector norm and represents tracking error super vector which is defined as
In the form of the super vector, the updating law (5) is reformulated as where is the learning gain matrix which consists of the learning gains of updating law (5). Now original two-dimensional ILC problem is converted into a one-dimensional linear input-output response problem .
3.2. Convergence and Robustness Analysis
Theorem 2. Assume that the ILC algorithm (13) is imposed on the linear switched system (10) with an arbitrary switching sequence , . Then the tracking error converges monotonically in the sense of some vector norm if the inequality holds, where “” denotes the induced matrix norm.
Proof. By the definition of the tracking error, it is easy to derive
Taking norm of both sides of (16) and using norm inequality yield
where or . Considering assumption gets
This completes the proof.
It is noted that the elements of the matrix are not determined in advance, as the switching rule of the controlled system is arbitrary. In the process of analysis, it is assumed that the condition (15) holds for all possibilities of .
Remark 3. The assumption (15) is a sufficient condition for monotone convergence. In particular, in the case when , , it derives Here denotes the spectral radius of and represents the singular value of , which is defined as . In the following discussion, we consider that , in (15).
There are two types of errors, namely, the contaminated tracking error and the uncontaminated tracking error to measure the learning behavior at the th trial. They are, respectively, defined as Clearly, the relationship of and is .
The signal is the observed error at the th iteration regardless of the noise at this trial (it is only influenced by previous noise signals , ). It is an option to assess the tracking behavior of the learning algorithm, whereas, since the noise is transferred by the learning process, the current input vector ought to be compensated by the contaminated error at the th trial; that is to say, the updating law (13) is reformulated as By the definition of the tracking error vector, the evolution of the uncontaminated tracking error vector at two adjacent trials can be inferred as
Theorem 4. Consider (24) which is derived by using the updating law (23) on the switched system (21). Then is bounded if the noise vectors satisfy for any and , where “” stands for the supremum of a sequence.
Proof. Taking the Euclidean norm of both sides of (24) yields Using the relation (25) successively derives Taking the assumption for any into account and denoting , inequality (26) becomes Since , it is easy to conclude that . This implies that This completes the proof.
Remark 5. It is seen from estimation (28) that the value of is mainly related to the boundary of the noise. The smaller magnitude of will lead to better tracking performance. In particular, when the noise is free, the monotone convergence of the uncontaminated tracking error in the sense of Euclidean norm is achieved, which is consistent with Theorem 2. In the case when the value of is determined, the influence of the noise can be reduced by decreasing the value of .
Remark 6. The super vector approach employed in the paper is a tool to theoretically analyze the learning performance of the addressed ILC algorithm. Since it converts the original two-dimensional problem into a one-dimension linear input-output response problem, it can deal with the ILC problem only in the iterative domain regardless of time domain. This brings a great convenience for designing a controller and for theoretical analysis.
Remark 7. Compared with the existing ILC algorithms for the linear switched systems in the literatures [9, 11], this paper analyzes robustness to external measurement noise by employing super vector method, which is one of significant issues in the procedure of designing an applicable controller. Additionally, it is observed that, for the switched systems, the convergence and robustness are guaranteed on the basis that the system dynamics is required to be iteration-invariant, though the system arbitrarily switches among the subdynamics. The case that can be regarded as the system dynamics is time-varying. The analysis implies that the ILC scheme may work well for time-varying systems. This turns to be the significance of the ILC strategy that it requires less a prior of system knowledge.
Remark 8. It is necessary to point out that the study on the ILC algorithms for switched systems is more arduous than that for nonswitched systems, since the dynamical behaviors of switched systems are more complex. As seen that a switched system obeys diverse subdynamics, compared with an ILC algorithm for a nonswitched system, the ILC scheme for a switched system requires much more memory to store the switching rules as well as the subdynamics. It would be a dimensional disaster in the case when the system dimension is higher and the sampling number is much larger. However, the memory requirement will be solved sooner or later with the advancing of information technology. Next, hinted by the manner of the existing references [9, 11, 12, 15], the study of the paper for the switched system is based on the premise that the switching rule is time-dependent but iteration-invariant; that is, the switching rule varies along the time axis but it must be fixed for the whole learning process once the switching rule is selected for the starting learning. This requirement is crucial. For a general case when the switching rule is fired randomly both in time axis and in iteration direction, how to analyze the learning performance is a key difficulty. The issue will be investigated in future work.
4. Numerical Simulations
To manifest the validity and the effectiveness of the algorithm, a simple example is considered, which has served as an example in the literature . The switched system with three subsystems is formulated as follows: Here, the operation discrete time duration is set as (i.e., ). Given arbitrary positive integers () belonging to , the arbitrarily switching sequence is defined as Two possible switching sequences of are shown in Figure 1.
The system dynamics are given as The desired trajectory is selected as , . The initial state is set as for all and the starting input vector is chosen as . Throughout the implementation, the learning gains are chosen to be time-invariant and set as . In this case, the condition holds.
Assume that the system (29) is not interfered by any external noise and the updating law (13) is applied. Figure 2 exhibits the curve of from the 1st iteration to the 50th iteration. Obviously, is convergent in the iteration domain. Figure 3 depicts the system outputs at the 5th iteration, the 10th iteration, and the 15th iteration. It is seen that the output of the switched system (29) can track the desired trajectory asymptotically as the iteration number enlarges. These indicate that ILC algorithm (13) is valid for the case when uncertain noise is neglected.
Suppose that the system (29) is randomly disturbed by a set of bounded measurement disturbance. One of disturbance set in an arbitrary trial is shown in Figure 4. The boundary of implies that is bounded too. The value of is calculated and its profile is shown in Figure 5. Then the magnitude of (instead of in Theorem 4) is calculated and the curve of is illustrated in Figure 6. It is obvious that the values of both and are bounded as iteration number enlarges.
The system outputs at the 10th trial and the 15th trial are exhibited in Figure 7. It is observed that the tracking performance of the ILC algorithm is satisfactory when the switching rule is arbitrarily fixed and the system is disturbed by measurement noise with an acceptable boundary.
In this paper, a P-type ILC algorithm is applied to a kind of discrete switched systems with an arbitrary switching rule. By the super vector approach, the convergence performance is firstly discussed and then the robustness is analyzed when the system is randomly interfered by bounded measurement noise for the case that the switching rule is fixed once it is randomly selected for the first operation. Results manifest that the convergence and robustness can be guaranteed under appropriate conditions. However, for the case when the switching rule is fired randomly both in time axis and iteration direction, the analysis of the convergence and the robustness remain a hanging issue. In addition, the learning performance of the ILC scheme for linear time-varying switched system or nonlinear switched system is a challenging topic.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
The authors sincerely appreciate the supports of the National Natural Science Foundation of China under Grants nos. F010114-60974140 and 61273135.
H.-S. Ahn, K. L. Moore, and Y. Chen, Iterative Learning Control Robustness and Monotonic Convergence for Interval Systems, Springer, New York, NY, USA, 2007.