Abstract

In a multiagent system (MAS), communication signals are affected by harsh wireless networks when they are transmitted from an agent to its neighboring agents, leading to the inconsistency of the MAS. In this paper, an average-iterative learning control (average-ILC) method is studied to address the consensus problem of MAS over wireless networks in the presence of channel noise and data dropout. The combined effects of channel noise and data dropout on iterative learning controllers are carefully analyzed. Based on graph theory and mathematical expectation, the corresponding average-iterative learning scheme is proposed. Especially, a sufficient condition is derived for the average-iterative learning scheme. Rigorous theoretical analysis demonstrates that the convergence of the covariance matrix of tracking error can be guaranteed with the help of an average-iterative learning scheme. Finally, simulation results are given to show the effectiveness of the proposed method.

1. Introduction

The consensus problem has become one of the most popular research studies in collaborative control of MAS [14]. Its purpose is to make each agent of MAS cooperate with others to achieve the desired trajectory and then complete a certain task. Meanwhile, ILC is an effective technology for dynamic systems that operate repetitively because it realizes the control tasks of dynamic systems with high uncertainty in a limited time interval. Thereby, ILC has attracted widespread attention in many areas, such as robotics [5], vehicles [6], industrial automation [7], and batch processes [8]. For these applications of ILC, it can be seen that ILC has a good performance in collaborative tasks. Thus, it is a splendid alternative to apply ILC algorithms in MAS.

The applications of ILC in multiagent frameworks have been developed for many years. ILC was firstly introduced into MAS by Ahn and Chen in [9], and the control input sequence of MAS was iteratively generated to realize formation control. Motivated by it, distributed ILC was proposed for multiagent tracking. In References [10, 11], the authors proposed distributed-ILC methods, which used the relation between local error and global error to solve the tracking problem of continuous-time systems and discrete-time systems, respectively. After that, Meng and Jia [12] extended distributed ILC for MAS to the varying communication topologies. In addition, tracking problems of heterogeneous and nonrepetitive MAS were studied in [13, 14]. Devasia [13] addressed the convergence of ILC for networked and heterogeneous MAS, where each agent has potentially different dynamics. And, the authors in [14] presented a novel ILC algorithm that did not rely on identical reference trajectories over the iteration domain. Besides, data-driven frameworks of ILC for MAS were proposed in [15, 16]. Coincidentally, Bu et al. made a more in-depth study on data-driven ILC and solved the problem of data quantization and limited sensor output [1719]. Bandwidth issues [20] and cyberattacks also increase the difficulty of achieving multiagent consistency control. In [21], a method of dynamic event-triggered scheduling was proposed to deal with the problem of limited bandwidth. In [22], distributed secure control and resource-aware secure control methods are introduced to ensure the security of multiagent networks.

However, an underlying condition of all the abovementioned results is that the signal transmission is reliable, which means that signals were not polluted when they are transmitted from one agent to another. But for MAS, all agents are usually located in different sites and communicate with others via wireless networks. Then, channel noise and data dropout always exist in channels of wireless networks and cause interference to the transmitted signals. Thus, reliable transmission is hard to be realized in actual networks when there are channel noise and data dropout in the wireless communication channel. This increases the design difficulty of iterative learning controllers. To solve this problem, many references give corresponding solutions on channel noise and data dropout. First of all, Kalman filter [23, 24] and adaptive methods [2527] are general ways to eliminate the effect of channel noise on ILC. In addition, Shen and Qu [28] considered the fading channel with both multiplicative and additive randomness, and a decreasing gain sequence was applied in the design of the iterative learning controller. After that, in [29], the robustness of ILC for a class of mobile robot systems with channel noise was analyzed. Then, distributed iterative algorithms for consensus problems were considered for random switching networks with channel noise [30]. Also, data dropout is a common problem existing in wireless communication channels and developing on ILC for many years [3134]. The convergence of ILC with successively dropped input data for a class of discrete-time systems over networks was discussed in [31]. Besides, Shen proposed an iterative learning method for linear stochastic systems under general data dropout environments [32] and then extended it to the data-driven approach [33].

Nevertheless, consensus problems of MAS with ILC in presence of channel noise or data dropout have not been fully investigated. These abovementioned references only consider the impact of channel noise or only the impact of data dropout. It is well known that channel noise and data dropout are unavoidable in wireless communication channels, and they simultaneously act on transmitted signals when the signals are transmitted from one agent to another. Channel noise leads to an inaccurate signal, and data dropout means that the signal is unable to be received by other agents. In other words, the signal cannot be received if data dropout exists; otherwise, the signal is received by other agents in an imprecise form. Then, these combined effects of channel noise and data dropout act on the iterative learning controller, causing the ILC algorithms to fail to converge. This indicates that the design complexity of the iterative learning controller is greatly increased when channel noise and data dropout coexist. Unfortunately, no literature considers channel noise and data dropout simultaneously for ILC of MAS, and ILC schemes proposed by existing references cannot solve this problem well. Therefore, our aim is to design an iterative learning controller to guarantee the convergence of ILC for MAS with channel noise and data dropout.

Motivated by this, in this paper, channel noise and data dropout are both taken into account for MAS. The mixing error caused by channel noise and data dropout will be introduced into the iterative learning controller and then make the outputs of MAS more difficult to reach the desired output. For dealing with this problem, an average-ILC method is proposed. As a result, rigorous theories demonstrate that the effects of both channel noise and data dropout on iterative learning controllers can be effectively eliminated by the proposed method.

The main contributions of this paper are highlighted as follows.(1)As we all know, channel noise and data dropout are important factors affecting signal transmission. As far as we know, there is no paper to study the situation with both channel noise and data loss. Thus, unlike the aforementioned references, channel noise and data dropout are both considered for the consensus problem of MAS using ILC, which further promotes the design complexity of the iterative learning controller and then increases the difficulty of the consensus problem for MAS. In addition, the differences between channel noise and data dropout are described, and their combined effects on ILC for MAS are also depicted in this paper.(2)For channel noise and data dropout introduced by wireless communication channels between neighboring agents, an average-iterative learning controller is designed to eliminate the mixing error caused by them. With the help of the series convergence property, a sufficient condition is proposed. Then, the perfect tracking can be obtained for MAS. In addition, by comparing the method proposed in this article with traditional methods, we verify the effectiveness of the method proposed in this article.

The remainder of this paper is organized as follows. Some preliminaries are made in Section 2, and the consensus problem of MAS with channel noise and data dropout is formulated in Section 3. To deal with this problem, an average-iterative learning scheme is proposed and the corresponding convergence is carefully analyzed in Section 4. The simulation results are shown in Section 5, and the effectiveness of the proposed method is illustrated. Finally, conclusions are given in Section 6.

Notions: represents agents, and contains all discrete time. and denote the column vector with appropriate dimensions whose elements are all ones and all zeros, respectively. is an identity matrix with appropriate dimensions.

2. Preliminaries

2.1. Graph Theory of MAS

Based on algebraic graph theory, we can change the network topology into mathematics matrices. Let be a directed graph consisting of agents, where is agents and is the edge set, and an edge represents a wireless channel where signals are transmitted from to . Therefore, we can associate the adjacency weight of with . Define when ; otherwise, . Moreover, we assume that , that is,

A path in directed graph is a finite sequence and . Define is a nonnegative weighted adjacency matrix of directed graph . Define where is the sum of th row of the weighted adjacency matrix . represents the set of neighbors of agent . The Laplacian matrix of is defined as . If MAS has a virtual leader marked as , then the network topology can be described as , where . Define where with if th agent can obtain information from the virtual leader directly; otherwise, .

2.2. Channel Noise and Packet Loss of MAS

All agents of MAS are located in different positions, and the multiagent consistency is realized through mutual cooperation. This means each agent needs to send signals to others and receive signals from others via wireless networks. However, channel noise and data dropout in wireless networks can cause interference to transmitted signals. Then, the details of channel noise and data dropout are shown in Figure 1. In this figure, agents 1, 2, and 3 are neighboring agents of agent . It is easy to obtain that outputs of neighboring agents (agents 1, 2, and 3) are polluted before agent receives them.

For instance, agent 1 transmits its output to agent via wireless networks. When the output is sent from agent 1, it is , but when it is received by other agents, it is , where is the original signal, is additive white Gaussian noise, and is the randomness of data dropout which follows the Bernoulli distribution. Herein, there is no data dropout if ; otherwise, . To better describe the randomness of these two variables, we assume that and satisfy the following statistics:where represents the successful transfer rate and is the variance of channel noise .

The effects of both channel noise and data dropout on agent are shown in Figure 2. The controller obtains the mixing error , which contains the randomness of channel noise and data dropout. Therefore, the design complexity of the iterative learning controller increases. This means that we need a novel iterative learning scheme to eliminate these effects. For the ease of presentation, we consider the noise as additive white Gaussian noise. In follow-up studies, we will consider other more general noises.

Remark 1. It also assumes that and are known to us because the statistics of both channel noise and data dropout rely on the actual environment. Therefore, in order to obtain the probability of data dropout , we can get the frequency of data dropout through multiple trials. When the number of trials is large enough, the frequency of data dropout is equal to the probability of data dropout. This means the probability of data dropout can be estimated in advance. Besides, is independent of , that is, .

3. Problem Formulation

Consider MAS with agents and the jth one is governed by the following discrete-time dynamics:where , , and represent the state, output, and control input of jth agent, respectively. , , and are system parameters.

For describing all agents of MAS (3), we denote , , and . Then, we can rewrite (3) aswhere , , and .

For a given virtual leader , its output trajectory is the desired trajectory for MAS. In this paper, desired control input satisfieswhere is the desired state.

Based on the descriptions of channel noise and data dropout in Section 2, we learn that both channel noise and data dropout existing in wireless networks pollute the transmitted signals and then increase the uncertainty of MAS. Take agent for example, the output that is received from agent can be described as

For the convenience of the following analysis, is applied in (6). Then, we havewhere and . is described in (2).

Remark 2. is the output of agent and is the signal received by the neighboring agents of agent . It is obvious that is affected by channel noise and data dropout in wireless channels, and then, . Corresponding to the actual process, the first step of (7) means that agent receives the polluted output of agent and then multiplies the factor , which is known to us in advance.
We consider that the topology of MAS (3) has a distributed structure, which means that part of agents can obtain signals from the virtual leader only. Therefore, local error for agent at time and iteration can be expressed aswhere .
Define and where is the element of th row and th column in matrix . Then, the compact form of (8) isFor MAS (3), the tracking error at time and iteration can be described as follows:Then, (9) can be rewritten asDefine , , and . Then, the compact form of (10) isThen, considering all the time, we can just go on and derive the following equations from (9):where , , , and for simplicity.
The objective in this paper is to ensure that the following convergence principle holds:

Remark 3. It is clear that is the local error polluted by channel noise and data dropout, while is the tracking error which represents the error between the outputs of all agents and desired output. In particular, channel noise and data dropout only have effect on the outputs that need to be transmitted, but for the agent itself, its output is not polluted by channel noise and data dropout. Thus, what we should do is to design the iterative learning scheme to eliminate the combined effects of channel noise and data dropout on the iterative learning controller and then to guarantee that all outputs of agents reach the desired output, such as (14).

Assumption 1. The virtual leader is globally reachable in directed graph .

Assumption 2. For all agents and iteration , the initial-time state satisfies

Assumption 3. For all agents , time and iteration , and the channel noise is bounded.

Remark 4. Assumption 2 is a common one in research studies on ILC [25, 29]. If the assumption cannot be satisfied, some methods can be applied to deal with the problem of the initial state, such as adaptive ILC with the neural network [35]. Thereby, for our future work, one of our objectives is to consider the initial state into the framework of ILC for MAS with channel noise and data dropout. Assumption 3 is also a general condition for the controller design [25, 28]. The channel noise is bounded but the bound is unknown. This is consistent with the actual situation.

4. Design of Average-Iterative Learning Controller

Channel noise and data dropout widely exist in the process of wireless signal transmission, which increases the design difficulty of the iterative learning controller. Hence, the research of channel noise and data dropout on ILC is undoubtedly important. In this section, an iterative learning controller is designed for MAS. An average-iterative learning scheme is utilized to deal with the combined effects of channel noise and data dropout on iterative learning controllers.

For realizing objective (14), an average-iterative learning scheme of agent at time and iteration is proposed as follows:

According to the definition of in (4), we havewhere .

Define and , and we can obtain the compact form of (17):

For MAS (3), we define the desired input and input error . Substituting (13) into (18), the compact form of our learning scheme can be converted as follows:

According to the expression of (20), it shows the relation of and . However, the relation of and is not clear, and it plays an important role in our next analysis. Then, we have the following derivation. Based on (10), we can derive thatwhere Assumption 2 is applied in the fourth step.

Then, the compact form of tracking error (12) can be rewritten as follows:where

The relation of and is deduced in (22). Then, we take (22) into (20),where .

Benefitting from above derivations, we can obtain the following theorem and corollary. For the ease of representation, we define .

Theorem 1. Let us consider MAS (3) with channel noise and data dropout, and Assumptions 13 hold. Average-iterative learning scheme (16) is applied. If there exists gain matrix satisfyingthen we have .

Proof. From (24) and definition of , we have following derivations:Noting that and . Besides, and are mutually independent. Thus, we take mathematical expectations on both sides of (26):Norm on both sides of (27):where , , and are suitable values. We can obtain from (24) thatIt is worth noting thatwhere . Thus, we can obtain from (29) thatwhere is the value that we can set. Formula (31) means is bounded, and we can derive from (28) thatwhere and is a suitable value.
Obviously, there is an iteration number so that when , we haveThen, we can derive from (32) thatIt means is bounded. Thus, we can derive from (32) again:where is a suitable value.
It seemed that if cannot converge to zero, we have , where is a suitable value. Thus, we can derive from (35) thatIt is worth noting that when . Then, we have . Obviously, it is impossible. Thus, we can derive thatThis completes the proof.

Corollary 1. Let consider MAS (3) with channel noise and data dropout, and Assumptions 13 hold. Average-iterative learning scheme (16) is applied. Then, the covariance matrix of tracking error asymptotically converges to zero if condition (25) holds, that is, .

Proof. According to the relation of input error and global output error , we can derive from (22) thatwhere is a constant matrix.
According to Theorem 1, we can derive that (37) holds if condition (25) holds. Then, we haveThis completes the proof.

Remark 5. Theorem 1 illustrates that converts to zero in the mean-square sense with the help of average-iterative learning scheme (16). Obviously, the key to the design of the learning scheme is to require the gain matrix to satisfy sufficient condition (25). Corollary 1 derives that the covariance matrix of tracking error converges to zero if converges to zero. It shows that the effects of both channel noise and data dropout on iterative learning controllers can be effectively eliminated by proposed scheme (16), and then, a perfect tracking can be guaranteed for MAS (3).

5. Simulation Results

For illustration and verification, we consider discrete-time MAS (3) with four agents and one virtual leader . The system parameter metrics are shown in (40):

Let the desired output is with . The directed graph of MAS is shown in Figure 3. Then, the weighted adjacent matrix

Average-iterative learning scheme (16) is applied. For all agents, set the state at initial time . The gain matrix is set to be .

To show the effectiveness of the proposed method, a benchmark method is introduced, such as . The only difference between the proposed method and benchmark one is the design of the iterative learning scheme.

Figure 4 shows the outputs of the proposed method and the benchmark one, respectively, when the variance of channel noise is , and the successful transfer rate is . From an intuitive point of view, the effect of outputs of MAS with the proposed method is better than the benchmark one.

To show the effectiveness of the proposed method more intuitively, we compare the convergence of the covariance matrix under the proposed method and benchmark method, such as Figure 5. The setting of channel noise and data dropout is the same as Figure 4. Obviously, the result illustrates that the benchmark method cannot guarantee that the covariance matrix of tracking error converges to zero, whereas the proposed method does.

In this paper, channel noise and data dropout are both considered, and the effects of these two factors on the convergence speed of the covariance matrix of tracking error need to be analyzed when the proposed method is applied.

Figure 6 shows the effects of different variances of channel noise on convergence speed of the covariance matrix of tracking error. In this figure, the successful transfer rate is , and the variances of channel noise are , , and . Then, the result shows that variances of channel noise do affect the convergence speed of tracking error, which still converges to zero. Besides, the smaller the variances, the faster the convergence speed.

The effect of different successful transfer rates on the convergence speed of the covariance matrix of tracking error is depicted in Figure 7. Similarly, the variance of the channel noise is , and the successful transfer rates are , , and . Then, the result of Figure 7 shows that the successful transfer rate affects the convergence speed of tracking error, and the smaller the rates, the faster the convergence speed. Nonetheless, the convergence of tracking error can be guaranteed.

6. Conclusions

This paper deals with the consensus problem of multiagent systems over wireless networks in the presence of channel noise and data dropout via an average-ILC approach. The gain matrix is designed to satisfy sufficient conditions. Rigorous theories demonstrate that the convergence of the covariance matrix of tracking error can be guaranteed with the help of an average-iterative learning scheme. To highlight the effectiveness of the proposed method, a benchmark method is realized to be a reference in Section 5. As a result, it is proved that convergence performance of the proposed method is much better than the benchmark one, and perfect tracking in the sense of expectation can be realized asymptotically. In the future work, consensus problems for a class of MAS with unknown dynamics will be discussed. Then, channel noise, data dropout, and other disturbances in communication channels are also considered.

Data Availability

The data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Acknowledgments

The work was supported by National Natural Science Foundation of China (NSFC) under Grant nos. 61673253 and 61901254.