- About this Journal ·
- Abstracting and Indexing ·
- Advance Access ·
- Aims and Scope ·
- Annual Issues ·
- Article Processing Charges ·
- Articles in Press ·
- Author Guidelines ·
- Bibliographic Information ·
- Citations to this Journal ·
- Contact Information ·
- Editorial Board ·
- Editorial Workflow ·
- Free eTOC Alerts ·
- Publication Ethics ·
- Reviewers Acknowledgment ·
- Submit a Manuscript ·
- Subscription Information ·
- Table of Contents

Abstract and Applied Analysis

Volume 2014 (2014), Article ID 159609, 13 pages

http://dx.doi.org/10.1155/2014/159609

## Consensus of Multiagent Systems with Packet Losses and Communication Delays Using a Novel Control Protocol

College of Automation, Harbin Engineering University, Heilongjiang 150001, China

Received 16 January 2014; Revised 23 February 2014; Accepted 24 February 2014; Published 7 April 2014

Academic Editor: Peng Shi

Copyright © 2014 Zheping Yan et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

This paper studies the consensus problem of multiagent system with packet losses and communication delays under directed communication channels. Different from previous research results, a novel control protocol is proposed depending only on periodic sampling and transmitting data in order to be convenient for practical implementation. Due to the randomicity of transmission delays and packet losses, each agent updates its input value asynchronously at discrete time instants with synchronized time stamped information and evolves in continuous time. Consensus conditions for multiagent system consists of three typical dynamics including single integrator, double integrator, and high-order integrator that are all discussed in this paper. It is proved that, for single integrator agents and double integrator systems with only communication delays, consensusability can be ensured through stochastic matrix theory if the designed communication topology contains a directed spanning tree. While, for double integrator agents and high-order integrator agents with packet losses and communication delays, the interval system theory is introduced to prove the consensus of multiagent system under the condition that the designed communication topology is a directed spanning tree. Finally, simulations are carried out to validate the effectiveness of the proposed solutions.

#### 1. Introduction

Consensus of multiagent system has attracted increasing focuses of researchers from different areas including multiple robotics system, large-scale oceanographic survey, and wireless sensor networks [1–4]. Among all the problems studied aiming at achieving consensus through local interaction, packet losses and communication delays that usually result from unreliable communication links are significant factors which influence the consensusability of multiagent system [5–25]. Considering those problems, three typical agent dynamics, single integrator [5, 9, 16, 23], double integrator [6, 8, 10, 12, 14, 17, 18], and high-order integrator [11, 15], are most widely discussed because they can represent a majority of autonomous systems.

Even though plenty of research results have been carried out about consensus problem of multiagent systems with communication delays, most of the controllers designed cannot be easily practiced. Take two typical controllers; for example, in Gao and Wang [10], the structure of controller implies that each agent has to memorize system states all the time between two sampling instants because of the randomicity of communication delay. In Lin and Jia [12], to deploy the control protocol, each agent has to broadcast the information all the time and only one transmitted data is useful to calculate the control input. In both cases, system resources are wasted to some extent, especially for embedded systems whose resources are ordinarily limited. So in this paper, in order to be convenient for practical implementation and economical for limited system resource, a novel controller structure is proposed depending only on periodic sampling and transmitting data which is the main contribution of this paper. Compared with previously proposed solutions, this protocol greatly relieves the computational burden of each agent. In addition, with this control protocol, it is worth being noticed that since the communication delays are random, each agent updates its input asynchronously at discrete time instants based on received data. But the information transmitted is with synchronized time stamp and the whole system evolves in continuous time.

With the proposed control protocol, interaction topology is time varying due to communication delays and packet losses. Also, many research results about consensus of multiagent systems with dynamically changing topology have been obtained based on stochastic matrix theory and Lyapunov theory. However, Lyapunov theory usually needs the topology to be undirected or balanced [7, 13, 14]. When random transmission delays and packet losses are concerned, undirected or balanced assumption is unreasonable. With the novel control protocol proposed in this paper, it will be shown that, for single integrator agent and second order agent without packet losses, similar results can be obtained as in [8, 9] according to stochastic matrix theory. That is, the consensus can be reached as long as the designed communication topology contains a directed spanning tree. However, when it comes to second order and high-order agent with packet losses and communication delays, stochastic theory is no longer easily applicable since the nonnegativity of the system matrix is not always guaranteed. Actually, to the best of the authors’ knowledge, few results have been obtained to handle this problem. Based on the theory of interval matrix, it will be proved that the consensus of the system can be reached as long as the designed communication topology is a directed spanning tree which is another contribution of this paper. Of course, in this situation, the states of all agents will converge to the root node and average consensus cannot be obtained. However, this assumption can also simplify the system architecture indicating that one agent can only receive message from its superior and send information to its inferiors; this kind of hierarchy structure is actually more efficient and convenient in real-world application. Since the protocol proposed in this paper can be easily implemented for system with limited resources and unreliable communication links, it would have a wide application prospect in multiple autonomous systems, especially for multiple marine systems such AUVs, UUVs, and USVs, that rely on acoustic communication which is characterized by intermittent failures and latency [16].

The rest of the paper is organized as follows. In Section 2, preliminaries are presented and problems concerned are formulated. In Section 3, consensus of the multiagent system with single integrator, double integrator, and high-order integrator are analyzed under different situations. And simulations to prove the results are given in Section 4. Conclusions are made in Section 5.

#### 2. Preliminaries and Problem Formulation

##### 2.1. Graph Theory

Graph theory has played an important role in analysis of multiagent systems for its advantages in modeling the interactions between agents. As graph theory has been introduced in many relative articles, only necessary notations are put forward here. Consider a system with agents and the topology graph consists of a vertex set , an edge set , and an adjacent matrix . If , then which means that agent can receive information from agent ; else . The set of neighbors of agent is denoted by . A directed spanning tree is a graph that has one node called root node, which has a directed path to all of the other nodes. The Laplacian matrix is defined as follows:

The following definitions are introduced for further discussion.

*Definition 1 (subgraph [8]). *Considering a topology graph , then is a subgraph of if ; .

*Definition 2 (union of graphs [7]). *Set the union of topology graphs as ; then, ; .

##### 2.2. Control Protocol

In this paper, system states are sampled and transmitted at discrete instants and the controller is designed based on the periodic sampling and transmitting information. For agent , control input between can be presented as follows: where is controller gain with proper dimension to be decided, the value of should be defined as (7). In the above equation, denotes the transmission delay between agent and agent during the period . From the structure of the controller, it is obvious that the control input is not constant during and each agent in the system updates its input asynchronously. It is also worth noticing that (3) implies that , which is not necessarily guaranteed for communication system with random delays. So the following assumption is introduced about communication delays.

*Assumption 3 (bounded transmission delays). *There exist positive constant values and denoting the delay between agent and agent ; presents the time period for sampling and transmitting data. The following condition is satisfied;

From a practical point of view, it can be assumed that, for any packet with transmission delay that cannot satisfy Assumption 3, the packets are regarded as being lost.

##### 2.3. Model

With the proposed control algorithm as in (2), the multiagent systems consist of three typical dynamics that are concerned. And the corresponding discrete-time system presentations are also presented in Table 1.

For th high-order system, the matrices are as follows:

*Definition 4 (consensus [11]). *Consensus of the multiagent system is regarded as being achieved when the following equation is satisfied:

#### 3. Consensus of Multiagent System

In this section, consensus problem of multiagent system consists of different agent dynamics that is discussed separately. With proper assumptions made, we have proposed the conditions needed for consensusability of the multiagent system.

##### 3.1. Case 1: Single Integrator Agent

###### 3.1.1. With Communication Delays and No Packet Losses

Define as the state of the multiagent system. Since it can be easily extended to multistate through Kronecker production, it is assumed here that each agent has only one state for briefness of description. Based on the controller as (2) and the discrete time model in Table 1, the dynamics of multiagent system can be denoted by where controller gain is presented as in this case. Because of transmission delays, Laplacian matrix is not invariant. So represent the Laplacian matrices that exist during and are the durations for corresponding Laplacian matrices satisfying . In fact, is a Laplacian matrix with no connections between agents and since no packet losses are concerned, for any , the topology associated with is a subgraph of the topology associated . To prove the consensusability of discrete-time system as in (7), following lemmas about nonnegative matrix and stochastic matrix are introduced beforehand.

Lemma 5 (see [26]). *Let be a stochastic matrix. If has an eigenvalue with algebraic multiplicity equal to one and all of the other eigenvalues satisfy , then is SIA. That is, .*

Lemma 6 (see [9]). *A stochastic matrix has algebraic multiplicity equal to one for its eigenvalue if and only if the graph associated with the matrix has a spanning tree. Furthermore, a stochastic matrix with positive diagonal elements has the property that for every eigenvalue not equal to one.*

Lemma 7 (see [27]). *Let be a finite set of SIA matrices with property that, for each sequence of positive length, the matrix product is SIA. Then, for each infinite sequence , there exists a column vector such that .*

Lemma 8 (Gershgorin circle criterion [28]). *All eigenvalues of a matrix are located within the union of discs as follows:
*

*Lemma 9 (see [29]). Let be a positive integer and let be nonnegative matrices with positive diagonal elements; then, , with . And if the digraph associated with has a spanning tree, the graph associated with also has a spanning tree.*

*Besides, some assumptions also need to be proposed.*

*Assumption 10 (quantized transmission delays). *There exists a small positive value such that, for all ,

Assumption 10 indicates that transmission delays can be quantized and must be a multiple of fundamental delay time . Assumption 10 is realizable and practical because all agents are operated under digital computers and the smaller the is, the higher the accuracy is.

*Assumption 11. *The designed communication topology for the multiagent system has a directed spanning tree.

*This assumption means that if there are no packet losses and communication delays, the topology of the multiagent system has a spanning tree at every instant . Combing with Assumption 3, it can be derived that the union of digraphs associated with has a directed spanning tree. Then based on introduced lemmas and assumptions, the consensus of the system described as in (7) can be proposed.*

*Theorem 12. For multiagent system consisting of single integrator dynamics, with control protocol designed as (2) and Assumptions 3–11, the consensus of the multiagent system can be reached if the controller gain is set to be , where is the largest in-degree of the Laplacian matrices .*

*Proof. *First of all, since there are a limited number of possible Laplacian matrices for fixed number of agents, can be precalculated without consideration about communication delays; then, it can be viewed as a constant in subsequent presentation. By substituting into (7), the system can be transformed as

Since Assumption 11 holds and there are no packet losses, has a spanning tree and the interaction graphs associated with are subgraphs of the topology associated with . Then, for the union of graphs , there is a simple eigenvalue equal to zero. According to Lemma 8, it is not difficult to conclude that all of other eigenvalues of are located within the circle with origin point of and radius of . Thus, it can be obtained that is a matrix with simple eigenvalues equal to one and the others within the unit circle of the complex plane which means that the topology associated with has a spanning tree according to Lemma 6.

In addition, since all the nondiagonal entries of Laplacian matrices are nonpositive, the nondiagonal entries of are nonnegative. All diagonal elements of are less than one due to the choice of . And since Laplacian matrices all have zero row sums, has row sum equal to one; that is, is a stochastic matrix. As a conclusion, is a stochastic nonnegative matrix with positive diagonal elements and it can be derived from Lemma 5 that is SIA.

Because has a spanning tree, also has a spanning tree according to Lemma 9. In addition, the stochastic matrices with positive diagonal entries are closed under matrix multiplication, so that is also a stochastic matrix with positive diagonal elements. According to Lemmas 6 and 5, the matrix is SIA.

With Assumption 10, it can be derived that there is a finite number of . After that, Lemma 7 can be applied to acquire that the multiagent system as in (10) can reach a consensus. Theorem 12 is proved.

*3.1.2. With Packet Losses and Communication Delays*

*In the above section, consensus problem with communication delays has been solved that lay firm foundation for the problem concerned in the situation where packet losses must be taken into consideration. In this case, Assumption 3 is no longer satisfied. As mentioned previously, Assumption 3 is a relative strict condition to be fulfilled in practice. So the following assumption is proposed in addition.*

*Assumption 13. *Set the success ratio of transmission between two agents as , ; there exists an integer that satisfies . If is chosen to be close to enough, it is reasonable to assume that the transmission can be successful for at least one time during periods. Besides, under Assumption 13, the communication delay can still satisfy Assumption 3 for the successful transmitted information. With Assumption 11, this assumption essentially means that the union of digraphs within periods has a directed spanning tree.

*Theorem 14. For multiagent system consisting of single integrator dynamics satisfying Assumptions 10–13, with control protocol designed as in (2), the consensus of the multiagent system can be reached with the same controller gain adopted as in Theorem 12.*

*Proof. *In this situation, since Assumption 3 is no longer satisfied all the time, cannot always have a spanning tree. However, according to Assumptions 11 and 13, the digraph associated with will have a spanning tree. Since is still a stochastic nonnegative matrix with positive diagonal elements, Lemma 9 still holds; that is, the relation exists. Thus, define such that

Since is a stochastic nonnegative matrix with positive diagonal elements and the associated graph has a spanning tree, the problem regarding packet losses and communication delays can be handled in a similar way as in proof of Theorem 12. So, the consensusability of multiagent system with packet losses and communication delays is guaranteed.

*Remark 15. *Based on the analysis of this section, it can be found that Theorem 12 can be viewed as a special case of Theorem 14 with . With the proposed control protocol and proper choice of controller gain, the multiagent system can reach consensus as long as the union of the digraphs within finite periods has a spanning tree.

*3.2. Case 2: Double Integrator Agent*

*3.2.1. With Communication Delays and No Packet Losses*

*For second order multiagent system, the corresponding variables are defined as , , respectively. Then based on the discrete time model of second order system in Table 1, it can be obtained that for agent
where is the control input results from the relative state information between agent and agent . denotes the default control value of agent that is usually set as and since the input is default.*

*To make (13) more concise, some transformations need to be carried out. Set . The transformation process is applicable because, during the period , are known to the agent . Equations (12) and (13) are revised as
*

*With the controller gain chosen as , . The dynamics of the multiagent system can be presented as
*

*As we know, topology associated with will have a spanning tree if Assumption 11 holds. has the same structure as except for all its items that have been multiplied by . Thus, topology of also has a spanning tree. The consensus problem for system depicted as (15) can be discussed in a similar way as in Cao and Ren [8].*

*Lemma 16 (Cao and Ren [8]). With the decomposition of system transfer matrix as in (16), since , all have spanning tree, if the conditions and are satisfied, consensus of the system can be reached
(1) are nonnegative matrices with positive diagonal entries and are nonnegative matrices.(2)The infinite norm of matrix is less than .*

*The first condition is aimed to guarantee that the first matrix is a nonnegative one with positive diagonal entries. In addition, it is not difficult to find that the matrix is also stochastic. Then the matrix is SIA and Lemma 7 is applicable. And the second condition is to make sure that multiplication of infinite number of the second matrix goes to zero. More detailed proofs can be found in Cao and Ren [8].*

*Theorem 17. For multiagent system consisting of double integrator agents, with Assumptions 3–11 holding, if the sampling and transmitting period and controller gain can satisfy the following conditions, the consensus of the multiagent system is guaranteed:(1);(2).*

*Proof. *If condition is satisfied, the infinite norm of matrix is less than . Define , that represent the largest in-degree for , respectively. is random due to the randomicity of transmission delays. From Assumption 3, it is obvious that

Then, with the second condition, it can be acquired that

As a result, . Besides, it is not difficult to find that since . As a result, it can be concluded that if the conditions are satisfied, Lemma 16 is also fulfilled and the consensusability of the multiagent system with double integrator dynamics is proved.

*3.2.2. With Communication Delays and Packet Losses*

*3.2.2. With Communication Delays and Packet Losses**For second order system with packet losses, Assumption 11 cannot hold and the Laplacian matrices , discussed in the above section no longer have a spanning tree all the time. In this situation, Lemma 16 cannot directly be applied. Inspired by Qin et al. [17], a covariable can be introduced here with definition as
where are constant parameters. It is easily derived that if and can reach consensus, the velocity of the system will also achieve consensus. So in the following discussion, the consensus problem of system states and is concerned. Besides, default control of agent also needs to be set as , .*

*As a result, the multiagent system can be transformed into*

*With proper choices of parameters , and , the system matrix can be a nonnegative stochastic matrix with positive diagonal elements. In fact, to ensure that the transfer matrix is stochastic, . Then if Assumption 13 holds, the system described as (20) can reach a consensus with similar proof as Theorem 14. However, because of the existence of default control input, the consensus value of system velocity is zero which is usually the case for rendezvous problem not for formation control or flocking. So in order to obtain the consensus for multiagent system without adding the control input , in the subsequence of this paper, a different assumption about interaction topology needs to be made.*

*Assumption 18. *The designed communication topology for the multiagent system is a directed spanning tree. Similarly, with Assumption 13, this assumption essentially means that the union of digraphs within periods is a directed spanning tree.

*Consider two agents , and assume that there is a directed link from agent to . According to Assumption 13, there exist a positive integer with such that the data transmission is successful during the period and packets dropout during the previous periods. Define the delay during as which satisfies Assumption 3. Adopt the controller gain as and the following dynamics can be obtained for agents and : *

*Define the states error between agents and at time instants as and as follows:
where represents the number of successful transmissions. Then the following equation is acquired denoting the error dynamics between agents and *

*According to the error dynamics depicted as above, the following lemma can be proposed.*

*Theorem 19. For multiagent system consisting of double integrator dynamics as in Table 1, with Assumptions 13 and 18, the consensusability of the system can be guaranteed with packet losses and transmission delays as long as the discrete error dynamics as in (23) is stable.*

*Proof. *Without loss of generality, set agent as the root node of the directed spanning tree. Define as the set of agents that receive information from agent . If the error dynamics as in (23) is stable, that is, , . It is obvious that agents and can reach a consensus for any with finite time periods since Assumption 18 holds.

Then there exist a positive number and a time instant such that for . With definition of , it can be derived that when , , for all which means that the consensus has been reached between agents and . Since the discrete error dynamics is as in (23) set no restrictions on initial states of agents and the agents belonging to will reach consensus with agent in a similar way. Finally, the whole multiagent system will reach a consensus.

*To be more illustrative, the process can be shown in Figure 1. The error dynamics between different agents in the dash line circle can be presented as (23). The agents in the real line circle mean that the consensus has been reached among them.*

*In the following, an algorithm to testify the Schur stability of discrete-time dynamics system as in (23) is proposed. Since all communication delay is random, the transfer matrixcan be viewed as an interval matrix for fixed with the expressions of and as follows:
*

*The following lemma needs to be introduced concerning the stability of interval matrix.*

*Lemma 20. An interval matrix is Schur stable if and only if there are finitely subinterval matrices , , such that
*

And for each , , satisfies the following conditions.(1) is Schur stable and there exists a positive definite matrix satisfying (2). is an operator and the definitions of and are as follows: (3)Subinterval matrices are complete decomposition of interval matrix which means that , such that .

*Proof. *See Wang et al. [30] and Liao et al. [31] for details.

*Consider the parameters in (23), according to Assumption 3 and actually denotes the smallest processing time available for the embedded system. is the sampling and transmitting period for the multiagent system and for acoustic communication system it also indicates the largest distance available between two linked agents since the relation has to be satisfied, where is the acoustic velocity. Due to the physical meanings of , , they usually are predetermined once the multiagent system structure is determined. As for , according to Assumption 13 and the derivation of (23), is a time varying positive integrator variable satisfying . So the following lemma is put forward.*

*Lemma 21. The system transfer matrix in (23) is Schur stable if, for every fixed , is Schur stable.*

*Proof. *Define the interval matrix as when , . If is Schur stable, then there exist a finite number of subinterval matrices satisfying conditions in Lemma 20. In addition, the system matrix in (23) can be completely decomposed as

Then it can be derived that

The above equation means that the system matrix can be decomposed into finite number of subinterval matrices that all satisfy the conditions in Lemma 20. The matrix is Schur stable.

*Even though Lemmas 20 and 21 have provided conditions to guarantee the Schur stability of the discrete interval system matrix, method to completely decompose an interval matrix is needed. Based on the definition of and in (28), the interval matrix can be presented as . With this presentation, it is natural to adopt the decomposition as . However, the decomposition is not always complete. Denote the element of the interval matrix at th row and th column by . Then divide the interval into two subintervals as follows:
*

*with and defined as
*

*If , the interval matrix can be decomposed as follows:
*

*Each element in at th row and th column will be either or . Then, it is obvious that the decomposition is complete. Now, Algorithm 1 is proposed in pseudocode to testify the Schur stability of the interval matrix. If a limited number of subintervals can be obtained for each , that satisfy the Schur stability conditions in Lemma 20, the system matrix in (23) is stable according to Lemma 21. That is, the multiagent system consists of second order agent with communication delays and packet losses can reach a consensus.*

*Through Algorithm 1, the consensusability of the multiagent system concerned can be testified. However, since the controller gain and the system parameters are predefined, no analytical solutions are provided by this method for multiagent system that could not reach consensus. Besides, the computational burden of the algorithm will increase exponentially with the order of agents. Therefore, in the next section, a theorem will be proposed to design the controller gain and solve the consensus problem of multiagent system with high-order integrator agents.*

*3.3. High-Order Integrator Agent*

*3.3. High-Order Integrator Agent*

*Assume that Assumption 18 still holds; similar result can be obtained as in Theorem 19; that is, if the root agent and agent , , can reach consensus, the multiagent system can reach consensus. So for the high-order integrator dynamics introduced in Table 1, with communication delays, the discrete system dynamics for agent and agent can be presented as
with as the controller gain to be designed; is the communication delay satisfying Assumption 3. Let the states error between agent and agent at time *

*The error dynamics between two agents is
*

*Considering packet losses and according to Assumption 13, there exists an integer such that the error dynamics during the period can be presented as
*

*Algorithm 1 can still be applied to test the Schur stability of system matrix equation (36) and (37). Except for the computational complexity increases exponentially with the system order, the controller gain is also difficult to design comparing with second order multiagent system. So in order to circumvent those difficulties, the following lemmas are applied to achieve the controller gain.*

*Lemma 22 (see [32]). For discrete time interval system as in (38), , the system is stabilizable if and only if there exist a matrix and a symmetric positive definite matrix and scalars , , , , , satisfying (39). And the controller gain can be adopted as . Consider
where , is a column vector with th element being . And
*

*Lemma 23. The interval system matrices and are stabilizable if there are a finite number of subintervals , , such that, for each , the system matrices , are stabilizable. And the interval system is completely decomposed which means that, at any time instant , if , then , . And the complete decomposition can be denoted by
*

*Proof. *Since the system matrices , are stabilizable, suppose that the controller gain is denoted by ; then, it can be derived that is Schur stable. Because the interval system is completely decomposed, the following decomposition is also complete

Then according to Lemma 21, the Schur stability of indicated Schur stability of the multiagent system.

*Comparing (36) with (37), it can be concluded that (36) is the special case of (37) when . Actually, the interval matrices in (37) are piecewise interval, and the system can be completely decomposed into subinterval systems easily. The subinterval systems can be presented as follows:
*

*Theorem 24. For multiagent system consisting of high order agents, under Assumptions 13 and 18, the consensusability of the system can be guaranteed with transmission delays and packet losses if there exists a controller gain such that the conditions in Lemma 22 can be satisfied for each , .*

*Proof. *If the conditions in Lemma 22 are satisfied, is Schur stable. From (43), the interval system in (37) can be completely decomposed by and , . Then according to Lemma 23, the theorem is established.

*In fact, the existence of controller gain is important in the above lemma. According to (39) in Lemma 22, matrix can be obtained by solving the LMI with matlab. In order to guarantee the conditions in Lemma 23, LMIs should be solved simultaneously to calculate the feedback gain . Besides, it should be noticed that Theorem 24 is a general solution for controller gain of multiagent system and can be applied to all kinds of agent dynamics including single integrator, second order integrator, and general linear system.*

*4. Simulations*

*4. Simulations*

*In this section, simulation results will be presented to demonstrate the theoretical results in Section 3. A multiagent system consists of five agents with the designed interaction topology as in Figure 2 that is concerned. The success ratio in Assumption 13 is set as according to the property of ordinary acoustic communication equipment; if is chosen to be , then can be set as which means that the transmission will be successful at least one time during five periods. is set to be , which is long enough for system to calculate the system inputs. Sampling and transmitting period . With all above initialization, single integrator, second order, and high-order agents are discussed separately and consensusability for every typical multiagent system is testified with packet losses and communication delays.*

*4.1. Single Integrator Agent*

*4.1. Single Integrator Agent*

*In this case, the initial state of each agent in the multiagent system is chosen randomly from 0 to 50, . Simulation result is shown in Figure 3. It can be concluded that, for single integrator system, the position of each agent will converge to the state of agent 1 and the consensus of the system will be reached fast.*

*4.2. Second Order Agent*

*4.2. Second Order Agent*

*In this case, we need to test Schur stability of the error dynamics with Algorithm 1; it can be calculated that, with subintervals, the conditions in Lemma 20 can be satisfied for every subinterval. Similar to Case 1, the initial values for position and velocity are randomly adopted within and , respectively. The simulation results are shown in Figures 4 and 5. It can be seen that, during some time intervals at the beginning, the difference of states may increase, especially for velocity of the agent, but the consensus will be reached with enough time. It is also worth noticing that the sampling and transmitting period adopted in this case cannot satisfy the condition in Theorem 17; however, the consensus can still be guaranteed which indicated that the condition from stochastic matrix theory is more conservative if Assumption 18 holds.*

*4.3. High-Order Agent*

*4.3. High-Order Agent*

*Considering the third order integrator agent, corresponding structure of matrices and can be obtained through Table 1. Then according to Lemmas 22 and 23, the controller gain can be calculated through solving the LMIs with matlab. It can be found that is a proper solution and the simulations are carried out with results presented in Figures 6, 7, and 8. Even though it takes more time to reach the consensus for the multiagent system, with the proposed controller structure and controller gain, the consensusability is guaranteed. In addition, the initial states for position, velocity, and acceleration are randomly chosen from , , and .*

*5. Conclusions*

*5. Conclusions*

*In this paper, the consensus problem of multiagent system with packet losses and communication delays is discussed. A novel control protocol that depends on periodic sampling and transmitting information is proposed to make it more convenient for implementation. Then, sufficient conditions for consensusability of multiagent systems consist of single integrator, second order, and high-order agents that are established, respectively, according to stochastic matrix theory and interval matrix theory. Finally, simulations are carried out to verify the theoretical results obtained. However, to reach the consensus for second and high-order systems with packet losses and communication delays, the directed communication topology is limited to a directed spanning tree. Even though this kind of structure has its own advantages in real-world applications, being convenient and economical, for example, it also has some flaws in modeling the system with massive agents such as flock and fish school. Therefore, in the follow-up study of this research, the directed topology will not be limited to a directed spanning tree in order to make the whole system more distributive.*

*Conflict of Interests*

*Conflict of Interests*

*The authors declare that they have no conflict of interests regarding the publication of this paper.*

*Acknowledgments*

*Acknowledgments*

*This work is supported by the National Natural Science Foundation of China (Grant nos. 5179038, 51109043, and 51309067) and New Century Excellent Talents in University of China (Grant no. NCET-10-0053).*

*References*

*References*

- K. Nagatani, Y. Okada, N. Tokunaga et al., “Multirobot exploration for search and rescue missions: a report on map building in RoboCupRescue 2009,”
*Journal of Field Robotics*, vol. 28, no. 3, pp. 373–387, 2011. View at Publisher · View at Google Scholar · View at Scopus - S. Zhang, J. Yu, A. Zhang, L. Yang, and Y. Shu, “Marine vehicle sensor network architecture and protocol designs for ocean observation,”
*Sensors*, vol. 12, no. 1, pp. 373–390, 2012. View at Publisher · View at Google Scholar · View at Scopus - S. Iyengar and R. Brooks,
*Distributed Sensor Networks: Sensor Networking and Applications*, CRC Press, 2012. - R. Cui, S. S. Ge, B. Voon Ee How, and Y. Sang Choo, “Leader-follower formation control of underactuated autonomous underwater vehicles,”
*Ocean Engineering*, vol. 37, no. 17-18, pp. 1491–1502, 2010. View at Publisher · View at Google Scholar · View at Scopus - R. Olfati-Saber and R. M. Murray, “Consensus problems in networks of agents with switching topology and time-delays,”
*IEEE Transactions on Automatic Control*, vol. 49, no. 9, pp. 1520–1533, 2004. View at Publisher · View at Google Scholar · View at Scopus - Y. Zhang and Y.-P. Tian, “Consensus of data-sampled multi-agent systems with random communication delay and packet loss,”
*IEEE Transactions on Automatic Control*, vol. 55, no. 4, pp. 939–943, 2010. View at Publisher · View at Google Scholar · View at Scopus - W. Ni and D. Cheng, “Leader-following consensus of multi-agent systems under fixed and switching topologies,”
*Systems and Control Letters*, vol. 59, no. 3-4, pp. 209–217, 2010. View at Publisher · View at Google Scholar · View at Scopus - Y. Cao and W. Ren, “Sampled-data discrete-time coordination algorithms for double-integrator dynamics under dynamic directed interaction,”
*International Journal of Control*, vol. 83, no. 3, pp. 506–515, 2010. View at Publisher · View at Google Scholar · View at Scopus - W. Ren and R. W. Beard, “Consensus seeking in multiagent systems under dynamically changing interaction topologies,”
*IEEE Transactions on Automatic Control*, vol. 50, no. 5, pp. 655–661, 2005. View at Publisher · View at Google Scholar · View at Scopus - Y. Gao and L. Wang, “Consensus of multiple double-integrator agents with intermittent measurement,”
*International Journal of Robust and Nonlinear Control*, vol. 20, no. 10, pp. 1140–1155, 2010. View at Publisher · View at Google Scholar · View at Scopus - P. Lin, Z. Li, Y. Jia, and M. Sun, “High-order multi-agent consensus with dynamically changing topologies and time-delays,”
*IET Control Theory and Applications*, vol. 5, no. 8, pp. 976–981, 2011. View at Publisher · View at Google Scholar · View at Scopus - P. Lin and Y. Jia, “Consensus of second-order discrete-time multi-agent systems with nonuniform time-delays and dynamically changing topologies,”
*Automatica*, vol. 45, no. 9, pp. 2154–2158, 2009. View at Publisher · View at Google Scholar · View at Scopus - Y. Liu, H. Min, S. Wang, Z. Liu, and S. Liao, “Distributed adaptive consensus for multiple mechanical systems with switching topologies and time-varying delay,”
*Systems & Control Letters*, vol. 64, pp. 119–126, 2014. View at Google Scholar - Y. Gao, J. Ma, M. Zuo, T. Jiang, and J. Duc, “Consensus of discrete-time second-order agents with time-varying topology and time-varying delays,”
*Journal of the Franklin Institute*, vol. 349, no. 8, pp. 2598–2608, 2012. View at Google Scholar - J. Zhu and L. Yuan, “Consensus of high-order multi-agent systems with switching topologies,”
*Linear Algebra and Its Applications*, vol. 443, pp. 105–119, 2014. View at Google Scholar - J. Almeida, C. Silverstre, and A. M. Pascoal, “Continuous time consensus with discrete time communications,”
*Systems & Control Letters*, vol. 61, no. 7, pp. 788–796, 2012. View at Google Scholar - J. Qin, H. Gao, and W. X. Zheng, “Consensus strategy for a class of multi-agents with discrete second-order dynamics,”
*International Journal of Robust and Nonlinear Control*, vol. 22, no. 4, pp. 437–452, 2012. View at Publisher · View at Google Scholar · View at Scopus - D. Goldin and J. Raisch, “Consensus for agents with double integrator dynamics in heterogeneous networks,”
*Asian Journal of Control*, vol. 15, no. 4, pp. 1–10, 2013. View at Google Scholar - G. Parlangeli, “Collaborative diagnosis and compensation of misbehaving nodes in acyclic consensus networks: analysis and algorithms,”
*International Journal of Innovative Computing Information and Control*, vol. 9, no. 3, pp. 915–938, 2009. View at Google Scholar - X. Su, L. Wu, Shi, and P. :, “Sensor networks with random link failures: distributed filtering for T-S fuzzy systems’,”
*IEEE Transactions on Industrial Informatics*, vol. 9, no. 3, pp. 1739–1750, 2013. View at Google Scholar - X. Su, X. Yang, P. Shi, and L. Wu, “Fuzzy control of nonlinear electromagnetic suspension systems,”
*Mechatronics*, 2013. View at Publisher · View at Google Scholar - X. Su, P. Shi, L. Wu, and Y.-D. Song, “A novel control design on discrete-time Takagi-Sugeno fuzzy systems with time-varying delays,”
*IEEE Transactions on Fuzzy Systems*, vol. 21, no. 4, pp. 655–671, 2013. View at Google Scholar - J. Yu and L. Wang, “Group consensus in multi-agent systems with switching topologies and communication delays,”
*Systems and Control Letters*, vol. 59, no. 6, pp. 340–348, 2010. View at Publisher · View at Google Scholar · View at Scopus - B. Iantovics and C. B. Zamfirescu, “ERMS: an evolutionary reorganizing multiagent system,”
*International Journal of Innovative Computing Information and Control*, vol. 9, no. 3, pp. 1171–1188, 2013. View at Google Scholar - L. Wu, X. Su, and P. Shi, “Sliding mode control with bounded L2 gain performance of Markovian jump singular time-delay systems,”
*Automatica*, vol. 48, no. 8, pp. 1929–1933, 2012. View at Google Scholar - R. A. Horn and C. R. Johnson,
*Matrix Analysis*, Cambridge University Press, 2012. - J. Wolfowitz, “Products of indecomposable, aperiodic, stochastic matrices,”
*Proceedings of the American Mathematical Society*, vol. 14, no. 5, pp. 733–736, 1963. View at Google Scholar - F. Lewis,
*Cooperative Control of Multi-Agent Systems: Optimal and Adaptive Design Approaches*, Springer, Berlin, Germany, 2013. - A. Jadbabaie, J. Lin, and A. S. Morse, “Coordination of groups of mobile autonomous agents using nearest neighbor rules,”
*IEEE Transactions on Automatic Control*, vol. 48, no. 6, pp. 988–1001, 2003. View at Publisher · View at Google Scholar · View at Scopus - K. Wang, A. N. Michel, and D. Liu, “Necessary and sufficient conditions for the Hurwitz and Schur stability of interval matrices,”
*IEEE Transactions on Automatic Control*, vol. 39, no. 6, pp. 1251–1255, 1994. View at Publisher · View at Google Scholar · View at Scopus - X. Liao, Q. Luo, Z. Mei, and W. Hu, “Notes on necessary and sufficient conditions of stability, observability and controllability for interval matrices,”
*Acta Automatica Sinica*, vol. 24, no. 6, pp. 829–833, 1998. View at Google Scholar · View at Scopus - D.-Q. Zhang, Q.-L. Zhang, and Y.-P. Chen, “Controllability and quadratic stability quadratic stabilization of discrete-time interval systems—an LMI approach,”
*IMA Journal of Mathematical Control and Information*, vol. 23, no. 4, pp. 413–431, 2006. View at Publisher · View at Google Scholar · View at Scopus

*
*