## Coordinated Control and Estimation of Multiagent Systems with Engineering Applications

View this Special IssueResearch Article | Open Access

# Average Consensus in Multiagent Systems with the Problem of Packet Losses When Using the Second-Order Neighbors’ Information

**Academic Editor:**Housheng Su

#### Abstract

This paper mainly investigates the average consensus of multiagent systems with the problem of packet losses when both the first-order neighbors’ information and the second-order neighbors’ information are used. The problem is formulated under the sampled-data framework by discretizing the first-order agent dynamics with a zero-order hold. The communication graph is undirected and the loss of data across each communication link occurs at certain probability, which is governed by a Bernoulli process. It is found that the distributed average consensus speeds up by using the second-order neighbors’ information when packets are lost. Numerical examples are given to demonstrate the effectiveness of the proposed methods.

#### 1. Introduction

In recent years, there has been an increasing research in coordination control of multiagent systems. Information consensus has attracted more and more attentions from many engineering application fields, such as formation control, flocking, artificial intelligence, and automatic control [1–4]. A critical problem in distributed control is to develop distributed protocols under which agents can reach an agreement on a common decision.

An excellent protocol can reduce cost, increase efficiency, and can optimize performance. Convergence rate is an important index to evaluate the performance of consensus. There has been much research interest in dealing with this issue. In [5], the authors pointed out that the second smallest eigenvalue of its Laplacian matrix was a measure of speed of solving consensus problems. From [6], we know that the convergence speeds up by finding the optimal weight associated with each communication link, where the global structure of the network must be known beforehand. Reference [7] accelerated the convergence rate by using the polynomial filtering algorithms. In [8], the authors presented randomized gossip algorithm on an arbitrary connected network and showed its performance precisely in the terms of the second largest eigenvalue of an appropriate stochastic matrix. The above literatures all tried to seek a suitable topology communication to achieve a fast convergence. However, in practice, it is more useful to design a protocol to obtain a better convergence performance under a given topology. In order to get a better convergence speed without changing the topology and edge weights, the authors in [9] proposed a protocol in an unchanged topology network that each node got its state value updated by using the information of multihop communication and showed that the protocol increased the convergence speed effectively for the first time. Then, in [10], the authors discussed that the node in the network topology updated its current state value not only from its immediate neighbors but also from its second-order neighbors for both the discrete-time case and the continuous-time case. Further, the authors in [11] extended the systems to second-order case and made comparisons between the convergence rate of second-order neighbor protocol and the general protocol. What is more, the delay margins of general protocol and second-order neighbor protocol were derived.

It is noted that the literatures mentioned above mainly focus on consensus problem for agents under first-order dynamics with time delay. In reality, the agents exchange data over fading communication channels instead of ideal ones. In fact, in many practical applications, this data exchange between sensors is done by wireless communication, which has a possibility of packets lost. Thereby, the packet losses should be taken into consideration. Many related works have been reported. Reference [12] dealt with consensus with random delay and data losses. Reference [13] compared the memory and memoryless consensus protocols in the presence of uniform packet losses. In [14, 15], the authors discussed the average consensus in first-order agents and analyzed the convergence speed under data losses. Furthermore, [16] showed that packet dropouts can be treated as an absence of a communication link over time. In addition, [17–19] studied stochastic consensus subject to a random process.

Inspired by the above references, we consider multiagent systems with the problem of packet losses based on the second-order neighbors’ information. We construct a group of agents, which can communicate with their second-order neighbors and each communication link has a probability of failure. We assume that all channels are independent and subject to a distributed random process. Thereby, they have the same probability of data loss. Each agent is equipped with a sampler and a zero-order hold, which are synchronized in time. Then, by converting the system to the equivalent error dynamics, stochastic stability of the error dynamic system is studied. Here, a Lyapunov function is constructed and a sufficient condition is established to guarantee the average consensus in the form of linear matrix inequality (LMI). We are curious about whether the protocol based on the second-order neighbors’ information can accelerate the convergence speed with the problem of packet losses. Then, a simulation comparison of the convergence rate between the protocol based on the second-order neighbors and the one in general linear is shown. Comparison of the convergence speed between different probabilities of packet losses is also simulated.

The rest of this paper is organized as follows. Section 2 provides some preliminaries on graph theory and gives the designed protocol. Section 3 analyses the average consensus and gives a sufficient condition. Section 4 includes some numerical examples, which demonstrate the effectiveness of the proposed approach. Finally, Section 5 offers the concluding remarks.

*Notations. *The set of real numbers is denoted by . For any matrix , . The index set is a group of consecutive integers from 1 to *. *The vector has all of its elements equal to 1. The mathematical expectation is denoted by and is the probability operator.

#### 2. Problem Formation

##### 2.1. Preliminaries on Graph Theory

In this paper, the interaction among agents is modeled by an undirected graph , where is the node set. The edge set contains ordered pairs of nodes. The neighbor set of agent is denoted by , which includes agents from which agent receives information. The adjacency matrix is a nonnegative matrix, where if and only if ; otherwise, . We assume that there is no self-loop, so . The Laplacian matrix is defined as

From the above definitions, we know some facts: and determine each other uniquely, and has nonnegative eigenvalues. Moreover, has at least one zero eigenvalue with the associated eigenvector (); that is, span, where null is the null space of . For the undirected graph, we further have , . From [20], it is known that span if and only if the undirected graph is connected.

##### 2.2. Protocols Based on Second-Order Neighbor with Packet Losses

Consider the following first-order dynamics: where are the state and the input of agent , respectively. With sampling period and a zero-order hold, the agent dynamics is discretized as Considering the protocol based on second-order neighbors’ information, if there is no communication constraint taken into account, the following control protocol can be used: where the control gain is to be designed.

Next, we consider the packet losses among agents. The following control protocol is designed: where , if there is no packet loss between agents and ; , otherwise.

Furthermore, we assume that the occurrence of packet loss is governed by a Bernoulli process with uniform probability satisfying ; that is, As a result, we have .

*Assumption 1. *The undirected topology is coupled; that is, for any pair of agents and , the communication channels between them exist or vanish simultaneously.

Assumption 1 ensures that the communication topology is always symmetric, so the average of agents’ states can be retained during dynamic evolution.

We define two sets of matrices and as follows: Denote the vectors and by Then, the control protocol can be rewritten as where .

So, the system dynamics can be written as By taking the mathematical expectation of and , we have , , where is the nominal Laplacian matrix of full weights where there is no packet loss and is the nominal Laplacian matrix of the system which is only based on the second-order neighbors’ information with full weights and without packet loss.

*Assumption 2. *The nominal communication topologies associated with and associated with are all connected.

The above assumption is necessary for consensus because if the undirected graph is not connected, then it does not have a spanning tree. From [21, Lemma 1] and [22, Theorem 5], we know that there exist two nonempty, disjoint groups of agents that have no communication with each other at any time. In this case, consensus cannot be reached.

#### 3. Consensus Analysis

The average states of the agents
are invariant. We say the* average consensus* problem is solved, if
Each agent state can be presented by the form
where the variable satisfies
The following error dynamics are obtained:
Obviously, the stability of (15) is equivalent to the consensus in (2). Then, we introduce the following lemma, which plays an important role in the stability analysis of (15).

Lemma 3 (see [16]). *For an undirected graph, given the Laplacian matrix , , and a symmetric matrix , can be calculated as follows:
**
where , , , , and is a function of , defined as
*

The following theorem gives a sufficient condition on the average consensus of the system (2).

Theorem 4. *Given the scalar , the average consensus of the system (2) is achieved if there exists a matrix , such that the following LMI holds:
*

*Proof. *Construct the candidate Lyapunov function as . We have
Thus, from the Lyapunov stability theory, we know that if is negative, then (15) is asymptotically stable. Thereby, the states of all agents will converge to their average state; that is, the average consensus of the system (2) is achieved.

#### 4. Simulations and Analyses

To illustrate the average consensus of the system (2) under the condition of packet losses and fast convergence rate of the protocol based on second-order neighbors’ information, a numerical example is provided. The nominal interaction topology and topology only based on second-order neighbors’ information among five agents are shown in Figure 1.

The weights are set to unity for simplicity here. We set the corresponding Laplacian matrices and as follows:

We choose the sampling period as sec, control gain as , and the probability of successfully receiving information as . The initial condition is set to be , and it will be shown that the agents’ states finally converge to the average value . Then, by solving the LMI in Theorem 4, the result shows that it is feasible. Thus, consensus will be achieved. The time history of the Bernoulli variable is shown in Figure 2. Figure 3 compares the convergence speed of the nominal communication and the topology based on second-order neighbors’ information with , from which we can see that the protocol we designed is more effective. Figure 4 compares the convergence speed based on second-order neighbors’ information with and , from which we can see the influence of packet losses.

**(a)**

**(b)**

#### 5. Conclusions

In this paper, we have investigated the average consensus in multiagent systems with the problem of packet losses when second-order neighbors’ information was used. The convergence rates of general protocol and second-order neighbor protocol with packet losses have been compared and it is concluded that second-order neighbor protocol speeds up the consensus rate. What is more, we can see the influence of packet losses. Future work will extend the agent dynamics to second-order or higher-order dynamics with data loss and time-varying delay.

#### Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

#### Acknowledgments

This work is supported by the National Natural Science Foundation (NNSF) of China under Grants no. 61004031, no. 61174096, and no. 61104141, Beijing Municipal Commission of Education Science and Technology Program (KM201310017006), and the Fundamental Research Funds for the Central Universities.

#### References

- H. Su, X. Wang, and Z. Lin, “Flocking of multi-agents with a virtual leader,”
*IEEE Transactions on Automatic Control*, vol. 54, no. 2, pp. 293–307, 2009. View at: Publisher Site | Google Scholar | MathSciNet - H. Su, N. Zhang, M. Z. Q. Chen, H. Wang, and X. Wang, “Adaptive flocking with a virtual leader of multiple agents governed by locally Lipschitz nonlinearity,”
*Nonlinear Analysis: Real World Applications*, vol. 14, no. 1, pp. 798–806, 2013. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - H. Michael, Z. Chen, X. Wang, and J. Lam, “Semi-global observer-based leader-following consensus with input saturation,”
*IEEE Transactions on Industrial Electronics*, vol. 61, no. 6, pp. 2842–2850, 2014. View at: Publisher Site | Google Scholar - H. Su, M. Z. Q. Chen, J. Lam, and Z. Lin, “Semi-global leader-following consensus of linear multi-agent systems with input saturation via low gain feedback,”
*IEEE Transactions on Circuits and Systems I: Regular Papers*, vol. 60, no. 7, pp. 1881–1889, 2013. View at: Publisher Site | Google Scholar | MathSciNet - R. Olfati-Saber and R. M. Murray, “Consensus problems in networks of agents with switching topology and time-delays,”
*IEEE Transactions on Automatic Control*, vol. 49, no. 9, pp. 1520–1533, 2004. View at: Publisher Site | Google Scholar | MathSciNet - L. Xiao and S. Boyd, “Fast linear iterations for distributed averaging,”
*Systems & Control Letters*, vol. 53, no. 1, pp. 65–78, 2004. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - E. Kokiopoulou and P. Frossard, “Polynomial filtering for fast convergence in distributed consensus,”
*IEEE Transactions on Signal Processing*, vol. 57, no. 1, pp. 342–354, 2009. View at: Publisher Site | Google Scholar | MathSciNet - S. Boyd, A. Ghosh, B. Prabhakar, and D. Shah, “Randomized gossip algorithms,”
*IEEE Transactions on Information Theory*, vol. 52, no. 6, pp. 2508–2530, 2006. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - Z. Jin and R. M. Murray, “Multi-hop relay protocols for fast consensus seeking,” in
*Proceedings of the 45th IEEE Conference on Decision and Control 2006 (CDC '06)*, pp. 1001–1006, December 2006. View at: Google Scholar - D. Yuan, S. Xu, H. Zhao, and Y. Chu, “Accelerating distributed average consensus by exploring the information of second-order neighbors,”
*Physics Letters A*, vol. 374, no. 24, pp. 2438–2445, 2010. View at: Publisher Site | Google Scholar - H. Pan and X. Nian, “Second-order consensus in multi-agent systems based on second-order neighbors' information,”
*International Journal of Systems Science*, pp. 1–22, 2012. View at: Google Scholar - Y. Zhang and Y.-P. Tian, “Consensus of data-sampled multi-agent systems with random communication delay and packet loss,”
*IEEE Transactions on Automatic Control*, vol. 55, no. 4, pp. 939–943, 2010. View at: Publisher Site | Google Scholar | MathSciNet - S. Wang, C. An, X.-X. Sun, and X. Du, “Average consensus over communication channels with uniform packet losses,” in
*Proceedings of the IEEE Control and Decision Conference (CCDC '10)*, pp. 114–119, May 2010. View at: Publisher Site | Google Scholar - F. Fagnani and S. Zampieri, “Randomized consensus algorithms over large scale networks,”
*IEEE Journal on Selected Areas in Communications*, vol. 26, no. 4, pp. 634–649, 2008. View at: Publisher Site | Google Scholar - F. Fagnani and S. Zampieri, “Average consensus with packet drop communication,”
*SIAM Journal on Control and Optimization*, vol. 48, no. 1, pp. 102–133, 2009. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - J. Wu and Y. Shi, “Average consensus in multi-agent systems with time-varying delays and packet losses,” in
*Proceedings of the American Control conference*, pp. 1579–1584, 2012. View at: Google Scholar - Y. Hatano and M. Mesbahi, “Agreement over random networks,”
*IEEE Transactions on Automatic Control*, vol. 50, no. 11, pp. 1867–1872, 2005. View at: Publisher Site | Google Scholar | MathSciNet - C. W. Wu, “Synchronization and convergence of linear dynamics in random directed networks,”
*IEEE Transactions on Automatic Control*, vol. 51, no. 7, pp. 1207–1210, 2006. View at: Publisher Site | Google Scholar | MathSciNet - M. Porfiri and D. L. Stilwell, “Consensus seeking over random weighted directed graphs,”
*IEEE Transactions on Automatic Control*, vol. 52, no. 9, pp. 1767–1773, 2007. View at: Publisher Site | Google Scholar | MathSciNet - W. Ren and R. W. Beard, “Consensus seeking in multiagent systems under dynamically changing interaction topologies,”
*IEEE Transactions on Automatic Control*, vol. 50, no. 5, pp. 655–661, 2005. View at: Publisher Site | Google Scholar | MathSciNet - Z. Lin, B. Francis, and M. Maggiore, “Necessary and sufficient graphical conditions for formation control of unicycles,”
*IEEE Transactions on Automatic Control*, vol. 50, no. 1, pp. 121–127, 2005. View at: Publisher Site | Google Scholar | MathSciNet - L. Moreau, “Stability of multiagent systems with time-dependent communication links,”
*IEEE Transactions on Automatic Control*, vol. 50, no. 2, pp. 169–182, 2005. View at: Publisher Site | Google Scholar | MathSciNet

#### Copyright

Copyright © 2014 Mei Yu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.