Abstract and Applied Analysis

Volume 2013, Article ID 412189, 7 pages

http://dx.doi.org/10.1155/2013/412189

## Dynamic Average Consensus and Consensusability of General Linear Multiagent Systems with Random Packet Dropout

^{1}School of Automation, Huazhong University of Science and Technology, Wuhan 430074, China^{2}Key Laboratory of Image Processing and Intelligent Control of Education Ministry of China, Wuhan 430074, China

Received 10 June 2013; Revised 19 August 2013; Accepted 27 August 2013

Academic Editor: Jianquan Lu

Copyright © 2013 Wen-Min Zhou and Jiang-Wen Xiao. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

This paper is concerned with the consensus problem of general linear discrete-time multiagent systems (MASs) with random packet dropout that happens during information exchange between agents. The packet dropout phenomenon is characterized as being a Bernoulli random process. A distributed consensus protocol with weighted graph is proposed to address the packet dropout phenomenon. Through introducing a new disagreement vector, a new framework is established to solve the consensus problem. Based on the control theory, the perturbation argument, and the matrix theory, the necessary and sufficient condition for MASs to reach mean-square consensus is derived in terms of stability of an array of low-dimensional matrices. Moreover, mean-square consensusable conditions with regard to network topology and agent dynamic structure are also provided. Finally, the effectiveness of the theoretical results is demonstrated through an illustrative example.

#### 1. Introduction

Multiagent systems (MASs) are kinds of networked systems in which each agent updates its states based on the information exchanges over communication networks. Due to their broad applications in many areas such as sensor networks [1], distributed computation [2], swarms and flocks [3], and formation control [4], the consensus problem of MASs has attracted increasing attention in recent years, and considerable interesting results have been obtained on this problem.

At the beginning, the consensus problem is investigated mainly for first-order and second-order MASs. Olfati-Saber and Murray [5] studied the consensus problem for a network of first-order integrators under various topology conditions, including directed or undirected, fixed or switching, and with or without communication time-delays; Hatano and Mesbahi [6] studied the asymptotic agreement of first-order continuous MASs over random information network based on stochastic stability analysis; Zhang and Tian [7] investigated the MASs consisting of discrete-time second-order agents under stochastic switching topology and proved that MASs can achieve mean-square consensus if and only if the union graphs in the topology set are connected. Sun et al. [8] investigated the finite-time consensus for first- and second-order leader-following Multiagent systems. In [9], Lin et al. further studied the consensus problems of a class of high-order Multiagent systems with dynamically changing topologies and time-delays and proved that the communication time-delays do not affect the stability of the Multiagent systems.

Recently, some researches on MASs with general linear dynamics have been conducted. Li et al. [10] proved that MASs with a communication topology having a spanning tree can reach consensus under an observe-type protocol if and only if each agent is stabilizable and detectable. Xu et al. [11] investigated the information structure for the consensusability of MASs under both fixed and switching topologies with dynamic output feedback control. In [12], Xu et al. further studied the leader-following consensus problem of discrete-time Multiagent systems with switching and undirected topology by applying two kinds of distributed observer-based consensus protocols to each agent. Su and Huang [13] proved that if the system matrix is marginally stable and the dynamic graph is jointly connected, both the leaderless and the leader-following consensus problems for linear discrete-time Multiagent systems under switching network topology can be solved.

Note that most of the existing results on the consensus problem of MASs are derived from the assumption that the network communication environment is perfect. However, communication constraints which may deteriorate the performance of MASs are inevitable in practice. There are numerous studies focusing on the consensus problem for MASs with either communication time delay or presence of perturbation or both of them, such as [14–18], but as one of the main reasons for performance deterioration, packet dropout, which takes place frequently during the information exchange between agents, is not fully investigated. Therefore, it is of great significance to study the effect of packet dropout in MASs. Ren and Beard [19] studied the consensus problem for first-order continuous-time agents communicating via unreliable network through dynamically changing interaction topology method and proved that asymptotic consensus can be achieved if the union of the directed graph had a spanning tree frequently enough. Sun et al. [20] investigated the convergence and convergence speed for the second-order and the high-order discrete-time Multiagent systems with random networks and arbitrary weights. Zhang and Tian [21] investigated the mean-square consensus problem for continuous time second-order MASs disturbed by noise, variable delays, and occasional packet dropout and discussed the necessary and sufficient condition for mean-square robust consensusability. And in [22], Zhang and Tian further studied the consensus seeking problem for linear MASs, where each agent communicates via a weighted random lossy network and derived the maximum allowable loss probability.

Motivated by the above analysis, this paper is concerned with consensus problem of general linear discrete-time MASs with random packet dropout that happens during the information exchange between agents, which, to the best of our knowledge, has not been fully investigated until now. The contribution of this paper lies in the following: first, a distributed consensus protocol with weighted graph is proposed to address the packet dropout phenomenon; second, through introducing a new disagreement vector, the dynamic average consensus problem is studied based on the established new framework; third, the necessary and sufficient condition for MASs to reach mean-square consensus is derived in terms of stability of an array of low-dimensional matrices, which is easier to be used in reality; moreover, mean-square consensusable conditions with regard to network topology and agent dynamic structure are also provided.

The rest of this paper is organized as follows. In Section 2, modeling construction of Multiagent systems with packet dropout is proposed, and some useful lemmas are introduced. In Section 3, a new framework is derived to address the consensus problem of MASs. The consensusable conditions with regard to network topology and agent dynamic structure are presented in Section 4. In Section 5, an illustrative example is provided to demonstrate the effectiveness of our results. Concluding remarks are drawn in Section 6.

*Notation.* and denote the -dimensional Euclidean space and the set of real matrix, respectively, and represents an -dimensional identity matrix. refers to a diagonal matrix, or a block diagonal matrix. For matrices and , implies that and are symmetric matrices and that is positive definite. The superscript and mean transpose and inverse of a real matrix separately, and symbol in a symmetric matrix implies a block that can be induced by symmetry. , and , denote, respectively, the smallest eigenvalue, the largest eigenvalue and the spectral radius of a matrix. stands for the occurrence probability of a stochastic event and the conditional probability. is the mathematical expectation operator. and stand the 2-norm and 1-norm respectively.

#### 2. Problem Formulation and Preliminaries

Consider a system of agents with identical general linear dynamics. The dynamic equation of agent is described by where is the state variable, is the control input, and and are known constant matrices.

Suppose that there is a predesigned undirected fixed topology which guarantees the effective communication between distinct nodes. This assumption is quite reasonable, since it is impossible to reach consensus under an unconnected topology. Denote as the neighbor set of the node and as the weighted adjacency matrix of undirected graph with , and for any belongs to set , , otherwise, .

Under ideal communication environment, the commonly used linear distributed consensus protocol in MASs is as follows: where is the gain matrix.

As mentioned in Section 1, packet dropout is inevitable in practical environment. In this paper, Bernoulli distributed white sequence is introduced to model the unreliability of the link between agent and agent . At any given time instant , for any , takes value in the set . Suppose that for any , is mutually independent; that is, the packet dropout probability between each pair of agents is independent. When the packet is transmitted successfully between agent and agent , ; when packet dropout takes place between agent and agent , , which can be described as where is the occurrence probability of packet dropout between and , and for any , , .

Besides, due to the occurrence of packet dropout, the topology of MAS (1) is no longer fixed. Denote as the number of agents in set , as the total number of the possible topologies. It is easy to see that ; then the topology of the MAS is changing among the set . Suppose that at certain time instant , and the network topology is , then the occurrence probability of graph , , is

Based upon the above analysis, the following distributed consensus protocol is employed in this paper: where is the state feedback gain matrix to be designed.

Substituting (5) into (1), the dynamic equation of agent can be rewritten as Then, the states of MAS (1) evolve according to the following linear system: where , is a stochastic process driven by an i.i.d. process and , where , , is the Laplacian matrix associated with , with Obviously, the Laplacian matrix is a symmetric matrix with zero row sum that is, , , and .

Before presenting our main results, the concepts of mean-square stability and mean-square consensus are introduced first, and along with them are some useful lemmas which play significant roles in the derivation of our results.

*Definition 1 (see [23]). *A closed-loop system is said to be mean-square stable, if for any , there exists such that for any , holds when . In addition, if for any initial condition, then the closed-loop system is said to be globally mean-square asymptotically stable.

*Definition 2. *Multiagent system (1) with protocol (5) is said to reach consensus in mean-square sense, if for any initial distribution and initial states, holds for all . Furthermore, if there exists a proper state feedback gain matrix such that the Multiagent system can achieve mean-square consensus, then we say that system (1) is mean-square consensusable under protocol (5).

Lemma 3 (see [21]). *For any vector , denote , then there is
*

Lemma 4 (see [6]). *For an undirected graph with vertices, the Laplacian is a positive-semidefinite symmetric matrix, and the spectrum of a graph Laplacian is on the form
**
with if and only if the graph that corresponds to is connected.*

Lemma 5. * has only one zero eigenvalue, if and only if the union graph of the topology set is connected.*

*Proof. * Since can be treated as a Laplacian matrix of a graph which has the same edges with the union graph of the topology set , then together with Lemma 4, it can be obtained that Lemma 5 holds.

Lemma 6 (see [24]). *For any , there exist orthogonal matrix and an upper triangular matrix , such that
**
where , , are the eigenvalues of matrix A.*

#### 3. Necessary and Sufficient Conditions for Mean-Square Consensus

Introduce the following variable:

Rewrite (12) in a compact form, which is where and is the so-called disagreement vector.

It is easy to verify that evolves according to the following disagreement dynamics: where is defined in (7).

Since , where , it is easy to verify that

Equation (15) implies that the mean-square consensus problem can be solved if and only if . From Definitions 1 and 2, it is easy to see that the consensus problem of MAS (1) is converted to the mean square stability analysis of system (14).

*Remark 7. *If the system matrix is Schur stable, which means all eigenvalues of are located in the unit circle, MAS (1) would definitely reach consensus without the design of consensus protocol, since under this condition, for any , will converge to zero, and holds for sure. In view of this, we assume that not all eigenvalues of are located in the unit circle.

Theorem 8. *For any initial distribution and initial states, Multiagent system (1) with the Bernoulli packet dropout between agents can achieve mean-square consensus under protocol (1), if and only if
**
where , , are the eigenvalues of matrix except one zero eigenvalue.*

*Proof. * Since for each , , is a symmetric matrix with zero row sum, and and are, respectively, the left and right eigenvectors of associated with zero eigenvalue, we can construct an invertible matrix with , such that
where , , , and .

Introduce the following variable: , where ; then (14) can be denoted in terms of as

Note that , which implies that state is always stable; thus, divide into two parts; that is, , with , it can be derived from (17) and (18) that
where .

Similar to [21], let ; then evolves according to

From Lemma 3, system (14) is mean-square stable if and only if system (20) is stable. Then, from the discrete-time system stability theory, it can be concluded that the necessary and sufficient condition for mean-square stability of (14) is .

Denote with , , , and ; then there is + . The above equation can be treated as a perturbation of by two terms depending on . For small enough , the above formula is equal to . Meanwhile, . Likewise, by applying perturbation argument, for a small enough , is equivalent to

Next, it will be proved that (21) holds if and only if (16) is satisfied.

It can be seen from (18) that has the same eigenvalue with and except one zero eigenvalue. Besides, based on Lemma 6, there exists an orthogonal matrix such that
where , , are the eigenvalues of matrix except one zero eigenvalue. It is easy to verify that is similar to

Based on the matrix theory, matrix has the same eigenvalue with matrix (23), obviously , if and only if (16) is satisfied. Then, together with the properties of the Kronecker product, it is safe to say that (21) holds if and only if (16) is satisfied, which completes the proof.

*Remark 9. *The contribution of Theorem 8 lies in the fact that it converts the consensus problem of MAS (1) into a set of matrices with the same dimensions as a single agent, which reduces the computational complexity greatly. Besides, while in most of the existing results each agent is guaranteed to achieve consensus with agent 1, see [7, 11, 21] for example, or to achieve average consensus, see [5], for example, in this paper a new disagreement vector is introduced to solve the consensus problem so that each agent will reach consensus on the average states of all agents, that is, dynamic average consensus.

#### 4. Consensusability Analysis

Theorem 8 presents the numerical solution to consensus problem, which also implies the design method of consensus protocol. However, in practice, we are equally interested in that under what conditions MAS (1) has the ability to reach consensus and inequality (16) has a solution at the same time, that is, what are the consensusable conditions? In this section, we focus on addressing this problem.

Theorem 10. *Multiagent system (1) with the Bernoulli packet dropout between agents can achieve mean-square consensus under protocol (5), if and only if the union graph of the topology set is connected, and is stabilizable.*

*Proof. * Necessity: define as the expected Laplacian matrix and its corresponding graph as the expected graph. Since is a symmetric matrix, there exists an invertible matrix with , such that
where , , , , which is defined in (18), is also the left eigenvalue of associated with zero eigenvalue, and is a diagonal matrix with its diagonal elements being , .

Denote ; then evolves according to
where .

Similar to the proof in Theorem 8, introduce the following variable transformation: ; then the dynamic equation of can be written as
where .

Notice that , divide into two parts, that is, , from (19) and (21), it can be derived that

If the union graph of the topology set is not connected, the expected graph is definitely not connected. It can be obtained from Lemma 3 that . Due to the fact that not all eigenvalues of are located in the unit circle, there exists an initial state such that and thus; system (14) is not mean-square stable since , and consequently, Multiagent system (1) cannot achieve mean-square consensus.

Besides, if is unstabilizable, it is impossible to guarantee that , , even if the topology condition is satisfied, and system (27) is still not guaranteed to be stable.

Sufficiency: It can be derived from Lemma 5 that when the union of the graphs in the topology set is connected, all eigenvalues of are positive; that is, , . Therefore, when the union graph of the topology set is connected and is stablizable, there exists a proper gain matrix such that , . The proof is completed.

*Remark 11. *In [21], for two-order continuous-time MASs with , , which implies that is stablizable, Zhang and Tian prove that the MAS can reach mean-square consensus if and only if the union graph is connected, while in this paper, it is verified theoretically that the stabilizability of is essential for achieving consensus.

#### 5. Numerical Simulation

Consider an MAS consisted of four agents, with its prior fixed weighted communication topology being , , , , , , ; then there are eight graphs in the topology set . Assume that the packet dropout probability between each pair of agents is .

Each agent is described by a three-order difference equation, with Obviously, each agent is unstable since the eigenvalues of are , , and , and is stablizable. By applying Theorem 8, it can be obtained that , such that . Suppose the initial conditions are , , , and ; the simulation results are shown in Figure 1.

#### 6. Conclusion

We have studied the consensus problem of general linear discrete-time Multiagent systems (MASs) with random packet dropout that happens during information exchange between agents. The packet dropout phenomenon is characterized as being a Bernoulli random process. A distributed consensus protocol with weighted graph is proposed to address the packet dropout phenomenon. By constructing a new disagreement vector, a new framework is established to solve the consensus problem. Then, through introducing a common linear transformation for the switching system, together with the control theory, the perturbation argument, and the matrix theory, the necessary and sufficient condition for MASs to reach mean-square consensus is derived in terms of stability of an array of low-dimensional matrices. Moreover, mean-square consensusable conditions with regard to network topology and agent dynamic structure are also provided.

It is worth pointing out that this paper is only a first step; the consensus problem of linear discrete time MASs, which may be affected by many other factors including time-delay, and noise, is not fully investigated, and this is of our research interest in the future.

#### Acknowledgments

This work is supported by the National Natural Science Foundation of China under Grants 61074124 and 61374171, the Project-Sponsored by SRF for ROCS, SEM, the Fundamental Research Funds for the Central Universities, HUST, under Grant 2012TS020, and the Graduate Fund of Innovation and Entrepreneurship, Hust, under Grant HF-11-18-2013.

#### References

- S. Kar and J. M. F. Moura, “Distributed consensus algorithms in sensor networks: quantized data and random link failures,”
*IEEE Transactions on Signal Processing*, vol. 58, no. 3, pp. 1383–1400, 2010. View at Publisher · View at Google Scholar · View at MathSciNet - N. A. Lynch,
*Distributed Algorithms*, Morgan Kaufmann, San Francisco, Calif, USA, 1997. View at MathSciNet - H. G. Tanner, A. Jadbabaie, and G. J. Pappas, “Flocking in fixed and switching networks,”
*IEEE Transactions on Automatic Control*, vol. 52, no. 5, pp. 863–868, 2007. View at Publisher · View at Google Scholar · View at MathSciNet - R. S. Dong and Z. Y. Geng, “Consensus based formation control laws for systems on Lie groups,”
*Systems & Control Letters*, vol. 62, no. 2, pp. 104–111, 2013. View at Publisher · View at Google Scholar · View at MathSciNet - R. Olfati-Saber and R. M. Murray, “Consensus problems in networks of agents with switching topology and time-delays,”
*IEEE Transactions on Automatic Control*, vol. 49, no. 9, pp. 1520–1533, 2004. View at Publisher · View at Google Scholar · View at MathSciNet - Y. Hatano and M. Mesbahi, “Agreement over random networks,”
*IEEE Transactions on Automatic Control*, vol. 50, no. 11, pp. 1867–1872, 2005. View at Publisher · View at Google Scholar · View at MathSciNet - Y. Zhang and Y.-P. Tian, “Consentability and protocol design of multi-agent systems with stochastic switching topology,”
*Automatica*, vol. 45, no. 5, pp. 1195–1201, 2009. View at Publisher · View at Google Scholar · View at MathSciNet - F. Sun, J. Chen, Z.-H. Guan, L. Ding, and T. Li, “Leader-following finite-time consensus for multi-agent systems with jointly-reachable leader,”
*Nonlinear Analysis: Real World Applications*, vol. 13, no. 5, pp. 2271–2284, 2012. View at Publisher · View at Google Scholar · View at MathSciNet - P. Lin, Z. Li, Y. Jia, and M. Sun, “High-order multi-agent consensus with dynamically changing topologies and time-delays,”
*IET Control Theory & Applications*, vol. 5, no. 8, pp. 976–981, 2011. View at Publisher · View at Google Scholar · View at MathSciNet - Z. K. Li, Z. S. Duan, G. R. Chen, and L. Hang, “Consensus of multi-agent systems and synchronization of complex networks: a unified viewpoint,”
*IEEE Transactions on Circuits and Systems*, vol. 57, no. 1, pp. 213–224, 2010. View at Google Scholar - J. Xu, L. H. Xie, T. Li, and K. Y. Lum, “Consensus of multi-agent systems with general linear dynamics via dynamic output feedback control,”
*IET Control Theory Applications*, vol. 7, no. 1, pp. 108–115, 2013. View at Google Scholar - X. L. Xu, S. Y. Cheng, W. Huang, and L. X. Gao, “Leader-following consensus of discrete-time multi-agent systems with observer-based protocols,”
*Neurocomputing*, vol. 118, pp. 334–341, 2013. View at Google Scholar - Y. F. Su and J. Huang, “Two consensus problems for discrete-time multi-agent systems with switching network topology,”
*Automatica*, vol. 48, no. 9, pp. 1988–1997, 2012. View at Publisher · View at Google Scholar · View at MathSciNet - P. Lin and Y. Jia, “Multi-agent consensus with diverse time-delays and jointly-connected topologies,”
*Automatica*, vol. 47, no. 4, pp. 848–856, 2011. View at Publisher · View at Google Scholar · View at MathSciNet - Z. H. Wu and H. J. Fang, “Improvement for consensus performance of multi-agent systems based on delayed-state-derivative feedback,”
*Journal of Systems Engineering and Electronics*, vol. 23, no. 1, pp. 137–144, 2012. View at Publisher · View at Google Scholar · View at Scopus - Z. H. Wu, L. Peng, L. B. Xie, and J. W. Wen, “Stochastic bounded consensus tracking of leader-follower multi-agent systems with measurement noises based on sampled-data with small sampling delay,”
*Physica A*, vol. 392, no. 4, pp. 918–928, 2013. View at Publisher · View at Google Scholar · View at MathSciNet - W. Zhu, “Consensus of multiagent systems with switching jointly reachable interconnection and time delays,”
*IEEE Transactions on Systems, Man, and Cybernetics A*, vol. 42, no. 2, pp. 348–358, 2012. View at Publisher · View at Google Scholar · View at Scopus - Y. G. Sun and L. Wang, “${H}_{\infty}$ consensus of second-order multi-agent systems with asymmetric delays,”
*Systems & Control Letters*, vol. 61, no. 8, pp. 857–862, 2012. View at Publisher · View at Google Scholar · View at MathSciNet - W. Ren and R. W. Beard, “Consensus seeking in multiagent systems under dynamically changing interaction topologies,”
*IEEE Transactions on Automatic Control*, vol. 50, no. 5, pp. 655–661, 2005. View at Publisher · View at Google Scholar · View at MathSciNet - F. L. Sun, Z.-H. Guan, X.-S. Zhan, and F.-S. Yuan, “Consensus of second-order and high-order discrete-time multi-agent systems with random networks,”
*Nonlinear Analysis: Real World Applications*, vol. 13, no. 5, pp. 1979–1990, 2012. View at Publisher · View at Google Scholar · View at MathSciNet - Y. Zhang and Y.-P. Tian, “Consensus of data-sampled multi-agent systems with random communication delay and packet loss,”
*IEEE Transactions on Automatic Control*, vol. 55, no. 4, pp. 939–943, 2010. View at Publisher · View at Google Scholar · View at MathSciNet - Y. Zhang and Y.-P. Tian, “Maximum allowable loss probability for consensus of multi-agent systems over random weighted lossy networks,”
*IEEE Transactions on Automatic Control*, vol. 57, no. 8, pp. 2127–2132, 2012. View at Publisher · View at Google Scholar · View at MathSciNet - C. Z. Zhang, G. Feng, H. J. Gao, and Y. Zhao, “State feedback controller design of networked control systems with multiple packet dropouts,” in
*Proceedings of the 29th Chinese Control Conference (CCC '10)*, pp. 5839–5844, July 2010. View at Scopus - F. Z. Zhang,
*Matrix Theory*, Springer, New York, NY, USA, 1999. View at MathSciNet