Discrete Dynamics in Nature and Society

Volume 2013 (2013), Article ID 269235, 11 pages

http://dx.doi.org/10.1155/2013/269235

## Consensus Analysis for High-Order Multi-Agent Systems without or with Delays

^{1}College of Science, Nanjing University of Posts and Telecommunications, Nanjing 210003, China^{2}College of Telecommunications and Information Engineering, Nanjing University of Posts and Telecommunications, Nanjing 210003, China

Received 26 August 2013; Accepted 7 September 2013

Academic Editor: Guanghui Wen

Copyright © 2013 Zhengxin Wang and Yang Cao. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

This paper studies the consensus problem for a high-order multi-agent systems without or with delays. Consensus protocols, which only depend on the own partial information of agents and partial relative information with its neighbors, are proposed for consensus and quasi-consensus, respectively. Firstly, some lemmas are presented, and then a necessary and sufficient condition for guaranteeing the consensus is established under the consensus protocol without delays. Furthermore, communication delays are considered. Some necessary and sufficient conditions for solving quasi-consensus problem with delays are obtained. Finally, some simulations are given to verify the theoretical results.

#### 1. Introduction

In recent years, the consensus problem of multi-agent systems has received a great deal of attention due to its broad applications in formation control of unmanned air vehicles, the design of sensor networks, the cooperative control of mobile robots, and automated highway system. In a word, we say all agents reach the consensus upon certain quantities of interest if all agents agree on a common state eventually; the precise definition will be introduced in the following sections. Many researches have been devoted to the consensus problem of multi-agent systems. In 1995, Vicsek et al. [1] proposed a discrete-time model and concluded that all the headings of the agents converged to a common value by simulations. In 2003, Jadbabaie et al. [2] provided a theoretical explanation for Vicsek’s simulation results by graph theory. Gradually, the consensus problem of multi-agent systems received a growing attention. For example, Olfati-Saber and Murray [3] discussed consensus problems for networks of dynamic agents with fixed and switching topologies under three cases. Ren and Beard [4] considered the problem of information consensus under dynamically changing interaction topologies and weighting factors. Recently, the second-order consensus problem of multi-agent systems has attracted more and more researchers’ attention [5–14]. Different from [5–7, 10], Yu et al. [9], Song et al. [11], and Wen et al. [14] all studied the second-order consensus problem of multi-agent systems with nonlinear dynamics. Compared with synchronization in complex networks which are of nonlinear dynamics, a generalized consensus was investigated. From a unified viewpoint, [15] provided a novel framework for the consensus of multi-agent systems and the synchronization of complex networks. Viewed from the leader-following consensus, both Song et al. [11] and Zhu and Cheng [12] considered the consensus problem with a leader. In general, the second-order consensus problem pays attention to whether the relative position and velocity of each agent will converge to common state.

At the same time, the high-order consensus problem of multi-agent systems is also worth being studied. Generally speaking, the first-order consensus problem of multi-agent systems can be considered as a special case of the synchronization of complex dynamic networks. Moreover, second-order consensus problem of multi-agent system means that the relative position and velocity of each agent will be converged to common. However, the birds achieving the consensus should be on the acceleration besides the relative position and velocity for the flocks of birds [16], which means that all the position, velocity, and acceleration will be converged to common. Recently, there are more and more studies on the high-order consensus or swarming problem (see [16–20] and the references therein).

Motivated by the previously mentioned results, consensus of high-order multi-agent systems is investigated in this paper. A new consensus protocol which only depends on the own partial information of agents and partial relative information with its neighbors is proposed. In other words, the consensus protocol in this paper does not need the global information of agents and the global relative information. It is convenient to be designed when the global information states cannot be available. Furthermore, we consider the quasi-consensus problem of high-order multi-agent systems with a time-delay protocol. The delay is nonnegligible in the information exchanges due to the limited transmission speed or memory effect. Therefore, there are many papers focusing on the consensus problem with delay [21–25]. It is worth noting that Yu et al. [25] considered the quasi-consensus problem of second-order multi-agent systems with delay under the protocol This delay is caused by the fact that the agent needs some memory to store the outdated information from its neighboring agents. It found that this delay can induce quasi-consensus; that is, all agents have the same velocity but keep a distance from each other eventually. Therefore, the delay in this sense looks very interesting. This paper considers quasi-consensus of high-order multi-agent systems with the delay in the sense of memory effect. Based on the Nyquist stability criterion, some results on the quasi-consensus of high-order multi-agent systems are obtained. It is worth noting that the results on the consensus of high-order multi-agent systems with a protocol of communication delay hold similarly. Furthermore, some simulations are given to verify the theoretical results.

*Notations*. Let denote the -dimensional Euclidian space. Let and be the zero matrix and identity matrix, respectively. If is a matrix, then rank and denote the rank and the spectrum of , respectively. Let and denote the column vectors of all ones and all zeros, respectively. The symbol denotes the Kronecker product.

#### 2. Preliminaries and Model

Consider a multi-agent systems of agents. The dynamics of each agent is governed by the following general th-order integrator: where , is a positive integer and denotes the order of the differential equations, , are the states of agent , is the consensus protocol, and denotes the th-order derivative of . The initial state denotes .

We use the weighted undirected graph to model the interaction topology of the multi-agent systems; that is, each vertex represents an agent of systems; each arc (edge) represents that there is a communication link from agent to agent . is the weight of the communication link . One can see [26] for more details. Now, we propose the following consensus protocol: where . Let be two nonempty subsets such that , is the coupling strength and is the feedback gain of relative information. , otherwise, and let ; , otherwise, and let . Let .

Let and , . By employing the consensus protocol (3), the dynamics equations of all agents can be written as follows: where is the associated Laplacian of ; that is , . It is easy to note that where .

*Definition 1. *The multi-agent systems governed by (4) are said to achieve consensus if , , , for any initial values.

*Remark 2. *For convenience, we assume in the following discussion; however, all the results hereafter remain valid for by the Kronecker product.

#### 3. Consensus Analysis

In this section, we consider the consensus problem defined in the Section 2 for the multi-agent systems (4) with fixed topology. To this end, we establish the following lemmas which are needed for the main results.

Denote . One has the following lemmas.

Lemma 3. * is similar to .*

*Proof. *
See the appendix.

Lemma 4. *Assume that is defined in (5) and ; then the characteristic polynomial of is
**
where .*

*Proof. *See the appendix.

Lemma 5. * has at least zero eigenvalues. It has exactly zero eigenvalues if and only if has a simple zero eigenvalue. If has a simple zero eigenvalue, then the geometric multiplicity of the zero eigenvalue of equals one. Moreover, the left and right eigenvector of associated with eigenvalue zero are as follows:
*

*Proof. *See the appendix.

Based on the previous lemmas, here we give the main result.

Theorem 6. *Under the consensus protocol (3), the multi-agent systems (4) achieve the consensus if and only if has exactly zero eigenvalues and all of other eigenvalues are negative.*

*Proof (Sufficiency). *If has exactly zero eigenvalues, then has the Jordan canonical form , where
is the upper diagonal block matrix with diagonal entries being the nonzero eigenvalues of . Moreover, one has
where , can be chosen to be the right eigenvectors or generalized eigenvectors of , , , can be chosen to be the left eigenvectors or generalized eigenvectors of . Without of loss generality, assume that and . Let , ; one can verify that are a right eigenvector and generalized right eigenvectors of associated with zero eigenvalue, respectively. Since has exactly zero eigenvalues, without loss of generality, one can denote them by . By Lemma 5, we know that has a simple zero eigenvalue, which implies that there is a nonnegative vector such that , by [16]. Then we choose, , , . It follows from Lemma 5 that they are generalized left eigenvectors and a left eigenvector of associated with eigenvalue zero, respectively. Moreover, , . It is noted that
where since the nonzero eigenvalues have negative real parts and
Therefore, for enough large , the dominant terms of denoted by isThus, we write by a compact form
where is a polynomial of with degree . It follows from (4) that
that is, for enough large ,
which implies that as for .

If , then as . Therefore, as , for all , . This implies that the multi-agent systems achieve the consensus.

(Necessity). By reduction to absurdity, suppose that the sufficient condition dose not hold; then there are two cases may be hold.*Case 1. * has more than zero eigenvalues. *Case 2. * has exactly zero eigenvalues, but it has at least one eigenvalue with nonnegative real part.

If Case 1 holds, then .

If Case 2 holds, then , and . However, it follows from (the dominant terms of ) that if the consensus is achieved, then . This is a contradiction.

*Remark 7. *From Theorem 6, if (4) achieves the consensus, then has exactly zero eigenvalues. Therefore, has a simple zero eigenvalue, which implies that the information exchange topology is connected.

*Remark 8. *Compared to the consensus protocols proposed in [16–19], protocol (3) only depends on the own partial information of agents and the partial relative states with its neighbors, which does not need the global information of agents or the global relative information. It is convenient to design when global information states cannot be available.

To illustrate the previous result, we consider the following example.

*Example 9. *Considering the following third-order system of agents, where the dynamics of each agent are governed by
where , , , , denote the position, velocity, and acceleration of agent , respectively, let Laplacian matrix be
It follows from the that the graph is connected. Moreover, the eigenvalues of are 0, 0.382, 0.6086, 1, 1, 2.2271, 2.618, and 5.1642. If we choose , , , and , then . Furthermore, has zero eigenvalues and the real parts of all other eigenvalues are negative. Let the initial values be the , , . By Theorem 6, consensus in dynamical multi-agent systems (18) with network topology (19) can be achieved. Figures 1, 2, and 3 show the plots of , , , , respectively.

#### 4. Quasi-Consensus Problem with Delays

Because of the limited transmission speed or memory effect, there exist nonnegligible delays in the communication process. Therefore, it is necessary to consider the influence of delays on the consensus. In [25], the authors considered the delays in the sense of memory store by the fact that the agent uses the memory to store the outdated information of its neighbors. Such delays are so interesting that can deduce quasi-consensus. In this section, we consider the consensus problem with the protocol of delays in the sense of memory store as follows: where . Let , .

With the consensus protocol (20), the closed loop of multi-agent systems (2) can be written as where , are defined as (5) and

Therefore, Let be the Jordan matrix associate with the . Therefore, there exists orthogonal matrix such that . Then, Let . Then, it follows from (24) that that is The characteristic equation of the multi-agent system (26) is

*Definition 10. *The multi-agent systems (2) are said to achieve quasi-consensus if
for any initial conditions, where are constants, for all and .

Theorem 11. *Assume that is connected. Quasi-consensus of multi-agent systems (2) with protocol (20) can be achieved if and only if each equation of (27) () has only simple zero root and the real parts of all other roots are negative.*

*Proof (Sufficiency). *If is connected, then has only a simple zero eigenvalue with associated right eigenvector , where , , , . If each equation of (27) () has only simple zero root and the real parts of all other roots are negative, then the states in (26) converge to some constants. It follows from the that . Denote ; then one has
Noting that , if one of the does not converge to zero, then . Therefore, , , . Moreover, one has ; therefore,
Thus,
where , . Therefore, the quasi-consensus is reached.

(Necessity). If the quasi-consensus can be reached, then there exists such that . Since is connected, has only one zero eigenvalue with associated eigenvector . Thus, ; that is, . Therefore, it follows from that
, , . By way of contradiction, assume that the sufficient condition does not hold; then there are two cases.*Case 1. *Each of equations (27) () has more than one zero roots. *Case 2.* Each of equations (27) () has simple zero root; however, there exists nonnegative real part.

If one of the previous two cases holds, then there exists a such that for , which contradicts formula (32).

can be expressed by Taylor expansion; therefore, (27) can be rewritten as follows:

Since and , , (33) has only simple zero root for . When , let , where Based on the Nyquist stability criterion, therefore, the real parts of nonzero roots of (27) are negative if and only if does not enclose the point for , where is imaginary unit.

Without loss of generality, assume that is an odd number. Denote and . By some calculations, one can obtain

Let , .

Therefore,

Therefore, Theorem 11 is equivalent to the following theorem.

Theorem 12. *Assume that is connected. Quasi-consensus of multi-agent systems (2) with protocol (20) can be achieved if and only if
**
does not enclose the point for and , where , *

As the symmetric property of the Nyquist plot, we only need to consider the case of . When , is monotonously decreasing; furthermore, where is the nonnegative integer.

When , crosses the negative real axis for the first time at , one has where , .

Therefore, one has the following result equivalently.

Theorem 13. *Assume that is connected. Quasi-consensus of multi-agent systems (2) with protocol (20) can be achieved if and only if
**
where is defined by .*

Denote . If all satisfy then Theorem 13 holds.

*Remark 14. *If one considers consensus protocol with communication delays as follows:
then the similar results can be obtained.

*Example 15. *Considering the multi-agent systems which is similar to example 1, here we take (20) as the quasi-consensus protocol. We take the same parameters; that is, the Laplacian matrix is also
, , and and . Then, eigenvalues of are , , , , , , and . By simulation, . Moreover, we choose . By Theorem 13, one knows that the quasi-consensus can be reached. Figures 4, 5 and 6 show that the quasi-consensus is reached.

#### 5. Conclusions

When the global states of agents and global relative information are unavailable, this paper designs a consensus protocol which only depends on the own partial information of agents and partial relative information with its neighbors. Under the consensus protocol, a necessary and sufficient condition for guaranteeing the consensus for a high-order integrator multi-agent systems is established. Moreover, the consensus protocol shows that the consensus can be reached when the own states of agents are complementary to the relative information with its neighbors; the consensus may not be reached when there are only a few information exchanges. Moreover, the paper also considers the quasi-consensus problem under the protocol with the delays. It is interesting that multi-agent systems can reach consensus without delays and quasi-consensus with delays.

#### Appendix

*Proof of Lemma 3. *In fact, let
where . Then . On the other hand, let and ; then
Noting that is a rearrange of , there exists a nonsingular matrix in which every row and every column has only simple one such that , which together with (A.2)
that is, . Therefore, is similar to . Moreover, and have the same characteristic polynomial and eigenvalues.

*Proof of Lemma 4. *Let be a nonsingular matrix such that , where is the Jordan matrix associated to . Thus

*Proof of Lemma 5. *It follows from (8) that there are zero eigenvalues of that correspond to each zero eigenvalue of . In fact, for every zero eigenvalue of ; that is, ,
which implies that every zero eigenvalue of corresponds to zero eigenvalues of . It is directly to see that has at least one zero eigenvalue with an associated eigenvector , since . Therefore, has at least zero eigenvalues. Moreover, It follows from (8) again that has exactly eigenvalues if and only if has exactly a simple zero eigenvalues.

Next, by a similar method from [16], let be an eigenvalue of with associated eigenvector , where are column vectors. Therefore,
which implies that , ; moreover, . Let ; that is, is an eigenvalue of with associated eigenvector . If has a simple zero eigenvalue, without loss of generality, suppose that , then has a eigenvalue (the algebraic multiplicity is ), so and , which is only one linearly independent eigenvector for associated with eigenvalue zero; that is, the geometric multiplicity of zero eigenvalue of is one.

It is easy to note that
Therefore, we obtain

#### Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

#### Acknowledgments

This work was jointly supported by the National Natural Science Foundation of China under Grant no. 61304169, the Natural Science Foundation of the Jiangsu Higher Education Institutions under Grant no. 13KJB110022, the Natural Science Foundation of Jiangsu Province of China under Grant no. BK20130857 and the Scientific Research Foundation of Nanjing University of Posts and Telecommunications under Grant no. NY213052.

#### References

- T. Vicsek, A. Czirk, E. Ben-Jacob, I. Cohen, and O. Shochet, “Novel type of phase transition in a system of self-driven particles,”
*Physical Review Letters*, vol. 75, no. 6, pp. 1226–1229, 1995. View at Publisher · View at Google Scholar · View at Scopus - A. Jadbabaie, J. Lin, and A. S. Morse, “Coordination of groups of mobile autonomous agents using nearest neighbor rules,”
*IEEE Transactions on Automatic Control*, vol. 48, no. 6, pp. 988–1001, 2003. View at Publisher · View at Google Scholar · View at MathSciNet - R. Olfati-Saber and R. M. Murray, “Consensus problems in networks of agents with switching topology and time-delays,”
*IEEE Transactions on Automatic Control*, vol. 49, no. 9, pp. 1520–1533, 2004. View at Publisher · View at Google Scholar · View at MathSciNet - W. Ren and R. W. Beard, “Consensus seeking in multi-agent systems under dynamically changing interaction topologies,”
*IEEE Transactions on Automatic Control*, vol. 50, no. 5, pp. 655–661, 2005. View at Publisher · View at Google Scholar · View at MathSciNet - Z. Meng, W. Ren, Y. Cao, and Z. You, “Leaderless and leader-following consensus with communication and input delays under a directed network topology,”
*IEEE Transactions on Systems, Man, and Cybernetics B*, vol. 41, no. 1, pp. 75–88, 2011. View at Publisher · View at Google Scholar · View at Scopus - G. Xie and L. Wang, “Consensus control for a class of networks of dynamic agents,”
*International Journal of Robust and Nonlinear Control*, vol. 17, no. 10-11, pp. 941–959, 2007. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - W. Ren, “On consensus algorithms for double-integrator dynamics,”
*IEEE Transactions on Automatic Control*, vol. 58, no. 6, pp. 1503–1509, 2008. View at Publisher · View at Google Scholar · View at MathSciNet - G. Wen, Z. Duan, W. Yu, and G. Chen, “Consensus of second-order multi-agent systems with delayed nonlinear dynamics and intermittent communications,”
*International Journal of Control*, vol. 86, no. 2, pp. 322–331, 2013. View at Publisher · View at Google Scholar · View at MathSciNet - W. Yu, G. Chen, M. Cao, and J. Kurths, “Second-order consensus for multi-agent systems with directed topologies and nonlinear dynamics,”
*IEEE Transactions on Systems, Man, and Cybernetics B*, vol. 40, no. 3, pp. 881–891, 2010. View at Publisher · View at Google Scholar · View at Scopus - W. Yu, G. Chen, and M. Cao, “Some necessary and sufficient conditions for second-order consensus in multi-agent dynamical systems,”
*Automatica*, vol. 46, no. 6, pp. 1089–1095, 2010. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - Q. Song, J. Cao, and W. Yu, “Second-order leader-following consensus of nonlinear multi-agent systems via pinning control,”
*Systems & Control Letters*, vol. 59, no. 9, pp. 553–562, 2010. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - W. Zhu and D. Cheng, “Leader-following consensus of second-order agents with multiple time-varying delays,”
*Automatica*, vol. 46, no. 12, pp. 1994–1999, 2010. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - G. Wen, Z. Duan, W. Yu, and G. Chen, “Consensus in multi-agent systems with communication constraints,”
*International Journal of Robust and Nonlinear Control*, vol. 22, no. 2, pp. 170–182, 2012. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - G. Wen, Z. Duan, W. Yu, and G. Chen, “Consensus of multi-agent systems with nonlinear dynamics and sampled-data information: a delayed-input approach,”
*International Journal of Robust and Nonlinear Control*, vol. 23, no. 6, pp. 602–619, 2013. View at Publisher · View at Google Scholar · View at MathSciNet - Z. Li, Z. Duan, G. Chen, and L. Huang, “Consensus of multiagent systems and synchronization of complex networks: a unified viewpoint,”
*IEEE Transactions on Circuits and Systems I*, vol. 57, no. 1, pp. 213–224, 2010. View at Publisher · View at Google Scholar · View at MathSciNet - W. Ren, K. L. Moore, and Y. Chen, “High-order and model reference consensus algorithms in cooperative control of multivehicle systems,”
*Journal of Dynamic Systems, Measurement and Control*, vol. 129, no. 5, pp. 678–688, 2007. View at Publisher · View at Google Scholar · View at Scopus - F. Jiang, L. Wang, and Y. Jia, “Consensus in leaderless networks of high-order-integrator agents,” in
*Proceedings of the American Control Conference (ACC '09)*, pp. 4458–4462, St. Louis, Mo, USA, June 2009. View at Scopus - W. He and J. Cao, “Consensus control for high-order multi-agent systems,”
*IET Control Theory & Applications*, vol. 5, no. 1, pp. 231–238, 2011. View at Publisher · View at Google Scholar · View at MathSciNet - F. Xiao and L. Wang, “Consensus problems for high-dimensional multi-agent systems,”
*IET Control Theory & Applications*, vol. 1, no. 3, pp. 830–837, 2007. View at Publisher · View at Google Scholar · View at Scopus - N. Cai, J.-X. Xi, and Y.-S. Zhong, “Swarm stability of high-order linear time-invariant swarm systems,”
*IET Control Theory & Applications*, vol. 5, no. 2, pp. 402–408, 2011. View at Publisher · View at Google Scholar · View at MathSciNet - P. Lin and Y. Jia, “Consensus of a class of second-order multi-agent systems with time-delay and jointly-connected topologies,”
*IEEE Transactions on Automatic Control*, vol. 55, no. 3, pp. 778–784, 2010. View at Publisher · View at Google Scholar · View at MathSciNet - C. Liu and F. Liu, “Consensus problem of coupled dynamic agents with communication delay,” in
*Proceedings of the 29th Chinese Control Conference (CCC '10)*, pp. 4501–4505, Beijing, China, July 2010. View at Scopus - X. Liu, W. Lu, and T. Chen, “Consensus of multi-agent systems with unbounded time-varying delays,”
*IEEE Transactions on Automatic Control*, vol. 55, no. 10, pp. 2396–2401, 2010. View at Publisher · View at Google Scholar · View at MathSciNet - Y. G. Sun, L. Wang, and G. Xie, “Average consensus in networks of dynamic agents with switching topologies and multiple time-varying delays,”
*Systems & Control Letters*, vol. 57, no. 2, pp. 175–183, 2008. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - W. Yu, G. Chen, and W. Ren, “Delay-induced quasi-consensus in multi-agent dynamical systems,” in
*Proceedings of the 29th Chinese Control Conference (CCC '10)*, pp. 4566–4571, Beijing, China, July 2010. View at Scopus - C. Godsil and G. Royle,
*Algebraic Graph Theory*, Springer, New York, NY, USA, 2001. View at Publisher · View at Google Scholar · View at MathSciNet