## Coordinated Control and Estimation of Multiagent Systems with Engineering Applications

View this Special IssueResearch Article | Open Access

# Impulsive Containment Control in Nonlinear Multiagent Systems with Time-Delay

**Academic Editor:**Housheng Su

#### Abstract

The containment control problems of nonlinear multiagent systems with time-delay via impulsive algorithms under both fixed and switching topologies are studied. By using the Lyapunov methods, several conditions are derived to achieve the containment control. It is shown that the states of the followers can converge into the convex hull spanned by the states of the leaders if every leader has directed paths to all the followers and the impulsive period is short enough. Finally, some simulations are conducted to verify the effectiveness of the proposed algorithms.

#### 1. Introduction

Recently, the distribution cooperative control of the multiagent systems has attracted numerous researches due to the extensive applications in the scientific, engineering, biological aspects, and so forth [1–5]. The very essence of the distribution cooperative control lies in that none of the agents know the states of all the other agents exactly and every agent updates its own states based on the state information from its neighbors. Consensus problems, as a fundamental branch of cooperative control, have been investigated in many literatures with plenty of useful results obtained [6, 7]. In earlier times, the researches mainly focused on the consensus cases where there exists no more than one leader [8–11]. Zhu and Cheng in [8] considered the consensus of multiagent systems where there exists one leader. Su et al. in [9, 10] mainly investigated the leader-following consensus of linear multiagent systems with one leader and input saturation. Lu et al. [11] studied the finite-time distributed tracking control for multiagent systems with an active leader.

The investigations on consensus problems of multiple leaders [12–19], called containment control, are also significant because they are related with many practical applications, such as there are some agents equipped with the detective sensors, while the other less capable agents are driven into the convex hull spanning by the former agents such that all the agents can navigate their trip without any potential danger.

The proposed algorithms in [13, 14] are applied to multiagent systems with linear dynamics. These critical defects limit the validity of the proposed models because the nonlinear systems are ubiquitous in the real world [20–22]. In this paper, we deal with the containment control of the nonlinear multiagent systems. Compared with the continuous control algorithms [12–19], the impulsive algorithms have remarkable superiority as the impulsive controllers are usually simple and practical [23–26]. In many cases, to achieve the consensus, the continuous regulation and control are not necessary or impossible. Nevertheless, the impulsive algorithms just need to regulate and alter the states of the systems at the impulsive instants. Also, it can be easily seen that impulsive control is effective and efficient in the control of the multiagent systems to achieve consensus. In many real applications, due to the limited switching speed and the transmission of the signals, the next states of the dynamic systems may be concerned not only with the states at this time but also with states of the time before. It is practical and necessary to analyse the systems with time-delay. If the time-delay is not taken into consideration in the system models, inappropriate or even inaccurate results may be obtained. There are some works [27, 28] that deal with the consensus or synchronization problem with time-delays.

Motivated by the aforementioned discussions, we investigate the achievement of the containment control for the nonlinear multiagent systems with time-delay under both fixed and switching topology in this paper. The proposed impulsive algorithm can achieve the containment control and some sufficient conditions are obtained, which show that, for specific dynamic systems, the containment control can be achieved if the control period of the impulsive algorithms and the feedback gain of the controller satisfy the given conditions. Finally, some numerical simulations are presented to verify the validity of the theoretical analysis.

The outline of this paper is organized as follows. In Section 2, we first give some preliminaries which are essential for the analyses of the multiagent systems. Then, the containment control of the nonlinear dynamic systems with internal time-delays under both fixed and switching topology via impulsive algorithms is considered. In Section 3, some simulations are presented to illustrate the theoretical results. Finally, some conclusions of this paper are drawn in Section 4.

The notions and symbols used in the paper are given as follows. denotes the set of real numbers. Let be the identity matrix (or just if no confusion), . is the matrix with all entries zero. denotes the Euclidean norm. , denote the maximum and minimum eigenvalue of the square matrix , respectively.

#### 2. Impulsive Containment Control for Nonlinear Systems with Internal Delay

First, we summarize some definitions and results from graph theory that will be used in the paper.

Let be a weighted graph consisting of the set of nodes , the set of edges , and a weighted adjacency matrix , , . If , then and ; otherwise, and the diagonal entries of are zero; that is, . A path from node to node is a sequence of edges , where . denotes the set of the neighbors of node , where . The Laplacian matrix of graph is denoted by , and for .

##### 2.1. Impulsive Containment Control for Nonlinear Dynamic Systems of Fixed Topology with Internal Delay

Consider a nonlinear dynamic multiagent system with agents. Assume that there are leaders and followers. An agent is a leader if the agent does not receive any information from others. Otherwise, it is a follower. The set of leaders is denoted by and the set of followers is denoted by . Let be the set of all the agents. The communications among the agents are represented by a directed graph .

The dynamics of the nonlinear multiagent system with internal time-delay are given as follows:where is the internal delay and and are the state and control input of the th agent, respectively. is the nonlinear dynamic of the th agent.

*Assumption 1. *The nonlinear function in system (1) satisfies the convex Lipschitz condition. That is, there exist two positive numbers and , such that, for all , ,where and .

The initial states of the system (1) arewhere and is the -dimensional vector space of continuous functions. In this paper, we consider the case of and all the results will hold for () by using the property of Kronecker product.

From the definitions of the leader and the follower, the Laplacian matrix of the graph can be partitioned aswhere is a matrix which denotes the communications among the followers. is a matrix which denotes the communications among the followers and leaders.

*Assumption 2. *In the graph , the communications among the followers are undirected and, for each follower, there exists at least one leader that has a directed path to that follower.

From the property of the Laplacian matrix, the following lemma can be obtained.

Lemma 3 (see [17]). *Let Assumption 1 hold. Then is symmetric positive definite and all the entries of are nonnegative and .*

*Definition 4 (see [29]). *A subset of is said to be convex if whenever , , and . The convex hull of a finite set of points ( is a positive integer) is the minimal convex set containing all points in . We use to denote it; that is,

*Definition 5. *The containment control is achieved in system (1) if, for any initial conditions, as , for all . That is, each state of the followers will converge into the convex hull formed by the states of the leaders as .

To achieve the containment control for the system (1), we propose the following impulsive algorithm:where is the feedback gain to be determined and is the adjacency matrix associated with the graph . The impulsive instants are , , . That is, is the impulsive instant sequence, where ; is the initial time. is the Dirac impulsive function.

Using the impulsive algorithm (6) in the system (1), we can obtain where and Assume that is left-hand continuous at , ; that is, , where , . For simplification, we assume that , , is continuous at the initial time .

*Assumption 6. *The internal delay must be less than the impulsive period. That is, , where , , is the impulsive period.

LetAccording to equality (4), the system (7) can be rewritten asLet , , and . Because and from equality (9), the following equations can be obtained:

*Remark 7. *From Lemma 3, every entry in is nonnegative and . We can get that each entry of is the convex hull formed by the states of the leaders. So, the containment control is achieved if the system (10) is stable.

Theorem 8. *Suppose that Assumptions 1, 2, and 6 are satisfied. The system (1) using impulsive algorithm (6) achieves containment control, that is, , as , if the following conditions are satisfied:**where is an auxiliary constant.*

*Proof. *Construct a Lyapunov function . Then is piecewise continuous and positive definite. When , we can get . Let and ; then we can get . From Assumption 1 and (10),can be obtained. That is,It is obvious thatCombining inequalities (15) and (16) and the definition of , we can arrive at the following inequality:From the definition of , we can obtain . From system (10), it is easy to see that . Thus,That is,To prove that the Lyapunov function is convergent, we construct an auxiliary variable in the following form:where the initial states are , , and , where , , and .

LetFrom inequalities (17), (19), and (20), it is obvious that, for all , . And the solution of (20) satisfies the following integral equation:where , , is the state transition matrix of the system (21).

When and , , we can arrive atFrom inequalities (11) and (12), we can obtainLet and . From condition (13), it is obvious that and . Accordingly, inequality (23) can be rewritten:Thus, from equality (22), we can obtainfor .

Let . Then, has a unique solution because is a strictly monotonic function and , . According to and when , we can getwhere . And we can prove that inequality (27) is true for in the following.

Suppose that inequality (27) is not held; there must exist a such thatHowever, from (26) and (29), we can obtainCombine the fact that and we can getwhich contradicts inequality (28). Thus, (27) can hold for .

As , thenThat is,This completes the proof.

*Remark 9. *For the special case with only one leader, the final states of the followers will track the leader under the conditions in Theorem 8. That is, , as , where and is the state of the leader.

##### 2.2. Impulsive Containment Control for Nonlinear Dynamic Systems of Switching Topology with Internal Delay

In the following, we propose the impulsive algorithms to achieve the containment control for nonlinear systems with switching topologies.

Consider the nonlinear system (1) in the switching cases; the proposed impulsive algorithm iswhere is the feedback gain.

Using the impulsive algorithm (34), the system (1) can be rewritten as where and assume that is left-hand continuous at , , . Obviously, is continuous when . For simplicity, we assume that is continuous at , .

LetFrom (4) and (35), we can arrive atwhere . The switching signal , which is equivalent to , is a piecewise constant function. That is, the Lapacian matrix of the communication topologies is assumed to take from a set and the switching signal describes which communication topology is active in the time interval . The communication topology is constant during and changes at , So, there exist subsystems in the system (37); that is,where , .

To simplify the presentation, define the constant numbers that satisfy the following equality:

Theorem 10. *Suppose that Assumption 2 is satisfied in every subsystem of (38) and Assumptions 1 and 6 are held. The system (1) with switching topologies using impulsive algorithm (34) achieves the containment control if**That is,**where is an auxiliary constant.*

*Proof. *Construct a Lyapunov function ; then is piece continuous and positive definite. It is obvious that is left-hand continuous at , . Now consider the time interval , . When , owing to Assumption 1, the differential of the with regard to (38) iswhere . It is obvious thatAs a consequence, we obtainIt follows from (38) that . Combine the definition of and in equality (39); we can obtainwhere , .

To prove the Lyapunov function is convergent, we construct an auxiliary variable in the following form:where the initial states of , , , , where , , .

Letwhere .

From (45), (46), and (47), it is obvious that, for all , . And the solution of (47) satisfies the following integral equation:where , , is the state transition matrix of the system (48).

When and , we can arrive atFrom inequalities (40) and (41), we can obtainLet and . Then, from inequality (42), we can get and . Accordingly, inequality (50) can be rewritten as follows:Thus, from (49), we can obtainLet . Then, has a unique solution because is a strictly monotonic function and , . It is obvious that the following inequality is satisfied:where . Then we can prove that inequalityis true in the following.

Suppose that inequality (55) is not held; there must be a such thatHowever, from (53) and (57), we can obtainwhich contradict inequality (56). Thus, (55) can hold for .

As ,That is,This completes the proof.

*Remark 11. *For the special case with only one leader, the result obtained in Theorem 10 also holds. And the final states of the followers will track the leader’s state.

*Remark 12. *The fixed communication topology in Section 2.1 can be viewed as a special case in the switching topology case. The achievement of the containment control in the fixed topology systems is the fundamental problem and it contributes to the proof procedure of the switching counterpart.

*Remark 13. *The design procedure of the impulsive controller in Theorem 8 is that first, according to the communication topology of the graph and inequality (11), the region of can be ascertained. Then, we choose an appropriate constant . From conditions (12) and (13), we can derive the region of the feedback and the impulsive period . Choosing the appropriate and , the containment control can be achieved. The counterpart under switching topology in Theorem 10 is similar and we omit it.

#### 3. Simulations

In this section, we give some examples to verify the theoretical analysis. The communication graphs are shown in Figure 1. The agents labeled as 6 and 7 are the leaders and the agents labeled as 1, 2, 3, 4, and 5 are the followers.

*Example 1. *According to Figure 1, the communication graph satisfies the Assumption 2. Consider that the system (1) with the nonlinear dynamic is , . Obviously, Assumption 1 is satisfied in the system and the corresponding parameters are and , respectively. Using the proposed impulsive containment control algorithm (6), the simulation results are shown in Figure 2. From condition (11) in Theorem 8, the regions of should be . In this case, we choose and, according to conditions (12) and (13), it is obvious that the region of and the impulsive period are and , respectively. We choose and . Suppose the time-delay . Obviously, Assumption 6 is satisfied in the system (1). From Figure 2, it is obvious that the final states of the followers converge into the convex hull formed by the leaders.

*Example 2. *The graphs of the communication topology are shown in Figure 1. Now consider the nonlinear system , , with switching topologies. It is clear that the four topologies in Figure 1 satisfy Assumption 2 and the dynamics of the system satisfy Assumption 1. In every time interval , , the communication topology is chosen from Figure 1 randomly. Using the impulsive algorithm (34), the simulation result of the nonlinear system with switching topologies is shown in Figure 3. According to the conditions in Theorem 10, the region of is and we choose . According to condition (41), the feedback gain should choose from and we choose . From inequality (42), the impulsive period should be less than and we choose . And suppose that the time-delay , which satisfies Assumption 6. From Figure 3, we can get that the containment control is achieved and the follower’s states converge into the convex hull spanned by the multiple leaders. The final states of the followers converge to as and the states are time varying and nonsmooth.

#### 4. Conclusions

This paper has considered the nonlinear multiagent systems with time-delay of multiple leaders. When the topologies in the nonlinear systems are fixed, an impulsive control algorithm is proposed and some useful sufficient conditions to achieve containment control are obtained. Also, the nonlinear systems under switching topologies are considered. Using the proposed impulsive algorithms, the final states of all the followers will converge into the convex hull formed by the states of the leaders. Finally, some simulations are given to illustrate our theoretical analyses.

#### Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

#### Acknowledgments

The work was supported partly by the National Natural Science Foundation of China under Grants 61374064, 61304152, and 61364017, the National Key Technology R&D Program of China 2013BAA01B01, and the China Postdoctoral Science Foundation funded Project 2012M511258 and 2013T60738.

#### References

- H. Su, X. Wang, and Z. Lin, “Flocking of multi-agents with a virtual leader,”
*IEEE Transactions on Automatic Control*, vol. 54, no. 2, pp. 293–307, 2009. View at: Publisher Site | Google Scholar | MathSciNet - H. Du and S. Li, “Attitude synchronization control for a group of flexible spacecraft,”
*Automatica*, vol. 50, no. 2, pp. 646–651, 2014. View at: Publisher Site | Google Scholar | MathSciNet - D. Yuan, D. W. Ho, and S. Xu, “Inexact dual averaging method for distributed multi-agent optimization,”
*Systems & Control Letters*, 2014. View at: Publisher Site | Google Scholar - Z. Liu, Z. Guan, T. Li, X. Zhang, and J. Xiao, “Quantized consensus of multi-agent systems via broadcast gossip algorithms,”
*Asian Journal of Control*, vol. 14, no. 6, pp. 1634–1642, 2012. View at: Publisher Site | Google Scholar | MathSciNet - X. Lu, F. Austin, and S. Chen, “Formation control for second-order multi-agent systems with time-varying delays under directed topology,”
*Communications in Nonlinear Science and Numerical Simulation*, vol. 17, no. 3, pp. 1382–1391, 2012. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - R. Olfati-Saber and R. M. Murray, “Consensus problems in networks of agents with switching topology and time-delays,”
*IEEE Transactions on Automatic Control*, vol. 49, no. 9, pp. 1520–1533, 2004. View at: Publisher Site | Google Scholar - W. Ren and R. W. Beard, “Consensus seeking in multiagent systems under dynamically changing interaction topologies,”
*IEEE Transactions on Automatic Control*, vol. 50, no. 5, pp. 655–661, 2005. View at: Publisher Site | Google Scholar | MathSciNet - W. Zhu and D. Cheng, “Leader-following consensus of second-order agents with multiple time-varying delays,”
*Automatica*, vol. 46, no. 12, pp. 1994–1999, 2010. View at: Publisher Site | Google Scholar | MathSciNet - H. Su, M. Z. Q. Chen, J. Lam, and Z. Lin, “Semi-global leader-following consensus of linear multi-agent systems with input saturation via low gain feedback,”
*IEEE Transactions on Circuits and Systems I: Regular Papers*, vol. 60, no. 7, pp. 1881–1889, 2013. View at: Publisher Site | Google Scholar | MathSciNet - H. Su, M. Chen, X. Wang, and J. Lam, “Semiglobal observer-based leader-following consensus with input saturation,”
*IEEE Transactions on Industrial Electronics*, vol. 61, pp. 2842–2850, 2014. View at: Google Scholar - X. Lu, R. Lu, S. Chen, and J. Lu, “Finite-time distributed tracking control for multi-agent systems with a virtual leader,”
*IEEE Transactions on Circuits and Systems I: Regular Papers*, vol. 60, no. 2, pp. 352–362, 2013. View at: Publisher Site | Google Scholar | MathSciNet - Y. Lou and Y. Hong, “Target containment control of multi-agent systems with random switching interconnection topologies,”
*Automatica*, vol. 48, no. 5, pp. 879–885, 2012. View at: Publisher Site | Google Scholar | MathSciNet - Z. Li, Z. Duan, W. Ren, and G. Feng, “Containment control of linear multi-agent systems with multiple leaders of bounded inputs using distributed continuous controllers,”
*International Journal of Robust and Nonlinear Control*, 2014. View at: Publisher Site | Google Scholar - H. Liu, G. Xie, and L. Wang, “Containment of linear multi-agent systems under general interaction topologies,”
*Systems and Control Letters*, vol. 61, no. 4, pp. 528–534, 2012. View at: Publisher Site | Google Scholar | Zentralblatt MATH - J. Li, W. Ren, and S. Xu, “Distributed containment control with multiple dynamic leaders for double-integrator dynamics using only position measurements,”
*IEEE Transactions on Automatic Control*, vol. 57, no. 6, pp. 1553–1559, 2012. View at: Publisher Site | Google Scholar | MathSciNet - Z. Meng, W. Ren, and Z. You, “Distributed finite-time attitude containment control for multiple rigid bodies,”
*Automatica*, vol. 46, no. 12, pp. 2092–2099, 2010. View at: Publisher Site | Google Scholar | MathSciNet - H. Liu, G. Xie, and L. Wang, “Necessary and sufficient conditions for containment control of networked multi-agent systems,”
*Automatica*, vol. 48, no. 7, pp. 1415–1422, 2012. View at: Publisher Site | Google Scholar | MathSciNet - J. Mei, W. Ren, and G. Ma, “Distributed containment control for Lagrangian networks with parametric uncertainties under a directed graph,”
*Automatica*, vol. 48, no. 4, pp. 653–659, 2012. View at: Publisher Site | Google Scholar | MathSciNet - Y. Cao, W. Ren, and M. Egerstedt, “Distributed containment control with multiple stationary or dynamic leaders in fixed and switching directed networks,”
*Automatica*, vol. 48, no. 8, pp. 1586–1597, 2012. View at: Publisher Site | Google Scholar | MathSciNet - P. Wang and Y. Jia, “Distributed containment control of second-order multi-agent systems with inherent non-linear dynamics,”
*IET Control Theory & Applications*, vol. 8, no. 4, pp. 277–287, 2014. View at: Google Scholar - K. Liu, G. Xie, W. Ren, and L. Wang, “Consensus for multi-agent systems with inherent nonlinear dynamics under directed topologies,”
*Systems and Control Letters*, vol. 62, no. 2, pp. 152–162, 2013. View at: Publisher Site | Google Scholar | Zentralblatt MATH - W. Yu, G. Chen, and M. Cao, “Consensus in directed networks of agents with nonlinear dynamics,”
*IEEE Transactions on Automatic Control*, vol. 56, no. 6, pp. 1436–1441, 2011. View at: Publisher Site | Google Scholar | MathSciNet - Z. Liu, H. Zhou, Z. Guan, W. Hu, L. Ding, and W. Wang, “Distributed impulsive consensus of the multiagent system without velocity measurement,”
*Abstract and Applied Analysis*, vol. 2013, Article ID 825307, 8 pages, 2013. View at: Publisher Site | Google Scholar | MathSciNet - J. Lu, J. Kurths, J. Cao, N. Mahdavi, and C. Huang, “Synchronization control for nonlinear stochastic dynamical networks: pinning impulsive strategy,”
*IEEE Transactions on Neural Networks and Learning Systems*, vol. 23, no. 2, pp. 285–292, 2012. View at: Publisher Site | Google Scholar - Z. Guan, D. J. Hill, and X. Shen, “On hybrid impulsive and switching systems and application to nonlinear control,”
*IEEE Transactions on Automatic Control*, vol. 50, no. 7, pp. 1058–1062, 2005. View at: Publisher Site | Google Scholar | MathSciNet - Z.-W. Liu, Z.-H. Guan, X. Shen, and G. Feng, “Consensus of multi-agent networks with aperiodic sampled communication via impulsive algorithms using position-only measurements,”
*Institute of Electrical and Electronics Engineers*, vol. 57, no. 10, pp. 2639–2643, 2012. View at: Publisher Site | Google Scholar | MathSciNet - Z.-H. Guan, Z.-W. Liu, G. Feng, and Y.-W. Wang, “Synchronization of complex dynamical networks with time-varying delays via impulsive distributed control,”
*IEEE Transactions on Circuits and Systems I: Regular Papers*, vol. 57, no. 8, pp. 2182–2195, 2010. View at: Publisher Site | Google Scholar - G. Wen, Z. Duan, W. Yu, and G. Chen, “Consensus of second-order multi-agent systems with delayed nonlinear dynamics and intermittent communications,”
*International Journal of Control*, vol. 86, no. 2, pp. 322–331, 2013. View at: Publisher Site | Google Scholar | MathSciNet - R. T. Rockafellar,
*Convex Analysis*, vol. 28 of*Princeton Mathematical Series*, Princeton University Press, Princeton, NJ, USA, 1997. View at: MathSciNet

#### Copyright

Copyright © 2015 Wenshan Hu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.