## Cooperative Control and Its Engineering Applications in Power Systems

View this Special IssueResearch Article | Open Access

# Consensus Tracking for Multiagent Systems with Nonlinear Dynamics

**Academic Editor:**Wenwu Yu

#### Abstract

This paper concerns the problem of consensus tracking for multiagent systems with a dynamical leader. In particular, it proposes the corresponding explicit control laws for multiple first-order nonlinear systems, second-order nonlinear systems, and quite general nonlinear systems based on the leader-follower and the tree shaped network topologies. Several numerical simulations are given to verify the theoretical results.

#### 1. Introduction

There have been a lot of recent researches paying attention to the problem of multiagent cooperative control which means a group of agents working cooperatively to achieve coverage, formation, and consensus [1â€“5]. The consensus problem, known as agreement on certain quantities of interest for groups of agents, is one of the major research directions. Consensus tracking means consensus with a dynamical leader [6, 7]. It is considered as a manner of cooperative behaviors and has also drawn far more attention.

In the pioneering work on consensus tracking of Ren [8], consensus with a constant reference state and with a time-varying reference state is analyzed for the first-order integrator systems. However, even in the second case, the dynamics of the time-varying reference state is assumed to have no explicit external input. Later, many variants of the consensus tracking algorithms are developed for various system models. In [9], a control algorithm is proposed for the problems of consensus tracking while those homogenous follower agents are with dynamics of first-order linear integrator and the leader is governed by the different dynamics. In [10], a consensus tracking algorithm is proposed and analyzed for the second-order integrator dynamics which is also a linear system model. And in [6], the author designs several consensus tracking algorithms for the agents with first-order (and second-order) integrator dynamics. We note that both the follower agents and the leader are with linear dynamics, and the leader has an upper bounded external input.

Li et al. [11] propose an observer-based algorithm for the problem of consensus tracking for multiagent systems with general linear dynamics. In the recent literature [12], the problem of multiple first-order nonlinear systems tracking several leaders is studied under the assumption that these leaders have no explicit external input. In [13], the consensus tracking problem is studied for the case that the dynamics of both the leader and the followers are of the second-order nonlinearity, under the assumption that the leader has no external input.

Nonlinear dynamics are now studied in the consensus problem from various perspectives such as [14â€“17]. In [16, 17], the effective consensus tracking laws are developed for multiagent systems modeled as higher-order dynamics with nonlinear terms under switching directed topologies. By contrast, this paper discusses the consensus tracking problem for multiagent systems with general nonlinear systems and the very special cases (the first-order and the second-order nonlinear systems) under tree topologies. The network of groups of nonlinear systems is a kind of coupled nonlinear systems with linear coupling (linearly coupled ordinary differential equations) [18] which is widely used in nature and engineering to describe the models of spike-burst neural activity, the transitions of -patch metapopulation, the dynamics of linearly coupled Chua circuits [13, 18], the coupled oscillator systems [19], epidemiology, ecology [20], and so on.

In those papers mentioned above, some focus on the problem that the linear follower agents track a leader who is governed by an external input, yet others focus on the problem that the nonlinear follower agents track a leader who has no explicit external input. In the practical network with a linear or a nonlinear leader, the external input is unavoidable or even is important for guiding the group to behave correctly. Thus, the study of consensus tracking for a group of nonlinear agents with the leader having an external input will be significative. In this paper, we consider the problem of consensus tracking for the network of a group of identical nonlinear agents, in which one agent indexed by and governed by its external input is assigned to be the leader, and the other agents indexed by are regarded as the followers. The nonlinear dynamics of agents in this paper are described by the first-order (resp., the second-order and the general) nonlinear equations like (1) in [12] (resp., (3) in [21] and (1) in [22]) which will be introduced later.

We have noted that the intrinsic dynamics of the leader in [12] which is specified by have no explicit external input, where is the state of the leader, is the nonlinear vector field, and is the time. However, it can be interpreted as the fact that each follower has known the detailed measurements of the leaderâ€™s external input all the time and the consensus algorithm for the follower could cancel out the impact of the leaderâ€™s external input. Though the equation is theoretically capable of including the situation of , the given Lipschitz condition for the in [12] will limit the choice of the control input or sometimes there will even be no choice. However, in this paper, we relax this condition and assume that each follower only knows the upper bound of the leaderâ€™s input in advance and there are no other limitations. There is a similar situation in [21].

Due to the existence of nonlinearity in the agentsâ€™ dynamics and the external input of the leader, the existing consensus algorithms are not applicable to our problem. By synthetically using the Lipschitz conditions, the variable structure technique [6], the feedback linearization technique [22], and the Lyapunov theory, all three control algorithms for consensus tracking under the undirect or the tree shaped communication topology are effectively designed.

The remainder of the paper is organized as follows. In Section 2, some notations and basic concepts in graph theory that will be used in this paper are introduced. Section 3 is the main text that establishes the consensus tracking algorithms for nonlinear systems. Section 4 shows several simulation results. Finaly, Section 5 draws conclusions to this paper.

#### 2. Background and Preliminaries

We use to denote the Euclidean norm and 1-norm. Let , denote column vectors with all components being ones and zeros, respectively. is used to denote the identity matrix. And stands for the kronecker product. A function is said to be of class if the derivatives exist and are continuous. The superscript means the transpose of a matrix. For a matrix , denotes that is positive definite.

Since graph theory plays an important role in modeling the communication topology of the network of the multiagent systems, some basic concepts in graph theory that will be used in this paper are introduced in the following.

In the problem of nonlinear consensus tracking, a kind of communication topology of follower agents is modeled as an undirected graph , where is a set of integers, with the number which means the th vertex representing the th agent, and is an edge set in which each edge is denoted by a pair of vertices . In an undirected graph, is equivalent to . The set of neighbors of agent is denoted by . is a weighted adjacency matrix of , where and if or 0 otherwise. The Laplacian of is defined as , where and [23]. A path in an undirected graph is a sequence of edges in the form of â€‰, where . An undirected graph is connected if there exists a path between every two vertices.

For a directed graph, does not necessarily mean . A directed path is a sequence of directed edges in the form of , where . The tree shaped communication topology is modeled as the tree shaped graph (a directed graph) in which each vertex has only one parent vertex except for one vertex called the root. To study the problem of nonlinear consensus tracking, a leader adjacency matrix is defined as , where if the leaderâ€™s information is available to the th follower agent and otherwise. The undirect graph with one additional vertex representing a leader is used to model the leader-follower communication topologies in this paper.

#### 3. Nonlinear Consensus Tracking

##### 3.1. Consensus Tracking for the First-Order Nonlinear Dynamics

We start by considering the first-order nonlinearity case: followers labeled as are described by the following first-order nonlinear ordinary differential equation: where is the state vector representing the position of agent , is a uniformly continuously differentiable vector-valued function, and is the control input. The communication topology of these followers is modeled as an undirected graph . The corresponding Laplacian matrix and adjacency matrix are denoted by and . We aim to design a control algorithm , , such that where is the state vector representing the position of the leader which is specified by Note that is the external input of the leader and . If the limit (2) is finally achieved, then we say that the first-order nonlinear followers (1) with the control algorithm asymptotically track the leader (3).

As in most existing works on networks of nonlinear agents [12, 13, 21, 24], we give an assumption of Lipschitz-like condition as follows.

*Assumption 1. *There exists such that the vector field satisfies , for all , .

In order to guarantee these followers could track the leader, the necessary connectivity is required from the point of view of graph theory. For this, we further make the following assumption.

*Assumption 2. *The undirected graph which models the network topology of followers is connected and at least one follower is informed about the state of the leader.

To deal with the problem of consensus tracking for the network with the first-order nonlinear agents, we propose a control algorithm for (1) as where is the adaptive gain [13] for agent and it is specified by where is the signum function, , is any positive constant, and is used for describing whether agent is informed about the state of the leader, as we introduced in Section 2, and we denote that . The column stack vectors of and are denoted by and , respectively. By applying the control algorithms (4) and (5) into the input of the system (1), the closed-loop system is then rewritten as follows: where .

Then, the main result on the problem of consensus tracking for the network with first-order nonlinear agents is proposed by the following theorem.

Theorem 3. *If Assumptions 1 and 2 are satisfied, then the first-order nonlinear followers (1) with the control algorithms (4) and (5) asymptotically track the leader (3).*

*Proof. *Let and . Then, we have

From Assumption 2 and Lemmaâ€‰â€‰1 in [13], the matrix is positive definite. Consider a Lyapunov function candidate
where is chosen such that
The derivative of along the system (7) satisfies
From (9) and , it is easy to obtain that . Therefore, as . It follows that . That is, the first-order nonlinear followers (1) track the leader (3) asymptotically.

##### 3.2. Consensus Tracking for the Second-Order Nonlinear Dynamics

Next, we discuss the second-order nonlinearity case. Suppose that each of the followers is described by where, , and are the state representing the position and the velocity of agent , respectively. is the intrinsic dynamics. is the control input. The problem is to design for each of the followers to track the leader which is specified by such that, for each agent , where and are, respectively, the position and velocity of the leader. If limits (13) are finally achieved, then we say that the second-order nonlinear followers (11) with the designed control algorithm asymptotically track the leader (12). Before studying this problem, we give some assumptions.

*Assumption 4. *There exist and such that the vector field satisfies , for all .

*Remark 5. *Compared with Assumption 1, it is easy to see that both of the assumptions are Lipschitz-like conditions.

Similar to the first-order case in Section 3.1, we give the same assumption on communication topology of the network as Assumption 2 to guarantee these followers with dynamics of (11) could track the leader with dynamics of (12). And here also represents the communication topology of the network, where and are the same as in Section 3.1.

Then, we propose the following control algorithm applied for the system (11): where is a constant gain, is a positive constant which is to be designed, and is a constant that satisfies . Before going any further, we define two matrices and associated with . For a matrix (let be the maximal eigenvalue of the and the constants , and , , and are defined by Then, we have the following lemma.

Lemma 6. *Given the matrix and the constants , , for any constant , if satisfies
**
or
**
then and , where
*

*Proof. *Since is a positive definite matrix, it can be diagonalized as , where and . We define that
It then follows that
Let be any eigenvalue of the matrix . Since is a diagonal matrix and is symmetric, it follows that is real and satisfies
That is,
Note that if and only if
which means
By a similar analysis, we have
Let be any eigenvalue of the matrix . Then, one has
And if and only if
which means
or
In summary, if satisfies or , then both the matrix and the matrix are positive definite. Since and have the same eigenvalues as that of and , we have and when satisfies or .

Then, the main result follows.

Theorem 7. *Suppose that Assumptions 2 and 4 are satisfied; if and , where , are defined as in Lemma 6, then the second-order nonlinear followers (11) with the control algorithms (14) asymptotically track the leader (12).*

*Proof. *Let and . And let , . We rewrite the closed-loop system of (11) using the control algorithm (14) as
where
Consider a Lyapunov function candidate
From Lemma 6, one has . The derivative of along the system (30) is
For the vectors and the matrix , we define
From Cauchy-Schwarz inequality, one has
It follows that
From Lemma 6 that and , we have . Equivalently, it follows that as , , , which means , as . And then the second-order nonlinear followers (11) with the control algorithms (14) asymptotically track the leader (12).

*Remark 8. *In order to deal with the nonlinear term of the agentsâ€™ dynamics in Theorem 7, one key procedure is the definition of the inner product (34) and the application of Cauchy-Schwarz inequality.

*Remark 9. *The result in Theorem 7 for multiagent systems with and is also suitable for agents with dynamics evolved in higher-order dimension; that is, and .

##### 3.3. Consensus Tracking for the General Nonlinear Dynamics

In the general nonlinear case, suppose that a network system with followers represented by the following nonlinear equation: where is the state vector of the th follower and is the control input. And a leader is given by where and are, respectively, the state and the control input of the leader. The function will be with regard to and , and so is . We aim to give an explicit control law for each follower such that If the limit (39) is finally achieved, then we say that the general nonlinear followers (37) with the control algorithm asymptotically track the leader â€‰(38).

*Remark 10. *Note that the differential equation (37) can describe the models of many kinds of mechanical system such as nonholonomic system and underactuated system.

Throughout the subsequent analysis we assume that the network topology satisfies the following two assumptions.

*Assumption 11. *The graph of the network topology is tree shaped with the leader as the root node, where the tree shaped graph means each node has only one parent node except the root node.

*Assumption 12. *For the network system, each agent knows the measurement of the control input of its parent agent at the same time.

Assumption 12 illustrates that each agent is a cooperative partner with its neighbors. Due to the very general nonlinear dynamics and the goal of nonlinear consensus tracking, it is necessary for an agent to know the input of its parent agent. Motivated by the consensus analysis in [25], where the tool of incidence matrix is used to model the error system, we number the edges in the tree shaped graph according to the length of the path which is indirectly connected to the root node shown in Figure 4.

In order to propose the consensus tracking algorithm for agents (37), we make some preparation. The following analysis is based on the* propositionâ€‰â€‰**1* in [22]. For the tree shaped graph, each follower node in the form of (37) tracks the trajectory of its parent node in the form of (37) (or (38)), where both , and , are bounded. And we denote

Let be the state transition matrix of ; that is, satisfies with . Further, for a given constant , we define If there exists a constant such that is bounded away from singularity uniformly in , then define as follows:

If there exist two numbers and such that then, for any function , continuous and bounded, we propose the following linear time-varying feedback control law: Now we have the main result as follows.

Theorem 13. *If Assumptions 11 and 12 are satisfied, then the general nonlinear followers (37) with the control algorithms (44) asymptotically track the leader (38).*

*Proof. *Let
where and are the state and the input of agent and the agent is the parent agent of agent . For simplicity, we denote in the multiagent systems by , , like in Figure 4, where is the number of edges in the graph of the network topology, and . Similarly, let , where , , represent the matrix , ( represents the leader in the network), and each is described by (42). Consider a Lyapunov function candidate
Note that
In addition, one has
Since , , from the control algorithm (44) and the notation (45) and
we have
Then,
It follows that and , as . At the same time, is satisfied and the consensus tracking problem is solved.

*Remark 14. *For an undirected connected graph which contains a tree shaped subgraph, or a directed graph which contains a directed spanning tree, we can choose such a tree as Assumption 11 required. However, such a directed tree is unfavorable for implementing the distributed control since in such case each follower has to know the information of the global communication topology. So, it is worth discussing the general undirected (or directed) communication topologies and it will be a direction of the future research.

*Remark 15. *It has been shown that systems (1) and (11) are the special cases of system (37). However, the analysis for convergence of closed system is completely different. Though, in each case, the communication topologies are relatively simple.

#### 4. Simulation Results

In this section, three numerical simulation examples are given to illustrate the theoretical results. Consider the first example, a network of three followers with a leader shown in Figure 1. Assume that the dynamics of the follower agents with are described by the following equations: The control input of the leader is given by . Choose for and . Note that . The initial values of the error between the multiple followers and the leader, which is described by , , , are given as . Then the results of consensus tracking are shown in Figure 2, where and . Since as moves on, consensus tracking is finally achieved.

**(a)**

**(b)**

The second example is also given for the graph in Figure 1, which characterizes the communication channel among the three followers and a leader. The dynamics of each follower and the leader are specified by the following equations, respectively: Note that and , . Choose ; then it is easy to compute that Choose . Given the initial values as , , , , , and , the results of consensus tracking are shown in Figure 3.

Now let us see the third example. In the case of the general nonlinear dynamics, the graph of the network topology is shown in Figure 4.

We consider each agentâ€™s dynamics to be a simple nonholonomic system specified by the equations as follows: Assume that the trajectory and the control input of the leader are, respectively, described by and , where the superscript means the leader. Choose and . For the initial value of , , given by