## Complex Discrete Dynamics and Its Structures in Bioinspired Systems

View this Special IssueResearch Article | Open Access

# Decentralized Discrete-Time Formation Control for Multirobot Systems

**Academic Editor:**Gualberto Solís-Perales

#### Abstract

Inspired from the collective behavior of biological entities for the group motion coordination, this paper analyzes the formation control of mobile robots in discrete time where each robot can sense only the position of certain team members and the group behavior is achieved through the local interactions of robots. The main contribution is an original formal proof about the global convergence to the formation pattern represented by an arbitrary Formation Graph using attractive potential functions. The analysis is addressed for the case of omnidirectional robots with numerical simulations.

#### 1. Introduction

In the last years, the control community has a special interest in the study of the coordination of multiple mobile robots [1]. This idea originated in the observation and simulation of the collective behavior of some biological entities, like ants, fishes, or birds, where they achieve complex group behaviors trough some network communication channels and an ordered motion coordination. Therefore, research areas as Multi-Agent Systems, sensor networks, and distributed control systems assume that the modeling and implementations of these natural behaviors could solve the coordination of mobile robots in industrial and service applications [2].

According to [3], when a group of animals work together, they combine their local sensors to maximize the detection range to find food or to alert the presence of predators more efficiently. So, the collective behavior is induced by survival intentions and the group behavior exhibits a complex self-organization constructed by the local interactions of the team members. The literature of small robots that reproduce the behavior of small collective animals is commonly named as *swarms robots* and there exist a wide range of approaches related to self-organization, fault tolerance and repairs, and so forth [4]. Another field of study is about the motion coordination found in some species of birds. In [5], Reynolds proposed that the mobile agents, referred to as *boids*, have a common leader (role assignment), and each agent has a local strategy based on three components: separation, alignment, and cohesion to maintain the formation during the flight. It is proposed that the movement rules must be decentralized, reactive for the collision avoidance and the eventual appearance of different roles in the group. The natural behavior of biological entities, as those studied by Reynolds, has inspired the motion coordination of mobile robots, for instance [6–8]. Finally, another cooperative control strategy deals with the reproduction of complex behaviors observed in herd of animals which more intentional than being innate or reactive to survival, for instance, the prey-hunter behavior, hierarchical social organization, group searching and rescue tasks, and else. These high level behaviors maximize the individual capacities and have been implemented in robot soccer competitions, military operations, robotic-based vigilance, manufacturing systems, and so forth, where the game theory, artificial intelligence, ethology, and discrete-event systems have some important contributions [9].

This paper is related to a motion coordination problem, named Formation control, where the robots converge to some static formation patterns [10]. Following the principles of motion coordination of the nature, all the robots must be formed obeying a local control law based on the partial knowledge about the position of certain team members measure of their local sensors. Formation control is a basic problem of robot coordination because it is contained in the majority of the tasks of multirobot systems, where the agents must occupy strategic postures or displacements within a workspace [10]. For example, in vigilance and exploration tasks, the robots are moved in a specific formation to maximize their detection capacities and eventually change the formation if an agent is broken down [3]. In searching and rescue operations, the robots share the information captured by each robot and eventually they are regrouped in formation patterns [11]. Finally, in the case of manipulation of large objects, the robots must conserve a rigid formation to carry out the workpiece [1, 12].

The formation control strategies based in biological systems can be classified in two schemes. The first proposes reactive schemes that includes the majority of the *swarms intelligence*, where the robots are formed following simple reactive behavior rules, as maintaining a distance between neighbors without a specific position within the formation. The second scheme is based in a prescribed topology of interrobot communication, commonly represented by a Formation Graph (FG) [13, 14], where each node is related to the position of an agent and the edges represented the possible communication (bidirectional or unidirectional channel) between pair of robots. A well-defined FG must be connected; that is, there are no isolated nodes, and for every edge is associated a relative vector of desired position between robots [9].

This FG-based scheme can provide specific postures of robots in the formation and the facility to analyze eventual changes of formation and leader roles, intermittent and delayed communication, and other dynamic behaviors [15, 16]. The majority of the approaches are analyzed for the case of continuous time, where commonly the analysis is reduced to some special topologies of FG identified as the most representatives of the collective behavior of biological systems. For instance, the complete FG [17], where there exists bidirectional communication in any pair of robots, cyclic pursuit formation [8], the start-like formation centered on a leader [18], or the open-chain or convoy configuration [19]. Few works address the general case of undirected FG [20], and more recently, in our previous work [21], we present a formal proof about the convergence for all kinds of FG with attractive potential functions.

On the other hand, the discrete-time formation control has been primarily studied by some consensus algorithms [22] that conceptually differ from formation control due to the incorporation of the relative position vectors, which could cause a formation infeasibility due to the disappearance of equilibria, and the interrobot collisions in physical implementations. Other works as [23] address the case of flocking behavior in discrete-time only. Recently, [24] analyzes the global convergence in discrete-time for two topologies of FG only and its extension to unicycle-type robots. Then, inspired from our previous work [21], this paper extends the analysis of formation convergence in continuous time using potential functions to the case of an arbitrary well-defined FG in discrete time. The analysis is focused on the case of omnidirectional robots or point robots in the plane. The main contribution is an original formal proof about the convergence of robots to multiple equilibria where the robots are placed in the desired formation. The collision avoidance is not included in the analysis following the practical assumptions of [8, 25, 26] where reactive routines appear momentarily if the robots detect a shock danger or if the initial postures of robots generated free-collision trajectories, which occur frequently in the nature behaviors.

The rest of the paper is organized as follows. Section 2 introduces the kinematic models and the main concepts of FG. The discrete-time formation control and the analysis of the global convergence are presented in Section 3. Some numerical simulations are given in Section 4. Finally, some concluding remarks are given in Section 5.

#### 2. Problem Statement and Formation Graphs

##### 2.1. Kinematic Models and Problem Statement

Denote by a set of agents moving in plane with positions , . The kinematic model of each agent or robot is described by where is the velocity of th robot along the - and -axes. Using the Euler-based discretization, the approximated model of (1) now is given by where is the sampling and . For a more compact notation, in the rest of the paper, we denote and , respectively, then

Let , , denote the subset of positions of the agents which are detectable for . Let , for all denote a time-invariant vector which represents the desired position of with respect to in a particular formation. Thus, we define the desired relative position of every in the formation by where is the cardinality of . Thus, the desired relative position of can be considered as a combination of the desired positions of with respect to the positions of all elements of .

*Problem Statement*. The control objective is to design a control law for every robot , such that .

##### 2.2. Formation Graphs

According to [14, 20, 27], the desired formations of an agents’ group can be represented by a Formation Graph (FG) defined by:

*Definition 1. *A Formation Graph is a triplet that consists in a set of vertices related to the team members, a set of edges , containing pairs of nodes that represent interagent communications, therefore if and only if , and a set of vectors , for all that specify the desired relative position between agents and , that is, , for all , in a desired formation pattern.

If , the the vertices and are called *adjacent*. The degree of the th vertex is defined as the number of its adjacent vertices. A path from vertex to is a sequence of distinct vertices starting with and ending with such that consecutive vertices are adjacent. The underlying graph of a FG, is the graph where for all , is added a new edge , if it does not appear on the original FG. The underlying graph is always an undirected graph. If there is a path between any two vertices of the underlying graph of FG, then the FG is said to be *connected*. Thus, a FG is said to be well defined if it satisfied the following conditions: the graph is connected, there are no conflicts in the desired vectors of positions, in the sense that if , then , and the desired vectors of positions establish a closed-formation, that is, if there exist the vectors , then they must satisfy
The previous condition establishes that some position vectors form closed-polygons. Figure 1 shows an example of the formation of four robots with their detectable subsets and the FG, including the closed formation conditions of vectors .

The matrix of a FG that captures the topological properties of the graph is called the *Laplacian matrix* and it is defined in what follows.

*Definition 2. * The Laplacian matrix of a Formation Graph is the matrix , where , where is the degree of the vertex and is called the Adjacency matrix with elements

For a connected FG, the Laplacian matrix has a single zero eigenvalue and the corresponding eigenvector is the vector [20]. Figure 1 shows an example of the Laplacian matrix of a FG. Note that, in general , .

Finally, a FG is said to be *directed* if for all , then (or but ), that is, the communication between pair of agents is one-way, *undirected* if then for all (or and ) and the communication between each pair of agents is a bidirectional channel, and *mixed* otherwise. For the case of undirected FG, the Laplacian is always a symmetric semidefinite matrix [20]. Note that Figure 1 presents a mixed FG.

For completeness of the paper, we introduce the next matrix operation [20].

*Definition 3 (Kronecker product). *Let with elements and let , then, the Kronecker product of and (denoted by ) is given by

The Kronecker product allows a more compact notation for systems’ equations.

#### 3. Formation ControL Strategy

For system (3), local Attractive Potential Functions (APFs) are defined by

The functions are always positives and reach their minimum () when , . Then, a discrete-time control law based only on APFs is defined as where is a gain parameter.

Theorem 4. * Consider the system (3) and the control law (9). Suppose that and the desired formation is based on a well-defined FG. Then, in the closed-loop system, formed by (3) and control law (9), the agents converge exponentially to the desired formation pattern, that is, , . *

The proof requires some preliminary lemmas.

Lemma 5. * Let , if around every principal diagonal element one draws a circle with radius given by the sum of the absolute values of the other elements on the same row, that is, , then every eigenvalue of lies in one of these circles, known as Gershgorin circles [28]. *

Lemma 6. *If the matrix has eigenvalues , where , , then discrete-time linear system is asymptotically stable [29]. *

*Proof of Theorem 4. *The closed-loop system, formed by (3) and the control law (9), the discrete-time dynamics of each coordinate , is given by
and the dynamics of all coordinates in matrix form are given by
where , is the Laplacian matrix of the FG, denotes the Kronecker product, is the identity, and

The matrix forces the multiplication of the th row of the Laplacian matrix and vector by the vertex degree . Define the formation errors as

Note that . The dynamics of the formation errors are given by

Substituting and for the case of time-invariant vectors of position, then
and written in matrix form,
where and is a matrix with elements

Using Lemma 5, from the linear system (16), it is possible to draw circles where the center of every circle is with radio equal to . Therefore if all the eigenvalues of matrix remains within the unitarian circle, and therefore by Lemma 6, the system is asymptotically stable and the formation errors converge exponentially to zero.

Note that the convergence of the formation errors is translated into the stability of the equilibrium point , which do not prove directly the convergence of the robots to the desired formation, due to possibility of solutions that could appear in these equilibrium point. Analyzing this, the system equations of the errors given in (13) can be expressed in matrix form as
where and . When the formation errors have converged to zero, then it is satisfied that
by the properties of the Kronecker [29]

Thus, the solution of can be decomposed in , the homogeneous and a particular solution, respectively. As mentioned before, for a connected FG, the Laplacian matrix has a single zero eigenvalue and the corresponding eigenvector is the vector ; this means that all the rows of the Laplacian matriz sum zero. Therefore, the homogeneous solution is given by , . Then it is possible to reduce the last row of the Laplacian matrix in (20) through the premultiplication of an appropriated matrix; that is,
where
generating the next reduced general equation
where is the submatrix form with the first rows and columns from , and is the last column from with just the rows. Note that there exist an infinity number of equilibrium points since which is the closed-formation condition given by (5) of a FG, where all the sums of all relative position vectors of the connected FG sum zero. The solution to (23) is
with being the absolute position of last robot. On the other hand the desired position from the first robots (4), can be expressed in a matrix form as
where . Substituting (24) in (25) we obtain
this means that the formation is preserved even though there are an infinite number of equilibria. We can interpret (24) as the position of the first robots relative to the position of the robot.

#### 4. Numerical Simulations

Figure 2 shows a numerical simulation of the closed-loop system (3)–(9) for , , and . The interrobot communication is a mixed FG given in the Figure 2(a) where the adjacent subsets , the desired positions and the vectors of relative position that establish a rhombus shape centered in are illustrated. The initial position of the robots is , , , , and . Note that robots converge to the desired formation in the plane (Figure 2(b)). It is proved by the convergence of the formation errors showing in the Figure 2(c).

**(a) Formation Graph**

**(b) Trajectories of the robots**

**(c) Error coordinates**

To compare the previous simulation, Figure 3 shows a different simulation with a different FG but with the same , , and the initial positions of the robots as of the previous simulation. Now, the communication links of the FG of the Figure 3(a) have changed to the case of an undirected or bidirectional cyclic pursuit. Observe that the robots converge to the formation and the formation errors converge to zero too, but performing different trajectories in the plane. So, the addition or subtraction of communication links to the same formation pattern modifies the dynamics of the agents and the convergence time of the formation errors.

**(a) Formation Graph**

**(b) Trajectories of the robots**

**(c) Error coordinates**

Note that the performance of the control actions improves as the sampling period decreases to small values, due to the Euler’s discretization and the control strategy based on attractive potential functions with a simple constant gain. Note that the value used in both simulations ensures a well performance, that is more than enough for real implementation in robots.

#### 5. Conclusions

This paper deals the case of discrete-time formation control for the case of omnidirectional robots. The main contribution is a formal proof about the global convergence of the robots to the desired formation pattern, showing the stability of multiple equilibrium points when the formation errors converge to zero. The approach is based on the coordination of biological entities were the motion coordination is defined by the local communication between robots and the available information is the position of some robots measures by local sensors. In further researches, the collision avoidance, the flocking behavior with group path-following, and the extension for the case of nonlinear models, like unicycle-type robots, will be addressed.

#### Acknowledgments

The authors acknowledge financial support from UIA, Mexico, and the closely academic collaboration with the Mechatronics Section from CINVESTAV-IPN, Mexico.

#### References

- Y. U. Cao, A. S. Fukunaga, and A. B. Kahng, “Cooperative mobile robotics: antecedents and directions,”
*Autonomous Robots*, vol. 4, no. 1, pp. 7–27, 1997. View at: Google Scholar - T. Arai, E. Pagello, and L. E. Parker, “Guest editorial advances in multirobot systems,”
*IEEE Transactions on Robotics and Automation*, vol. 18, no. 5, pp. 655–661, 2002. View at: Google Scholar - T. Balch and R. C. Arkin, “Behavior-based formation control for multirobot teams,”
*IEEE Transactions on Robotics and Automation*, vol. 14, no. 6, pp. 926–939, 1998. View at: Google Scholar - W. M. Spears, D. F. Spears, J. C. Hamann, and R. Heil, “Distributed, physics-based control of swarms of vehicles,”
*Autonomous Robots*, vol. 17, no. 2-3, pp. 137–162, 2004. View at: Publisher Site | Google Scholar - C. W. Reynolds, “Flocks, birds and schools: a distributed behavioral model,”
*Computer Graphics*, vol. 21, no. 4, pp. 25–34, 1987. View at: Google Scholar - H. Ando, Y. Oasa, I. Suzuki, and M. Yamashita, “Distributed memoryless point convergence algorithm for mobile robots with limited visibility,”
*IEEE Transactions on Robotics and Automation*, vol. 15, no. 5, pp. 818–828, 1999. View at: Publisher Site | Google Scholar - R. Olfati-Saber and R. M. Murray, “Distributed cooperative control of multiple vehicle formations using structural potential functions,” in
*Proceedings of the 15th IFAC World Congress*, pp. 2864–2869, 2002. View at: Google Scholar - B. Francis, M. Broucke, and Z. Lin, “Local control strategies for groups of mobile autonomous agents,”
*IEEE Transactions on Automatic Control*, vol. 49, no. 4, pp. 622–629, 2004. View at: Publisher Site | Google Scholar | MathSciNet - E. G. Hernandez-Martinez and E. Aranda-Bricaire, “Convergence and collision avoidance in formation control: a survey of the artificial potential functions approach,” in
*Multi-Agent Systems—Modeling, Control, Programming, Simulations and Application*, F. Alkhateeb, E. A. Maghayreh, and I. A. Doush, Eds., pp. 103–126, InTech, Rijeka, Croatia, 2011. View at: Google Scholar - Y. Q. Chen and Z. Wang, “Formation control: a review and a new consideration,” in
*Proceedings of the International Conference on Intelligent Robots and Systems*, pp. 3181–3186, 2005. View at: Google Scholar - H. Yamaguchi, “A distributed motion coordination strategy for multiple nonholonomic mobile robots in cooperative hunting operations,”
*Robotics and Autonomous Systems*, vol. 43, no. 4, pp. 257–282, 2003. View at: Publisher Site | Google Scholar - Y. Asahiro, H. Asama, I. Suzuki, and M. Yamashita, “Improvement of distributed control algorithms for robots carrying an object,” in
*Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics*, pp. 608–613, October 1999. View at: Google Scholar - J. A. Fax and R. M. Murray, “Information flow and cooperative control of vehicle formations,”
*IEEE Transactions on Automatic Control*, vol. 49, no. 9, pp. 1465–1476, 2004. View at: Publisher Site | Google Scholar | MathSciNet - J. P. Desai, “A graph theoretic approach for modeling mobile robot team formations,”
*Journal of Robotic Systems*, vol. 19, no. 11, pp. 511–525, 2002. View at: Publisher Site | Google Scholar - J. P. Desai, J. P. Ostrowski, and V. Kumar, “Modeling and control of formations of nonholonomic mobile robots,”
*IEEE Transactions on Robotics and Automation*, vol. 17, no. 6, pp. 905–908, 2001. View at: Publisher Site | Google Scholar - W. Wang and J. Slotine, “A theoretical study of different leader roles in networks,”
*IEEE Transactions on Automatic Control*, vol. 51, no. 7, pp. 1156–1161, 2006. View at: Publisher Site | Google Scholar | MathSciNet - E. G. Hernández-Martínez and E. Aranda-Bricaire, “Non-collision conditions in multi-agent robots formation using local potential functions,” in
*Proceedings of the IEEE International Conference on Robotics and Automation (ICRA'08)*, pp. 3776–3781, Pasadena, Calif, USA, May 2008. View at: Publisher Site | Google Scholar - E. G. Hernandez-Martinez and E. Aranda-Bricaire, “Non-collision conditions in formation control using a virtual leader strategy,” in
*Proceedings of the 13th Congreso Latinoamericano de Control Automatico*, pp. 798–803, 2008. View at: Google Scholar - F. Belkhouche and B. Belkhouche, “Modeling and controlling a robotic convoy using guidance laws strategies,”
*IEEE Transactions on Systems, Man, and Cybernetics B*, vol. 35, no. 4, pp. 813–825, 2005. View at: Publisher Site | Google Scholar - D. V. Dimarogonas and K. J. Kyriakopoulos, “Distributed cooperative control and collision avoidance for multiple kinematic agents,” in
*Proceedings of the 45th IEEE Conference on Decision and Control (CDC'06)*, pp. 721–726, San Diego, Calif, USA, December 2006. View at: Publisher Site | Google Scholar - E. G. Hernandez-Martinez and E. Aranda-Bricaire, “Decentralized formation control of multi-agent robots systems based on formation graphs,”
*IET Studies in Informatics and Control*, vol. 21, no. 1, pp. 7–16, 2012. View at: Google Scholar - W. Ren and R. W. Beard,
*Distributed Consensus in Multi-Vehicle Cooperative Control: Theory and Applications*, Springer, New York, NY, USA, 2008. - S. Glavaski, A. Williams, and T. Samad, “Connectivity and convergence of formations,” in
*Cooperative Control of Distributed Multi-Agent Systems*, J. S. Shamma, Ed., pp. 43–61, John Wiley & Sons, New York, NY, USA, 2007. View at: Google Scholar - D. E. Hernandez-Mendoza, G. R. Penaloza-Mendoza, and E. Aranda-Bricaire, “Discrete-time formation and marching control of multi-agent robots systems,” in
*Proceedings of the 8th International Conference on Electrical Engineering Computing Science and Automatic Control (CCE'11)*, pp. 1–6, Merida City, Mexico, October 2011. View at: Publisher Site | Google Scholar - J. Antich and A. Ortiz, “Extending the potential fields approach to avoid trapping situations,” in
*Proceedings of the IEEE IRS/RSJ International Conference on Intelligent Robots and Systems (IROS'05)*, pp. 1386–1391, August 2005. View at: Publisher Site | Google Scholar - E. G. Hernandez-Martinez and E. Aranda-Bricaire, “Non-collision conditions in multi-agent virtual leader-based formation control,”
*International Journal of Advanced Robotic Systems*, vol. 9, no. 1, pp. 1–10, 2012. View at: Google Scholar - A. Muhammad and M. Egerstedt, “Connectivity graphs as models of local interactions,” in
*Proceedings of the 43rd IEEE Conference on Decision and Control (CDC'04)*, vol. 1, pp. 124–129, December 2004. View at: Publisher Site | Google Scholar - H. E. Bell, “Gershgorin's theorem and the zeros of polynomials,”
*The American Mathematical Monthly*, vol. 72, pp. 292–295, 1965. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - D. S. Bernstein,
*Matrix Mathematics: Theory, Facts, and Formulas with Applications to Linear Systems Theory*, Princeton University Press, Princeton, NJ, USA, 2005. View at: MathSciNet

#### Copyright

Copyright © 2013 E. G. Hernandez-Martinez et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.