Research Article | Open Access

Li Bing, Li Jie, Huang KeWei, "Modeling and Flocking Consensus Analysis for Large-Scale UAV Swarms", *Mathematical Problems in Engineering*, vol. 2013, Article ID 368369, 9 pages, 2013. https://doi.org/10.1155/2013/368369

# Modeling and Flocking Consensus Analysis for Large-Scale UAV Swarms

**Academic Editor:**J. A. Tenreiro Machado

#### Abstract

Recently, distributed coordination control of the unmanned aerial vehicle (UAV) swarms has been a particularly active topic in intelligent system field. In this paper, through understanding the emergent mechanism of the complex system, further research on the flocking and the dynamic characteristic of UAV swarms will be given. Firstly, this paper analyzes the current researches and existent problems of UAV swarms. Afterwards, by the theory of stochastic process and supplemented variables, a differential-integral model is established, converting the system model into Volterra integral equation. The existence and uniqueness of the solution of the system are discussed. Then the flocking control law is given based on artificial potential with system consensus. At last, we analyze the stability of the proposed flocking control algorithm based on the Lyapunov approach and prove that the system in a limited time can converge to the consensus direction of the velocity. Simulation results are provided to verify the conclusion.

#### 1. Introduction

UAV is an advanced system with high autonomy for intelligent combat [1]. In the future, UAVs will be used for complex tasks, such as surveillance, reconnaissance, and precision strike missions. Many organizations have foreseen that in the near future, swarms of UAVs will replace single ones for more complicated missions in more uncertain and possibly hostile environments [2]. Therefore, many researchers are studying groups of cooperative UAVs.

*(A) Related Work on the UAV Swarms Problem.* The new challenges imposed by UAV swarms have attracted many researchers. New control mechanisms, application domains, simulation models, and simulation tools have been developed to tackle issues in different aspects of the swarm. Currently, a completely new topic is opening up in the area of UAV swarms performing different missions cooperatively. [3], the method of evolutionary pinning control is applied to UAV swarms successfully. Path planning and routing are investigated in [4, 5], using multiobjective evolutionary algorithm. The path planning problem in three-dimensional environment without any obstacles is addressed in [6, 7] and with only static obstacles in [8]. [9], cooperative searching problem is discussed for the purpose of detecting moving and evading targets in a hazardous environment. A similar cooperative searching problem is also discussed in [10, 11]. Reference [12] investigates the automatic target recognition (ATR) problem in UAV control and proposes a distributed strategy for UAV swarms. Task allocation problem is discussed in [13–18] using different methodologies. Some applications of using a UAV swarm to search and destroy targets could be found in [19–22]. [23], a swarm simulator for target searching is implemented with Java. Garcia introduces a multi-UAVs simulator implemented with X-Plane—a commercial flight simulator [24]. Russell et al. present a parallel swarm simulation environment which utilizes an existing parallel emulation and simulation tool called SPEEDS [25]. MASON [26] is a general purpose multiagents simulation library utilized in our previous work, along with MATLAB based UAV simulator [27].

*(B) Related Work on the Consensus Flocking Problem*. Most research on formation of agent swarms uses distributed techniques by Reynolds’ seminal work on the mobility of flocks [28], which prescribes three fundamental operations for each robot to realize distributed flocking—separation, alignment, and cohesion [29, 30]. One of the earliest attempts to realize flocking through a set of basic behaviors including safe wandering, aggregation, dispersion, and homing to implement flocking is by Mataric [31]. Kelley and Keating realize flocking with robots based on leader-following behavior [32]. Hayes and Dormiani-Tabatabaei [33] propose a flocking algorithm based on two behaviors: collision avoidance and velocity-matching flock centering. Holland et al. [34] propose a flocking algorithm for UAV similar to Reynolds’. A host is used as an intermediate station for receiving each UAV’s range, bearing, and velocity and sending them to other UAVs to simulate the sensing process of one UAV for perceiving range, bearing, and heading of its neighbors. Ferrante et al. [35] introduce a new communication strategy called the information aware communication for alignment behavior. Recently, Stranieri et al. [36] perform flocking with a swarm of behaviorally heterogeneous mobile robots.

In this paper, we consider models for flocking swarms. Firstly, a mathematical model of cooperative system is established by using Markov stochastic process and calculus analysis. Then, the control law for UAV swarm is established based on artificial potential field. At last, we analyze the stability of the proposed flocking control algorithm based on the Lyapunov approach and prove the conclusion that the system in a limited time can converge to the consensus direction of the velocity. Simulation results are provided to verify the conclusion.

#### 2. The Model of the UAVs Swarms

##### 2.1. Differential Integral Model

Let denote the state of the UAV swarms at time ; identifies the state that UAV swarms are stable at time . The state of UAV at time is denoted by , in which the first element is the UAV’s position in the environment at time , and the second element is the UAV’s orientation. The UAV’s dynamics is subject to its physical curvature radius constraints, leading to the fact that it can only change its orientation by at most one step, which is described as go straight, go up, go down, turn left, turn upper left, turn lower left, turn right, turn upper right, and turn lower right.

In order to obtain Markov random process, the new state of process is derived by supplement of variable [37, 38], which is described as follows: where is the dwell time after state . So it is easy to verify that is a broad Markov random process.

The probability of state transition after can be obtained using total probability theorem: According to (2) we can get the all probability: where is the average sustained rate of each state and is the average repair rate at state . Similarly, the expression of state transition rate for can be derivated.

Differentiate the expression for state transition probability to derive its limit. Then the mathematical model can be described using integral-differential equations as follows: The boundary and initial conditions are

Theorem 1. *The reliability of coordination system has uniqueness and nonnegative solution on .*

*Proof. *According to the initial conditions we can get the analytic solution of the partial differential equation [39, 40].

Set
where
where ,.

So we can get the following equation:
Assuming

then, the solution of the system can be converted into vectors format as follows:

Any component of and vector is nonnegative. The functions and ,are limitary on the domain . The solution of integral equation is unique and nonnegative on . So the reliability of coordination system has unique and nonnegative solution on .

##### 2.2. Probabilistic Analysis Based on State Transformation

The behavior evolution of the UAV swarm system is a limited Markov decision process. Suppose that the probability distribution of the system state isat time . Then at time , the probability distribution is . According to the relationship of the probability density at different time, the marginal probability density is .

And the time derivative of the is Define as the transition probability density from state to state in unit time during time interval . So the transition probability from state to state during time interval is . Then the probability by which the transition does not happen is where , when . Thus, Equation (13) describes the evolution of the system states over time, which is the primary equation model of the UAV swarms behavior.

#### 3. Flocking Control of UAV Swarms

##### 3.1. Flocking Control Law

In this section, first we design a distributed flocking control law. Assuming that each UAV senses its own position and velocity and is able to obtain its neighbors’ position and velocity, the UAV swarms form flocking behaviour model structure control law as follows: where . Note that alignment at a common velocity is equivalent to . is the distance between the individual and . is potential function and satisfies the condition [29, 30]:(i),,(ii),.

##### 3.2. Stability Analysis

Consider the following positive semidefinite function: In order to facilitate writing, we simplify the certification process variable substitution as follows: where is UAV swarms system satisfying the Laplacian matrix of the communication conditions. Therefore, the quadratic form is explicitly described as follows: Consider the following collections: is a closed set. The following is to verify that it is a compact set, and there is a clear conclusion that . Similarly ,, and according to the definition of the potential field we obtain . According to the LaSalle invariance principle, the system will converge to the largest invariant set in the area and meet . According to , when the system enters the steady state, the speed of each individual is equal, and all individuals move to the target position , making the overall potential energy minimum.

Theorem 2. *Consider the UAV swarms consisting of UAVs. The position of individual is . All individuals in the swarms will eventually build up to the spherical region:
*

*Proof. *Consider
where ,.

By making the variable replacement ,, we get
Then
Since ,,
The largest and the smallest eigenvalues of symmetric positive definite matrix are and , respectively. The symmetric positive definite matrixwith appropriate dimensions satisfies the following conclusion [41, 42].

Finally, select Lyapunov function

Time derivative can be obtained:
Therefore, according to the above formula we obtain
When
. The system continues to move closer to the population centre. Therefore, eventually the system stabilizes at a known system of

#### 4. Simulation of System Flocking Formation Behavior

According to the UAV’s physical characteristics, this paper will discretize the time with high frequency. Thus, a UAV makes its path decision at time-step and will execute an action as the following equation:

The movement of the individual is not only controlled by itself but also affected by the state of other individuals. Therefore, the individual direction of movement at a certain time is not only relative to its direction one moment before, but also relative to the directions of its surrounding individuals’ movements. The influence of all the individuals to the individual can be described as the following equation:

Then, the speed direction of the UAV at time () can be modified as the following equation:

We consider the swarms of 100 UAVs with six degrees of freedom. The weights of the cost function are set to ,,, m/s and . Direction is the rand variable from −2 * pi to 2 * pi. The position of the UAVs is the rand variable. The factors of the influence on the flight are wind and airstream. The results for the case of 100 UAVs are shown in Figures 1 and 2.

From Figure 1, at , the velocities of the swarms achieve consensus at .

Figure 2 describes the trajectories with respect to time. The UAV swarms system will eventually be able to form a stable distance between each individual and the same velocity vectors. Collision between individuals is thus avoided.

Figures 3, 4, and 5 show the Pitch, Roll, and Attack with respect to time. From the simulation results, we can conclude that the UAVs based on the method successfully fly after the adjustment at the initial stage.

Figure 6 shows the Sideslip with respect to time. Through the analysis of the Sideslip Angle, we can find that the Angle of the Sideslip is less than 0.5 degrees and tends to zero, to ensure the turning flight control.

#### 5. Conclusion

This paper analyzed current researches and existent problems of UAV swarms. Afterwards, by the theory of stochastic process and supplemented variables, a differential-integral model was established. The existence and uniqueness of the solution of the system were discussed. The flocking control law is given based on artificial potential with system consensus. At last, we analyzed the stability of the proposed flocking control algorithm based on the Lyapunov approach and proved the conclusion that the system in 28 s can converge to the consensus direction of the velocity. And we performed simulation tests to verify the conclusion.

#### Acknowledgment

This paper is supported by The National Defense Pre-Research Foundation of China (Grant no. B222011XXXX).

#### References

- H. B. Duan, Q. N. Luo, and G. J. Ma, “Hybrid particle swarm optimization and genetic algorithm for multi-UAV formation reconfiguration,”
*IEEE Computational Intelligence Magazine*, vol. 8, pp. 16–27, 2013. View at: Google Scholar - W. Yi, M. B. Blake, and R. G. Madey, “An operation-time simulation framework for UAV swarm configuration and mission planning,”
*Procedia Computer Science*, vol. 18, pp. 1949–1958, 2013. View at: Publisher Site | Google Scholar - Y. Tang, H. J. Gao, J. Kurths, and J.-A. Fang, “Evolutionary pinning control and its application in UAV coordination,”
*IEEE Transactions on Industrial Informatics*, vol. 8, no. 4, pp. 828–838, 2012. View at: Publisher Site | Google Scholar - G. B. Lamont, J. N. Slear, and K. Melendez, “UAV swarm mission planning and routing using multi-objective evolutionary algorithms,” in
*Proceedings of the 1st IEEE Symposium of Computational Intelligence in Multicriteria Decision Making (MCDM '07)*, pp. 10–20, April 2007. View at: Publisher Site | Google Scholar - E. Besada-Portas, L. de la Torre, J. M. de la Cruz, and B. de Andrés-Toro, “Evolutionary trajectory planner for multiple UAVs in realistic scenarios,”
*IEEE Transactions on Robotics*, vol. 26, no. 4, pp. 619–634, 2010. View at: Publisher Site | Google Scholar - S. Kanchanavally, R. Ordonez, and C. J. Schumacher, “Path planning in three dimensional environment using feedback linearization,” in
*Proceedings of the American Control Conference (ACC '06)*, pp. 3545–3550, Mineapolis, Minn, USA, June 2006. View at: Google Scholar - M. Shanmugavel, A. Tsourdos, R. Zbikowski, and B. A. White, “3D path planning for multiple UAVs using pythagorean hodograph curves,” in
*Proceedings of the AIAA Guidance, Navigation, and Control Conference and Exhibit*, pp. 1576–1589, Hilton Head, SC, USA, August 2007. View at: Google Scholar - I. Hasircioglu, H. R. Topcuoglu, and M. Ermis, “3-D path planning for the navigation of unmanned aerial vehicles by using evolutionary algorithms,” in
*Proceedings of the 10th Annual Genetic and Evolutionary Computation Conference (GECCO '08)*, pp. 1499–1506, July 2008. View at: Google Scholar - P. Vincent and I. Rubin, “A framework and analysis for cooperative search using UAV swarms,” in
*Proceedings of the ACM Symposium on Applied Computing*, pp. 79–86, 2004. View at: Google Scholar - G. Varela, P. Caamamño, F. Orjales, Á. Deibe, F. López-Peña, and R. J. Duro, “Swarm intelligence based approach for real time UAV team coordination in search operations,” in
*Proceedings of the 3rd World Congress on Nature and Biologically Inspired Computing (NaBIC '11)*, pp. 365–370, October 2011. View at: Publisher Site | Google Scholar - Y. l. Yang,
*Cooperative search by uninhabited air vehicles in dynamic environment [Ph.D. thesis]*, University of Cincinnati, Cincinnati, Ohio, USA, 2005. - P. Dasgupta, “A multiagent swarming system for distributed automatic target recognition using unmanned aerial vehicles,”
*IEEE Transactions on Systems, Man, and Cybernetics A*, vol. 38, no. 3, pp. 549–563, 2008. View at: Publisher Site | Google Scholar - M. Yunhong, J. Zhe, and Z. Deyun, “A faster pruning optimization algorithm for task assignment,”
*Journal of Northwestern Polytechnical University*, vol. 31, pp. 40–43, 2013. View at: Google Scholar - B. Di, R. Zhou, and Q.-X. Ding, “Distributed coordinated heterogeneous task allocation for unmanned aerial vehicles,”
*Control and Decision*, vol. 28, pp. 274–278, 2013. View at: Google Scholar - W. You, Sh. Wang, and J. Tao, “Multi-UAV dynamic task assignment by ISODATA restrained clustering,”
*Electronics Optics & Control*, vol. 17, pp. 22–26, 2010. View at: Google Scholar - D. Dionne and C. A. Rabbath, “Multi-UAV decentralized task allocation with intermittent communications: the DTC algorithm,” in
*Proceedings of the American Control Conference (ACC '07)*, pp. 5406–5411, July 2007. View at: Publisher Site | Google Scholar - P. Dasgupta and M. Hoeing, “Dynamic pricing algorithms for task allocation in multi-agent swarms,” in
*Massively Multi-Agent Technology*, N. Jamali, P. Scerri, and T. Sugawara, Eds., vol. 5043 of*Lecture Notes in Computer Science*, pp. 64–79, 2008. View at: Publisher Site | Google Scholar - P. Gaudiano, B. Shargel, and E. Bonabeau,
*Swarm Intelligence: A New C2 Paradigm with an Application to Control Swarms of UAVs*, Icosystem, Cambridge, Mass, USA, 2003. - J. Finke, K. M. Passino, S. Ganapathy, and A. Sparks, “Modeling and analysis of cooperative control systems for uninhabited autonomous vehicles,” in
*Cooperative Control*, V. Kumar, N. Leonard, and A. S. Morse, Eds., vol. 309 of*Lecture Notes in Control and Information Science*, pp. 79–102, Springer, New York, NY, USA, 2005. View at: Publisher Site | Google Scholar | MathSciNet - T. McLain, R. Beard, and J. Kelsey, “Experimental demonstration of multiple robot cooperative target intercept,” in
*Proceedings of the AIAA Guidance, Navigation, and Control Conference*, AIAA-2002-4678, 2002. View at: Google Scholar - A. Moitra, R. Szczerba, V. Didomizio, L. Hoebel, R. Mattheyses, and B. Yamrom, “A novel approach for the coordination of multi-vehicle teams,” in
*Proceedings of the AIAA Guidance, Navigation, and Control Conference*, pp. 608–618, Monterey, Calif, USA, 2001. View at: Google Scholar - P. Vincent and I. Rubin, “A framework and analysis for cooperative search using UAV swarms,” in
*Proceedings of the ACM Applied Computing*, pp. 79–86, Nicosia, Cyprus, 2004. View at: Google Scholar - H. Hexmoor, B. McLaughlan, and M. Baker, “Swarm control in unmanned aerial vehicles,” in
*Proceedings of the International Conference on Artificial Intelligence (ICAI '05)*, pp. 911–917, June 2005. View at: Google Scholar - R. Garcia and L. Barnes, “Multi-UAV simulator utilizing x-plane,”
*Journal of Intelligent and Robotic Systems*, vol. 57, no. 1–4, pp. 393–406, 2010. View at: Publisher Site | Google Scholar | Zentralblatt MATH - M. A. Russell, G. B. Lamont, and K. Melendez, “On using SPEEDES as a platform for a parallel swarm simulation,” in
*Proceedings of the Winter Simulation Conference*, pp. 1129–1137, December 2005. View at: Publisher Site | Google Scholar - S. Luke, C. Cioffi-Revilla, L. Panait, K. Sullivan, and G. Balan, “MASON: a multiagent simulation environment,”
*Simulation*, vol. 81, no. 7, pp. 517–527, 2005. View at: Publisher Site | Google Scholar - S. J. Rasmussen, J. W. Mitchell, P. R. Chandler, C. J. Schumacher, and A. L. Smith, “Introduction to the Multi-UAV2 simulation and its application to cooperative control research,” in
*Proceedings of the American Control Conference (ACC '05)*, pp. 4490–4501, June 2005. View at: Google Scholar - T. McLain, R. Beard, and J. Kelsey, “Experimental demonstration of multiple robot cooperative target intercept,” in
*Proceedings of the AIAA Guidance, Navigation, and Control Conference*, AIAA-2002-4678, Monterey, Calif, USA, 2002. View at: Google Scholar - H. G. Tanner, A. Jadbabaie, and G. J. Pappas, “Stable flocking of mobile agents, part I: fixed topology,” in
*Proceedings of the 42nd IEEE Conference on Decision and Control*, pp. 2010–2015, December 2003. View at: Google Scholar - H. G. Tanner, A. Jadbabaie, and G. J. Pappas, “Stable flocking of mobile agents part II: dynamic topology,” in
*Proceedings of the 42nd IEEE Conference on Decision and Control*, pp. 2016–2021, December 2003. View at: Google Scholar - M. J. Mataric,
*Interaction and intelligent behavior [Ph.D. thesis]*, Massachusetts Institute of Technology, Cambridge, Mass, USA, 1994. - I. Kelly and D. Keating, “Flocking by the fusion of sonar and active infrared sensors on physical autonomous robots,” in
*Proceedings of the Conference on Mechatronics and Machine Vision in Practice*, pp. 14–17, 1996. View at: Google Scholar - A. T. Hayes and P. Dormiani-Tabatabaei, “Self-organized flocking with agent failure: off-line optimization and demonstration with real robots,” in
*Proceedings of the IEEE International Conference on Robotics and Automation*, pp. 3900–3905, May 2002. View at: Google Scholar - O. Holland, J. Woods, R. de Nardi, and A. Clark, “Beyond swarm intelligence: the ultraswarm,” in
*Proceedings of the IEEE Swarm Intelligence Symposium (SIS '05)*, pp. 217–224, June 2005. View at: Publisher Site | Google Scholar - E. Ferrante, A. E. Turgut, N. Mathews, M. Birattari, and M. Dorigo, “Flocking in stationary and non-stationary environments: a novel communication strategy for heading alignment,” in
*Parallel Problem Solving from Nature—PPSN XI*, R. Schaefer, C. Cotta, J. Kolodziej, and G. Rudolph, Eds., vol. 6239 of*Lecture Notes in Computer Science*, pp. 331–340, 2010. View at: Publisher Site | Google Scholar - A. Stranieri, E. Ferrante, A. E. Turgut et al., “Self-organized flocking with a heterogeneous mobile robot swarm,” Tech. Rep., 2011. View at: Google Scholar
- B. Li, “Stochastic process model of the multi-UAVs collaborative system based on state transition,” in
*Proceedings of Conference on Modeling, Identification and Control*, pp. 757–761, 2012. View at: Google Scholar - Z. X. Chen,
*Partial Differential Equations*, Science Press, Beijing, China, 2002. - L. Guo, H. Xu, C. Gao, and G. Zhu, “Stability analysis of a new kind series system,”
*IMA Journal of Applied Mathematics*, vol. 75, no. 3, pp. 439–460, 2010. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - D. p. Gaver, “Time to failure and availability of paralleled system with repair,”
*IEEE Transactions on Reliability*, vol. 12, pp. 30–38, 1963. View at: Google Scholar - Q. J. Fan,
*Key techniques research of cooperative formation biomimetic flight control for multi-UAV [Ph.D. thesis]*, Nanjing University of Aeronautics and Astronautics, Nanjing, China, 2008. - C. Yancai,
*Research on distributed cooperative control for swarm UAVs [Ph.D. thesis]*, Nanjing University of Aeronautics and Astronautics, Nanjing, China, 2011.

#### Copyright

Copyright © 2013 Li Bing et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.