Chinese Journal of Engineering

Volume 2014, Article ID 901986, 8 pages

http://dx.doi.org/10.1155/2014/901986

## Team Robot Motion Planning in Dynamics Environments Using a New Hybrid Algorithm (Honey Bee Mating Optimization-Tabu List)

^{1}Industrial Engineering, Yazd University, Yazd 8196658899, Iran^{2}Faculty of Industrial Engineering Department, Yazd University, Yazd, Iran

Received 4 February 2014; Revised 26 April 2014; Accepted 26 April 2014; Published 29 May 2014

Academic Editor: Jing-Shan Zhao

Copyright © 2014 Mohammad Abaee Shoushtary et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

This paper describes a new hybrid algorithm extracted from honey bee mating optimization (HBMO) algorithm (for robot travelling distance minimization) and tabu list technique (for obstacle avoidance) for team robot system. This algorithm was implemented in a C++ programming language on a Pentium computer and simulated on simple cylindrical robots in a simulation software. The environment in this simulation was dynamic with moving obstacles and goals. The results of simulation have shown validity and reliability of new algorithm. The outcomes of simulation have shown better performance than ACO and PSO algorithm (society, nature algorithms) with respect to two well-known metrics included, ATPD (average total path deviation) and AUTD (average uncovered target distance).

#### 1. Introduction

One of the most important issues in using robots is working automatically without human intervention. Autonomous robots are robots that self-control itself without human intervention [1]. Today, these robots could be applied in different areas such as working with dangerous materials, working in military service [2], underwater working [3], and rescue robots [4]. But using robots in these working areas is faced with some difficulties such as accuracy and constancy in operation [5]. The robots work in an unknown [6] and dynamics [2] Environments. The obstacles and goals in these environments are variable with a moving situation [7]. So, these robots must perform their tasks in such complex environment. In these environments, the robots must identify their tasks, reading and reaching decision for performing a good performance [8]. Consequently, suitable and accurate programming of robots has a positive influence on their operation. Moreover, we can use hardware capabilities of robots with a good programming of robots [9]. So, robot motion planning has been presented as an important field in robotic science [10].

Robot motion planning refers to process of robot task breakdown in the format of separated and discrete motions [7]. In robot motion planning, general strategies are educated to robots for selecting suitable motion among different motions that are available for it [11]. This helps them in doing their chores without any important problems or obstacle collision.

But the working capacity of a robot is limited and when we use it in a real world’s environment, we need to be using a group of them [12]. When we use a group of robots, we faced new problems such as robot cooperation [13], robot obstacle avoidance [10], and robot avoidance deadlock [14].

Furthermore, using robot in industrial tasks causes some overall costs such as energy cost [4], robot service, and maintenance cost [11]. Moreover, when we apply a robotic system, we want to increase performance and productivity [10]. So, we need to reduce costs and increase the speed of working of robots.

Because of the following reasons, this paper tries to investigate a new hybrid algorithm for team-robot motion planning that offers a robot motion planning algorithm with an optimized robot path travelling distance and obstacle avoidance in dynamics and unknown environment with moving goals and obstacles according to real world conditions. For doing it, we use honey bee mating optimization algorithm for taking an optimized path according to robot path travelling distance and use tabu lists for obstacle avoidance. The validity and reliability of this algorithm show with regard to simulation results. All simulations has been done in Webots 7.0.1 simulation software and programming of this algorithm implemented on a C++ programming language on a Pentium PC. The simulation results compare to two other algorithms including ant colony optimization algorithm (ACO) and particle swarm (PSO) algorithm. The outcomes of simulation have shown better performance than ACO and PSO algorithm (society, nature algorithms) with respect to two well-known metrics included, ATPD (average total path deviation) and AUTD (average uncovered target distance).

In the following part, we distinguish the research methodology. Section 3 is about the results of inquiry. The last section of this research describes the conclusion of the research.

#### 2. Methodology

In the first step of managing this research, we describe the methodology of environmental modeling. Then we identify the problem definition and the offered algorithm structure. Ultimately, we describe the simulation methods and ways of making resolutions.

##### 2.1. Environment Modeling

In this research, the environment is dynamic and unknown. Dynamic environments are the environments with moving obstacles and goals. For the modeling of dynamic in obstacles and goals, we must apply a physical modeling. The physical modeling is based on the dynamic equations in physics science. According to physics science in one step of time (from to ) an obstacle or goal does a motion from situation 1 to situation 2. Figure 1 shows this motion. In this figure, if we assume that the boxes are the obstacles and the stars are goals and the cylindrical object is a robot, when the robot is in time step , the robot must predict the obstacle and the goal position for time step according to previous knowledge extracted from its sensors and cameras in the previous time step (from to ). For calculation of the next position of obstacles and goals, robot uses physical equations of motion.

According to physics science, a solid object makes a motion with a velocity vector from its position at time to the next position in time . So, the robot creates a prediction according to According to Figure 1, and in this equation are the position of obstacles and goals that are shown with its indexes; it is the time, is the angle between the velocity vector and horizontal vector. The velocity vector is computed according to

For the modeling of obstacle and goals in the simulation software, we use a supervised plan for making motion in time according to random position of obstacle and goals and equations (2).

This dynamic in the environment is unknown for the robot. Robots did not have any previous information about robots, obstacles, and goals. Robots must get information from their sensors and cameras.

The simulation software is working with virtual reality modeling language. So, we must use a supervisor node for making these changes in the environment.

##### 2.2. Problem Definition

The conceptualization speculates the evaluation of the next position of the robot in its workspace thereby avoiding collision with other robots and the static hindrances in its runway from the current locality of the robot in the workspace. The following are the presuppositions made to validate the multirobot path planning problem: among a fixed set of actions in motion the robot has to select only one action at a time; the path planning problem, hence, incurs a bit of steps until all the robots arrive at their respective address.

The following principles are used to satisfy the assumptions: the robot first ascertains the next position in order to coordinate itself with the destination and constructs a path to that location.

Figure 2 shows the modeling of problem. In this picture, each robot show by . The global positions of robot were calculated by information extracted from GPS device (online) mounted on robot according to equation (3).

In Figure 2, the robot is available in time in position 1 with () coordination and wants to reach to goal that there is in () coordination in time . In doing that, it faces an obstacle. So, it must go to a point near to obstacle with () coordination at first and then follow the goal. So, it must go to this point by using a velocity vector named in time . According to that the () coordination is calculated with Now, if we desire to compute the path traveling distance of all robots, we use

According to (4), the path traveling distance of all robots is minimized when (4) becomes minimized. But because this problem is a NP-hard problem, solving that based on common methods is not possible and we must use metaheuristic methods. So, we use honey bee mating optimization algorithm for choosing the next path in each time step.

##### 2.3. Honey Bee Mating Optimization Algorithm (HBMO)

The honey bee is a social insect that can survive only as a member of a community, or a colony. The colony of different drone’s sperm there is in her spermatheca; she can use parts of the honey bee community which consists of three structurally different forms: the queen (reproductive female), the drones (male), and the workers (no reproductive female). These castes are associated with different functions in the colony; each caste possesses its own special instincts geared to the needs of the colony. The HBMO algorithm combines a number of different steps and the main steps of HBMO are depicted in Figure 3. Each of them corresponds to a different phase of the mating process of the honey bee. A drone mates with a queen probabilistically using an annealing function as where is the probability of adding the sperm of drone to the spermatheca of the queen (i.e., the probability of a successful mating), is the absolute difference between the fitness of and the fitness of the queen (for complete description of the calculation of the fitness function see below), and is the speed of the queen at time . The probability of mating is high when the queen is with the high speed level, or when the fitness of the drone is as well as the queen’s. After each transition in space, the queen’s speed decreases according to the following: where and are factors such that , are the amount of speed and energy reduction after each transition and each step, respectively. Initially, the speed of the queen is generated at random. A number of mating flights are realized. At the start of a mating flight drones are generated randomly and the queen selects a drone using the probabilistic rule in (5). If the mating is successful (i.e., the drone passes the probabilistic decision rule), the drone’s sperm is stored in the queen’s spermatheca. By using the crossover of the drone’s and the queen’s genotypes, a new brood (trial solution) is generated, which can be improved later by employing workers to conduct local search. In real life, the role of the workers is restricted to brood care and for this reason the workers are not separate members of the population and they are used as local search procedures in order to improve the broods produced by the mating flight of the queen. If the new brood is better than the current queen, it takes the place of the queen. If the brood fails to replace the queen, then in the next mating flight of the queen this brood will be one of the drones.

By replacing the bees with points that are available around the robot, we can choose the best point with minimum traveling distance for each robot. But this point may be available in the obstacles and robots must choose another point. So, we use tabu list technique for avoiding obstacles. The diagram of this algorithm is shown in Figure 3.

##### 2.4. Search Strategies and Tabu List Technique

The first step in this algorithm is searching. Searching begins with camera searching in time. According to things that camera found or forecast, we have three strategies for robots. These strategies are as follows: if the camera did not find an object near to robot for time step, the robot continues the algorithm and choose the near optimum point according to HBMO and move to it. At the end must put this calculated point in tabu list; if camera found a goal near to robot in time step, then robot chooses the near to optimum point, according to HBMO move to this point and put it to tabu list; if camera found an obstacle near to robot in time step, then robot puts this point to tabu list and choose to optimum point, according to HBMO and move to that and put it to tabu list.After doing the search, the robot runs the HBMO algorithm and chooses a near to optimum path and moves to that point. The searching and moving algorithm diagram is shown in Figure 4.

##### 2.5. Formation of Tabu Lists

In this algorithm, there are two tabu lists. One of these is global and the other is local. Each robot has a local tabu list and there is a global list for all algorithms. The local tabu list is for robot obstacle avoidance and the global tabu list is for avoiding robot loss. The main pseudocode is shown in Pseudocode 1.

#### 3. Results

The algorithm was implemented in a C++ programming language and on a Pentium PC. All of the simulations are done in Webots 7.0.1. The results of simulations are evaluated according to two known metrics: average total path deviation (ATPD) and average uncovered target distance (AUTD). An example of simulation is shown in Figure 5.

##### 3.1. Average Total Path Deviation (ATPD)

Let be a path from the starting point to the goal point generated by the program for robot in the th run. If are the paths generated over runs, then the average path traversed (APT) by robot . ATPD is calculated according to

##### 3.2. Average Uncovered Target Distance

Given a goal position and the current position of a robot on a 2-dimensional workspace, where and are 2-dimensional vectors, the uncovered distance of robot is , where denotes Euclidean norm. For robots, uncovered target distance (UTD) is the sum of . Now, for runs of the program, we evaluate the average of UTDs and call it the average uncovered target distance (AUTD). For all experiments conducted in this study, we considered . The experiment was conducted using the centralized version of the algorithm, where we used (4) as the fitness function to determine the next position of each robot from the current position. The algorithm is iterated until all the robots reach their respective goal positions. Let the number of robots be and the number of obstacles . The experiment was performed by setting the same velocity for all the robots in a given program run and AUTD readings versus the number of steps were noted for each run. The experiment was then repeated by changing velocities of the robots in each run.

##### 3.3. The Algorithm Performance

Figure 6 shows that, with the decrease in velocity, AUTD takes a longer time to attain zero value. Similar observations also follow for the number of robots , as a variable in the AUTD versus number of steps plot (Figure 7).

Figure 5 also shows that the AUTD gradually diminishes with iterations. Further, it is noted that the larger the velocity settings of the robots in program run, the faster the fall-off in the AUTD profile.

The fall-off in AUTD over program steps for a given is demonstrated in Figure 6 where we see that the larger the number of robots, the slower the convergence. Slower convergence, in turn, causes a delayed fall-off in AUTD.

We note from Figure 8 that ATPD is a nondecreasing function of for a constant . An intuitive interpretation of this phenomenon is that with increase in , robots face more constraints to plan local trajectories, thereby increasing ATPD. It is also noted from Figure 9 that, for a constant , an increase in causes more spatial restrictions in trajectory planning, thereby increasing ATPD. The same observations follow from Figure 9.

The fall-off in AUTD over time for a given is demonstrated in Figure 10 where we see that the larger the number of robots, the slower the convergence. Slower convergence, in turn, causes a delayed fall-off in AUTD. Also we note from Figure 11 that, for a constant , an increase in causes more spatial restrictions in trajectory planning, thereby increasing time required to reach the goal position.

The simulation results of PSO and ACO algorithm show that the average performance of new algorithm is better than them (you can see the results in Table 1).

#### 4. Conclusion

The paper introduced a new technique for team robot motion planning in dynamics and unknown environment with moving goals and obstacles to select the shortest path length of all the robots without hitting any obstacles in the world map with a hybrid algorithm extracted from HBMO and Tabu lists algorithm. Experiments reveal that the proposed scheme outperforms the PSO and ACO robot motion planning scheme at least with respect to two well-known metrics: ATPD and AUTD. These results confirm the validity and reliability of algorithm.

#### Conflict of Interests

The authors declare that they have no conflict of interests regarding the publication of this paper.

#### References

- N. S. V. Rao and S. S. Iyengar, “Autonomous robot navigation in unknown terrains: incidental learning and environmental exploration,”
*IEEE Transactions on Systems, Man and Cybernetics*, vol. 20, no. 6, pp. 1443–1449, 1990. View at Publisher · View at Google Scholar · View at Scopus - D. Tamilselvi and M. Shalinie, “Navigation of a robot amidst moving obstacles using DPPA (Dynamic Path Planning Agent),”
*European Journal of Scientific Research*, vol. 58, no. 4, pp. 506–517, 2011. View at Google Scholar · View at Scopus - Y. Yang, S. Wang, Z. Wu, and Y. Wang, “Motion planning for multi-HUG formation in an environment with obstacles,”
*Ocean Engineering*, vol. 38, no. 17-18, pp. 2262–2269, 2011. View at Publisher · View at Google Scholar · View at Scopus - H. Wei, B. Wang, Y. Wang, Z. Shao, and K. C. C. Chan, “Staying-alive path planning with energy optimization for mobile robots,”
*Expert Systems with Applications*, vol. 39, no. 3, pp. 3559–3571, 2012. View at Publisher · View at Google Scholar · View at Scopus - A. Sgorbissa and R. Zaccaria, “Planning and obstacle avoidance in mobile robotics,”
*Robotics and Autonomous Systems*, vol. 60, no. 4, pp. 628–638, 2012. View at Publisher · View at Google Scholar · View at Scopus - S. S. Ge, Q. Zhang, A. T. Abraham, and B. Rebsamen, “Simultaneous path planning and topological mapping (SP2ATM) for environment exploration and goal oriented navigation,”
*Robotics and Autonomous Systems*, vol. 59, no. 3-4, pp. 228–242, 2011. View at Publisher · View at Google Scholar · View at Scopus - E. Masehian and Y. Katebi, “Robot motion planning in dynamic environments with moving obstacles and target,”
*International Journal of Aerospace and Mechanical Engineering*, vol. 1, no. 1, pp. 20–25, 2007. View at Google Scholar - J. M. Martín Ramos, D. López García, F. Gómez-Bravo, and A. Blanco Morón, “Application of multicriteria decision-making techniques to manoeuvre planning in nonholonomic robots,”
*Expert Systems with Applications*, vol. 37, no. 5, pp. 3962–3976, 2010. View at Publisher · View at Google Scholar · View at Scopus - A. Dolgui and A. Pashkevich, “Manipulator motion planning for high-speed robotic laser cutting,”
*International Journal of Production Research*, vol. 47, no. 20, pp. 5691–5715, 2009. View at Publisher · View at Google Scholar · View at Scopus - C. Shi, Y. Wang, and J. Yang, “A local obstacle avoidance method for mobile robots in partially known environment,”
*Robotics and Autonomous Systems*, vol. 58, no. 5, pp. 425–434, 2010. View at Publisher · View at Google Scholar · View at Scopus - H. Yu, C.-J. Chi, T. Su, and Q. Bi, “Hybrid evolutionary motion planning using follow boundary repair for mobile robots,”
*Journal of Systems Architecture*, vol. 47, no. 6, pp. 635–647, 2001. View at Google Scholar · View at Scopus - C. M. Clark, “Probabilistic Road Map sampling strategies for multi-robot motion planning,”
*Robotics and Autonomous Systems*, vol. 53, no. 3-4, pp. 244–264, 2005. View at Publisher · View at Google Scholar · View at Scopus - J. B. Kramer and L. Sabalka, “Multidimensional online motion planning for a spherical robot,”
*International Journal of Computational Geometry and Applications*, vol. 20, no. 6, pp. 653–684, 2010. View at Publisher · View at Google Scholar · View at Scopus - G. A. S. Pereira, V. Kumar, and M. F. M. Campos, “Closed loop motion planning of cooperating mobile robots using graph connectivity,”
*Robotics and Autonomous Systems*, vol. 56, no. 4, pp. 373–384, 2008. View at Publisher · View at Google Scholar · View at Scopus