Table of Contents Author Guidelines Submit a Manuscript
Mathematical Problems in Engineering
Volume 2015, Article ID 964871, 13 pages
http://dx.doi.org/10.1155/2015/964871
Research Article

Multiagent Cooperative Learning Strategies for Pursuit-Evasion Games

1Department of Computer Science and Information Engineering, National Taipei University of Technology, Taipei, Taiwan
2Department of Computer Science, National Taipei University of Education, Taipei, Taiwan
3Department of Safety, Health and Environmental Engineering, Ming Chi University of Technology, New Taipei City, Taiwan

Received 20 June 2014; Revised 17 September 2014; Accepted 12 October 2014

Academic Editor: Saeed Balochian

Copyright © 2015 Jong Yih Kuo et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. K. P. Sycara, “Multiagent systems,” AI Magazine, vol. 19, no. 2, pp. 79–92, 1998. View at Google Scholar · View at Scopus
  2. N. Vlassis, A Concise Introduction to Multiagent Systems and Distributed Artificial Intelligence, Synthesis Lectures on Artificial Intelligence and Machine Learning, Morgan & Claypool, 2007.
  3. A. Antoniades, H. J. Kim, and S. Sastry, “Pursuit-evasion strategies for teams of multiple agents with incomplete information,” in Proceedings of the 42nd IEEE Conference on Decision and Control, pp. 756–761, December 2003. View at Scopus
  4. L. J. Guibas, J.-C. Latombe, S. M. Lavalle, D. Lin, and R. Motwani, “A visibility-based pursuit-evasion problem,” International Journal of Computational Geometry & Applications, vol. 9, no. 4-5, pp. 471–493, 1999. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  5. J. P. Hespanha, G. J. Pappas, and M. Prandini, “Greedy control for hybrid pur-suit-evasion games,” in Proceedings of the European Control Conference, pp. 2621–2626, 2001.
  6. R. Vidal, O. Shakernia, H. J. Kim, D. H. Shim, and S. Sastry, “Probabilistic pursuit-evasion games: theory, implementation, and experimental evaluation,” IEEE Transactions on Robotics and Automation, vol. 18, no. 5, pp. 662–669, 2002. View at Publisher · View at Google Scholar · View at Scopus
  7. R. E. Korf, “A simple solution to pursuit games,” in Proceedings of the 2nd International Workshop on Distributed Artificial Intelligence, pp. 183–194, 1992.
  8. S. Nolfi and D. Floreano, “Coevolving predator and prey robots: do “arms races” arise in artificial evolution?” Artificial Life, vol. 4, no. 4, pp. 311–335, 1998. View at Publisher · View at Google Scholar · View at Scopus
  9. N. J. Savill and P. Hogeweg, “Evolutionary stagnation due to pattern-pattern interactions in a coevolutionary predator-prey model,” Artificial Life, vol. 3, no. 2, pp. 81–100, 1997. View at Publisher · View at Google Scholar · View at Scopus
  10. J. Y. Kuo, F.-C. Huang, S.-P. Ma, and Y.-Y. Fanjiang, “Applying hybrid learning approach to RoboCup's strategy,” Journal of Systems and Software, vol. 86, no. 7, pp. 1933–1944, 2013. View at Publisher · View at Google Scholar · View at Scopus
  11. S. I. Nishimura and T. Ikegami, “Emergence of collective strategies in a prey-predator game model,” Artificial Life, vol. 3, no. 4, pp. 243–260, 1998. View at Google Scholar · View at Scopus
  12. K.-C. Jim and C. L. Giles, “Talking helps: evolving communicating agents for the predator-prey pursuit problem,” Artificial Life, vol. 6, no. 3, pp. 237–254, 2000. View at Publisher · View at Google Scholar · View at Scopus
  13. T. Haynes and S. Sen, “Evolving behavioral strategies in predators and prey,” in Adaption and Learning in Multi-Agent Systems, vol. 1042 of Lecture Notes in Computer Science, pp. 113–126, Springer, Berlin, Germany, 1995. View at Google Scholar
  14. D. Hládek, J. Vaščák, and P. Sinčák, “Hierarchical fuzzy inference system for robotic pursuit evasion task,” in Proceedings of the 6th International Symposium on Applied Machine Intelligence and Informatics (SAMI '08), pp. 273–277, Herľany, Slovakia, January 2008. View at Publisher · View at Google Scholar · View at Scopus
  15. R. G. Smith, “The contract net protocol: high-level communication and control in a distributed problem solver,” IEEE Transactions on Computers, vol. 19, no. 12, pp. 1104–1113, 1980. View at Publisher · View at Google Scholar · View at Scopus
  16. P.-C. Zhou, B.-R. Hong, Y.-H. Wang, and T. Zhou, “Multi-agent coopoerative pursuit based on extended contract net protocol,” in Proceedings of the International Conference on Machine Learning and Cybernetics, vol. 1, pp. 169–173, August 2004. View at Scopus
  17. A. Rao and M. Georgeff, “BDI agents: from theory to practice,” in Proceedings of the International Conference on Multi-Agent Systems, pp. 312–319, 1995.
  18. J. Piaget, The Equilibration of Cognitive Structures: The Central Problem of Intellectual Development, University of Chicago Press, 1985.
  19. J. Y. Kuo, S. J. Lee, C. L. Wu, N. L. Hsueh, and J. Lee, “Evolutionary agents for intelligent transport systems,” International Journal of Fuzzy Systems, vol. 7, no. 2, pp. 85–93, 2005. View at Google Scholar · View at Scopus
  20. J. Y. Kuo and F. C. Huang, “A hybrid approach for multi-agent learning systems,” Intelligent Automation and Soft Computing, vol. 17, no. 3, pp. 385–399, 2011. View at Publisher · View at Google Scholar · View at Scopus
  21. S. Gebhardt, P. Grant, R. von Georgi, and M. T. Huber, “Aspects of Piaget's cognitive developmental psychology and neurobiology of psychotic disorders—an integrative model,” Medical Hypotheses, vol. 71, no. 3, pp. 426–433, 2008. View at Publisher · View at Google Scholar · View at Scopus
  22. S. Takamuku and R. C. Arkin, “Multi-method learning and assimilation,” Robotics and Autonomous Systems, vol. 55, no. 8, pp. 618–627, 2007. View at Publisher · View at Google Scholar · View at Scopus
  23. T. Parsons, “Pursuit-evasion in a graph,” in Theory and Applications of Graphs, vol. 642 of Lecture Notes in Mathematics, pp. 426–441, Springer, Heidelberg, Germany, 1978. View at Publisher · View at Google Scholar
  24. R. Breisch, “An intuitive approach to speleotopology,” Southwestern Cavers, vol. 6, no. 5, pp. 72–78, 1967. View at Google Scholar
  25. F. Ferrari, “A new parameterized potential family for path planning algorithms,” International Journal on Artificial Intelligence Tools, vol. 18, no. 6, pp. 949–957, 2009. View at Publisher · View at Google Scholar · View at Scopus
  26. K. Walsh and B. Banerjee, “Fast A* with iterative resolution for navigation,” International Journal on Artificial Intelligence Tools, vol. 19, no. 1, pp. 101–119, 2010. View at Publisher · View at Google Scholar · View at Scopus
  27. L.-P. Wong, M. Y. H. Low, and C. S. Chong, “Bee colony optimization with local search for traveling salesman problem,” International Journal on Artificial Intelligence Tools, vol. 19, no. 3, pp. 305–334, 2010. View at Publisher · View at Google Scholar · View at Scopus
  28. E. Raboin, D. S. Nau, U. Kuter, S. K. Gupta, and P. Svec, “Strategy generation in multi-agent imperfect-information pursuit games,” in Proceedings of the International Conference on Autonomous Agents and Multiagent Systems, pp. 947–954, 2010.
  29. B. P. Gerkey, S. Thrun, and G. Gordon, “Visibility-based pursuit-evasion with limited field of View,” International Journal of Robotics Research, vol. 25, no. 4, pp. 299–315, 2006. View at Publisher · View at Google Scholar · View at Scopus
  30. N. Basilico, N. Gatti, and F. Amigoni, “Leader-follower strategies for robotic patrolling in environments with arbitrary topologies,” in Proceedings of the 8th International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS '09), pp. 57–64, May 2009. View at Scopus
  31. M. Yan, “Multi-robot searching using game-theory based approach,” International Journal of Advanced Robotic Systems, vol. 5, no. 4, pp. 341–350, 2008. View at Google Scholar · View at Scopus
  32. K.-D. Althoff, “Case-based reasoning,” in Handbook on Software Engineering and Knowledge Engineering, pp. 549–587, 2001. View at Google Scholar
  33. E. K. Burke, B. L. MacCarthy, S. Petrovic, and R. Qu, “Multiple-retrieval case-based reasoning for course timetabling problems,” Journal of the Operational Research Society, vol. 57, no. 2, pp. 148–162, 2006. View at Publisher · View at Google Scholar · View at Scopus
  34. J. Long, D. G. Schwartz, S. Stoecklin, and M. K. Patel, “Application of loop reduction to learning program behaviors for anomaly detection,” in Proceedings of the International Conference on Information Technology: Coding and Computing (ITCC '05), vol. 1, pp. 691–696, April 2005. View at Publisher · View at Google Scholar · View at Scopus
  35. The Repast Suite, The Repast Suite, 2014, http://repast.sourceforge.net/.
  36. L. Matignon, G. J. Laurent, and N. L. Fort-Piat, “Hysteretic Q-Learning: an algorithm for decentralized reinforcement learning in cooperative multi-agent teams,” in Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '07), pp. 64–69, San Diego, Calif, USA, October-November 2007. View at Publisher · View at Google Scholar · View at Scopus
  37. I. Partalas, I. Feneris, and I. Vlahavas, “A hybrid multiagent reinforcement learning approach using strategies and fusion,” International Journal on Artificial Intelligence Tools, vol. 17, no. 5, pp. 945–962, 2008. View at Publisher · View at Google Scholar · View at Scopus