Table of Contents Author Guidelines Submit a Manuscript
Mathematical Problems in Engineering
Volume 2016, Article ID 1907971, 12 pages
http://dx.doi.org/10.1155/2016/1907971
Research Article

A Semi-Markov Decision Model for Recognizing the Destination of a Maneuvering Agent in Real Time Strategy Games

College of Information System and Management, National University of Defense Technology, Changsha 410073, China

Received 19 August 2015; Accepted 16 December 2015

Academic Editor: M. I. Herreros

Copyright © 2016 Quanjun Yin et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. S. C. J. Bakkes, P. H. M. Spronck, and G. van Lankveld, “Player behavioural modelling for video games,” Entertainment Computing, vol. 3, no. 3, pp. 71–79, 2012. View at Publisher · View at Google Scholar · View at Scopus
  2. S. Raghavana, P. Singlab, and R. J. Mooney, “Plan recognition using statistical-relational models,” in Plan, Activity, and Intent Recognition: Theory and Practice, G. Sukthankar, R. P. Goldman, C. Geib et al., Eds., pp. 57–85, Elsevier, Waltham, Mass, USA, 2014. View at Google Scholar
  3. G. Robertson and I. Watson, “A review of real-time strategy game AI,” AI Magazine, vol. 35, no. 4, pp. 75–104, 2014. View at Google Scholar · View at Scopus
  4. S. Ragi, C. Tan, and E. K. Chong, “Guidance of autonomous amphibious vehicles for flood rescue support,” Mathematical Problems in Engineering, vol. 2013, Article ID 528162, 9 pages, 2013. View at Publisher · View at Google Scholar · View at MathSciNet
  5. H. H. Bui, S. Venkatesh, and G. West, “Policy recognition in the abstract hidden Markov model,” Journal of Artificial Intelligence Research, vol. 17, pp. 451–499, 2002. View at Google Scholar · View at MathSciNet · View at Scopus
  6. S. G. Yue, Y. B. Zha, Q. J. Yin, and Q. Zhang, “Path plan recognition by CGF based on abstract hidden Markov model,” Journal of National University of Defense Technology, vol. 36, no. 1, pp. 148–153, 2014. View at Publisher · View at Google Scholar · View at Scopus
  7. M. Wiering and M. van Otterlo, Reinforcement Learning: State-of-the-Art, Springer, Berlin, Germany, 2011.
  8. F. Southey, W. Loh, and D. Wilkinson, “Inferring complex agent motions from partial trajectory observations,” in Proceedings of the 20th International Joint Conference on Artificial Intelligence (IJCAI '07), pp. 2631–2637, January 2007. View at Scopus
  9. K. Murphy and S. Russell, “Rao-blackwellised particle filtering for dynamic Bayesian networks,” in Sequential Monte Carlo Methods in Practice, A. Doucet, N. de Freitas, and N. J. Gordon, Eds., Springer, 2001. View at Google Scholar
  10. H. A. Kautz and J. F. Allen, “Generalized plan recognition,” in Proceedings of the 5th National Conference on Artificial Intelligence, pp. 32–37, Philadelphia, Pa, USA, 1986.
  11. D. Avrahami-Zilberbrand and G. A. Kaminka, “Fast and complete symbolic plan recognition,” in Proceedings of the 19th International Joint Conference on Artificial Intelligence (IJCAI '05), pp. 79–84, San Francisco, Calif, USA, August 2005.
  12. H. H. Zhuo, H. Muñoz-Avila, and Q. Yang, “Learning hierarchical task network domains from partially observed plan traces,” Artificial Intelligence, vol. 212, pp. 134–157, 2014. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  13. B. Auslander, K. M. Gupta, and D. W. Aha, “Maritime threat detection using plan recognition,” in Proceedings of the 23rd Annual Conference on Homeland Security Technology, pp. 249–254, Waltham, Mass, USA, November 2012. View at Publisher · View at Google Scholar
  14. D. Koller and N. Friedman, Probabilistic Graphical Models: Principles and Techniques, MIT Press, Cambridge, Mass, USA, 2009. View at MathSciNet
  15. D. Masato, T. J. Norman, W. W. Vasconcelos, and K. Sycara, “Agent-oriented incremental team and activity recognition,” in Proceedings of the 22nd International Joint Conference on Artificial Intelligence (IJCAI '11), pp. 1402–1407, July 2011. View at Publisher · View at Google Scholar · View at Scopus
  16. A. Sadilek and H. Kautz, “Location-based reasoning about complex multi-agent behavior,” Journal of Artificial Intelligence Research, vol. 43, pp. 87–133, 2012. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  17. D. I. Kosmopoulos, N. D. Doulamis, and A. S. Voulodimos, “Bayesian filter based behavior recognition in workflows allowing for user feedback,” Computer Vision and Image Understanding, vol. 116, no. 3, pp. 422–434, 2012. View at Publisher · View at Google Scholar · View at Scopus
  18. L. He, C.-F. Zong, and C. Wang, “Driving intention recognition and behaviour prediction based on a double-layer hidden Markov model,” Journal of Zhejiang University: Science C, vol. 13, no. 3, pp. 208–217, 2012. View at Publisher · View at Google Scholar · View at Scopus
  19. P. Doshi, X. Qu, and A. Goodie, “Decision-theoretic planning in multi-agent settings with application to behavioral modeling,” in Plan, Activity, and Intent Recognition: Theory and Practice, G. Sukthankar, R. P. Goldman, C. Geib et al., Eds., pp. 205–224, Elsevier, Waltham, Mass, USA, 2014. View at Google Scholar
  20. W. J. Mao, J. Gratch, and X. C. Li, “Probabilistic plan inference for group behavior prediction,” IEEE Intelligent Systems, vol. 27, no. 4, pp. 27–36, 2012. View at Publisher · View at Google Scholar · View at Scopus
  21. C. W. Geib and R. P. Goldman, “A probabilistic plan recognition algorithm based on plan tree grammars,” Artificial Intelligence, vol. 173, no. 11, pp. 1101–1132, 2009. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  22. S. Hladky and V. Bulitko, “An evaluation of models for predicting opponent positions in first-person shooter video games,” in Proceedings of the IEEE Symposium on Computational Intelligence and Games (CIG '08), pp. 39–46, IEEE, Perth, Australia, December 2008. View at Publisher · View at Google Scholar · View at Scopus
  23. S. Zouaoui-Elloumi, V. Roy, J. P. Marmorat et al., “Securing harbors by modeling and classifying ship behavior,” in Proceedings of the 20th Annual Conference on Behavior Representation in Modeling and Simulation, pp. 114–121, Sundance, Utah, USA, March 2011.
  24. T. Duong, D. Phung, H. Bui, and S. Venkatesh, “Efficient duration and hierarchical modeling for human activity recognition,” Artificial Intelligence, vol. 173, no. 7-8, pp. 830–856, 2009. View at Publisher · View at Google Scholar · View at Scopus
  25. T. L. M. van Kasteren, G. Englebienne, and B. J. A. Kröse, “Activity recognition using semi-Markov models on real world smart home datasets,” Journal of Ambient Intelligence and Smart Environments, vol. 2, no. 3, pp. 311–325, 2010. View at Publisher · View at Google Scholar · View at Scopus
  26. B. Auslander, K. M. Gupta, and D. W. Aha, “Maritime threat detection using probabilistic graphical models,” in Proceedings of the 25th International FLAIRS Conference, AAAI Press, Marco Island, Fla, USA, 2012.
  27. T. D. Ullman, C. L. Baker, O. Macindoe, O. Evans, N. D. Goodman, and J. B. Tenenbaum, “Help or hinder: bayesian models of social goal inference,” in Proceedings of the 23rd Annual Conference on Neural Information Processing Systems (NIPS '09), pp. 1874–1882, December 2009. View at Scopus
  28. B. Tastan, Y. Chang, and G. Sukthankar, “Learning to intercept opponents in first person shooter games,” in Proceedings of the IEEE International Conference on Computational Intelligence and Games (CIG '12), pp. 100–107, IEEE, Granada, Spain, September 2012. View at Publisher · View at Google Scholar · View at Scopus
  29. B. G. Weber, M. Mateas, and A. Jhala, “A particle model for state estimation in real-time strategy games,” in Proceedings of the 7th AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment (AIIDE '11), pp. 103–108, AAAI, Stanford, Calif, USA, October 2011. View at Scopus
  30. A. Pfeffer, S. Das, D. Lawless, and B. Ng, “Factored reasoning for monitoring dynamic team and goal formation,” Information Fusion, vol. 10, no. 1, pp. 99–106, 2009. View at Publisher · View at Google Scholar · View at Scopus
  31. J. Lapuyade-Lahorgue and W. Pieczynski, “Unsupervised segmentation of hidden semi-Markov non-stationary chains,” Signal Processing, vol. 92, no. 1, pp. 29–42, 2012. View at Publisher · View at Google Scholar · View at Scopus