Table of Contents Author Guidelines Submit a Manuscript
Mathematical Problems in Engineering
Volume 2014, Article ID 183401, 10 pages
http://dx.doi.org/10.1155/2014/183401
Research Article

A Case Study on Air Combat Decision Using Approximated Dynamic Programming

School of Automation Science and Electrical Engineering, Beijing University of Aeronautics and Astronautics, Beijing 100191, China

Received 6 June 2014; Accepted 21 August 2014; Published 25 September 2014

Academic Editor: Minrui Fei

Copyright © 2014 Yaofei Ma et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. Defense Technical Information Center, “Unmanned aircraft systems roadmap 2013–2038 [R/OL],” 2013, https://info.publicintelligence.net/DoD-UnmannedRoadmap-2013.pdf.
  2. R. Isaacs, “Games of pursuit,” 1951.
  3. L. A. Petrosjan, Differential Games of Pursuit, vol. 2, World Scientific, 1993. View at Publisher · View at Google Scholar · View at MathSciNet
  4. F. Austin, G. Carbone, M. Falco, and H. Hinz, “Automated maneuvering decisions for air-to-air combat,” AIAA Paper 87-2393, 1987. View at Google Scholar
  5. H. Burgin George and L. B. Sidor, “Rule-based air combat simulation,” Tech. Rep. TITAN-TLJ-H-1501, Titan Systems Inc, La Jolla, Calif, USA, 1988. View at Google Scholar
  6. S. B. Banks and C. S. Lizza, “Pilot's Associate: a cooperative, knowledge-based system application,” IEEE Expert, vol. 6, no. 3, pp. 18–29, 1991. View at Publisher · View at Google Scholar · View at Scopus
  7. K. Schwamb, F. Vincent, and K. D. Keirsey, “Working with ModSAF: interfaces for programs and users,” in Proceedings of the 4th Conference on Computer Generated Forces and Behavioral Representation, 1994.
  8. B. McEnany, “CCTT SAF functional analysis,” in Proceedings of the 4th Conference on Computer Generated Forces and Behavioral Representation, Institute for Simulation and Training, 1994.
  9. A. J. Courtemanche and R. L. Wittman Jr., “OneSAF: a product line approach for a next-generation CGF,” in Proceedings of the 11th Computer Generated Forces Conference, IEEE Computer Society Press, Orlando, Fla, USA, 2002.
  10. K. Virtanen, J. Karelahti, and T. Raivio, “Modeling air combat by a moving horizon influence diagram game,” Journal of Guidance, Control, and Dynamics, vol. 29, no. 5, pp. 1080–1091, 2006. View at Publisher · View at Google Scholar · View at Scopus
  11. R. Bellman, “On the theory of dynamic programming,” Proceedings of the National Academy of Sciences of the United States of America, vol. 38, pp. 716–719, 1952. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  12. A. Coates, P. Abbeel, and A. Y. Ng, “Apprenticeship learning for helicopter control,” Communications of the ACM, vol. 52, no. 7, pp. 97–105, 2009. View at Publisher · View at Google Scholar · View at Scopus
  13. M. G. Lagoudakis and R. Parr, “Least-squares policy iteration,” Journal of Machine Learning Research, vol. 4, no. 6, pp. 1107–1149, 2004. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  14. M. Maggioni and S. Mahadevan, “Fast direct policy evaluation using multiscale analysis of Markov diffusion processes,” in Proceedings of the 23rd International Conference on Machine Learning (ICML '06), pp. 601–608, ACM, June 2006. View at Scopus
  15. M. Geist and P. Olivier, “A brief survey of parametric value function approximation,” Rapport interne, Supélec, 2010.
  16. B. Li and J. Si, “Approximate robust policy iteration using multilayer perceptron neural networks for discounted infinite-horizon markov decision processes with uncertain correlated transition matrices,” IEEE Transactions on Neural Networks, vol. 21, no. 8, pp. 1270–1280, 2010. View at Publisher · View at Google Scholar · View at Scopus
  17. Y. Ma, G. Gong, and X. Peng, “Cognition behavior model for air combat based on reinforcement learning,” Journal of Beijing University of Aeronautics and Astronautics, vol. 36, no. 4, pp. 379–383, 2010. View at Google Scholar · View at Scopus
  18. S. Baron, D. L. Kelinman, and S. Serben, “A study of the Markov game approach to tactical maneuvering problems,” NASA CR-1979, NASA, 1972. View at Google Scholar
  19. F. Austin, G. Carbone, M. Falco, H. Hinz, and M. Lewis, “Game theory for automated maneuvering during air-to-air combat,” Journal of Guidance, Control, and Dynamics, vol. 13, no. 6, pp. 1143–1149, 1990. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus