Table of Contents Author Guidelines Submit a Manuscript
Modelling and Simulation in Engineering
Volume 2016, Article ID 5309348, 15 pages
http://dx.doi.org/10.1155/2016/5309348
Research Article

Automated Search-Based Robustness Testing for Autonomous Vehicle Software

1Leidos Inc., Huntsville, AL 35806, USA
2University of Alabama in Huntsville, Huntsville, AL 35899, USA

Received 28 April 2016; Revised 4 July 2016; Accepted 10 July 2016

Academic Editor: Min-Chie Chiu

Copyright © 2016 Kevin M. Betts and Mikel D. Petty. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. T. H. Cox, C. J. Nagy, M. A. Skoog, I. A. Somers, and R. Warner, A Report Overview of the Civil UAV Capability Assessment, National Aeronautics and Space Administration Aeronautics Research Mission Directorate, 2005.
  2. E. Guizzo, “How Google's self-driving car works,” IEEE Spectrum Online, vol. 18, 2011. View at Google Scholar
  3. E. Sholes, “Evolution of a UAV autonomy classification taxonomy,” in Proceedings of the IEEE Aerospace Conference, pp. 1–16, Big Sky, Mont, USA, March 2007. View at Publisher · View at Google Scholar · View at Scopus
  4. B. Lei, X. Li, Z. Liu, C. Morisset, and V. Stolz, “Robustness testing for software components,” Science of Computer Programming, vol. 75, no. 10, pp. 879–897, 2010. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus
  5. J. Cohen, D. Plakosh, and K. Keeler, “Robustness testing of software-intensive systems: explanation and guide,” Technical Note CMU/SEI-2005-TN-015, Software Engineering Institute, Carnegie Mellon University, Pittsburgh, Pa, USA, 2005. View at Google Scholar
  6. V. Reye, Virtual Hardware in the Loop (vHIL): Earlier and Better Testing for Automotive Applications, Synopsys White Paper, Raleigh, NC, USA, 2014.
  7. B. Murphy, A. Wakefield, and J. Friedman, “Best practices for verification, validation, and test in model-based design,” SAE Technical Paper 2008-01-1469, 2008. View at Google Scholar
  8. J. Edvardsson, “A survey on automatic test data generation,” in Proceedings of the 2nd Conference on Computer Science and Engineering, pp. 21–28, October 1999.
  9. J. Schumann, A. Bajwa, P. Berg, and R. Thirumalainambi, “Parametric testing of launch vehicle FDDR models,” in Proceedings of the AIAA SPACE Conference & Exposition, SPACE Conferences and Exposition, vol. no. 8868, Anaheim, Calif, USA, August 2010. View at Publisher · View at Google Scholar
  10. J. K. Telford, “A brief introduction to design of experiments,” Johns Hopkins APL Technical Digest, vol. 27, no. 3, pp. 224–232, 2007. View at Google Scholar · View at Scopus
  11. M. Uy and J. K. Telford, “Optimization by design of experiment techniques,” in Proceedings of the IEEE Aerospace Conference, pp. 1–10, March 2009. View at Publisher · View at Google Scholar · View at Scopus
  12. J. M. Hanson and B. B. Beard, “Applying Monte Carlo simulation to launch vehicle design and requirements verification,” Journal of Spacecraft and Rockets, vol. 49, no. 1, pp. 136–144, 2012. View at Publisher · View at Google Scholar · View at Scopus
  13. G. Fasano, D. Accardo, A. Moccia et al., “Multi-sensor-based fully autonomous non-cooperative collision avoidance system for unmanned air vehicles,” Journal of Aerospace Computing, Information and Communication, vol. 5, no. 10, pp. 338–360, 2008. View at Publisher · View at Google Scholar · View at Scopus
  14. E. Baumann, C. Bahm, B. Strovers, R. Beck, and M. Richard, “The X-43A six degree of freedom Monte Carlo analysis,” in Proceedings of the 46th AIAA Aerospace Sciences Meeting and Exhibit, Paper No. 2008-203, January 2008. View at Scopus
  15. M. Roeckel, R. H. Rivoir, R. E. Gibson, and S. P. Linder, “Simulation environments for the design and test of an intelligent controller for autonomous underwater vehicles,” in Proceedings of the 31st Conference on Winter Simulation: Simulation—A Bridge to the Future, vol. 2, pp. 1088–1093, IEEE, Phoenix, Ariz, USA, December 1999.
  16. Z. Saigol, F. Py, K. Rajan, C. McGann, J. Wyatt, and R. Dearden, “Randomized testing for robotic plan execution for autonomous systems,” in Proceedings of the IEEE/OES Autonomous Underwater Vehicles (AUV '10), pp. 1–9, IEEE, Monterey, Calif, USA, September 2010. View at Publisher · View at Google Scholar · View at Scopus
  17. S. Ali, L. C. Briand, H. Hemmati, and R. K. Panesar-Walawege, “A systematic review of the application and empirical investigation of search-based test case generation,” IEEE Transactions on Software Engineering, vol. 36, no. 6, pp. 742–762, 2010. View at Publisher · View at Google Scholar · View at Scopus
  18. D. E. Goldberg, Genetic Algorithms in Search and Machine Learning, Addison-Wesley, Reading, Mass, USA, 1989.
  19. D. Whitley, “A genetic algorithm tutorial,” Statistics and Computing, vol. 4, no. 2, pp. 65–85, 1994. View at Publisher · View at Google Scholar · View at Scopus
  20. W. Afzal, R. Torkar, and R. Feldt, “A systematic review of search-based testing for non-functional system properties,” Information and Software Technology, vol. 51, no. 6, pp. 957–976, 2009. View at Publisher · View at Google Scholar · View at Scopus
  21. C. C. Michael, G. E. McGraw, M. A. Schatz, and C. C. Walton, “Genetic algorithms for dynamic test data generation,” in Proceedings of the 12th IEEE International Conference on Automated Software Engineering, pp. 307–308, Incline Village, Nev, USA, November 1997. View at Publisher · View at Google Scholar
  22. J. Müller, C. A. Shoemaker, and R. Piché, “SO-I: a surrogate model algorithm for expensive nonlinear integer programming problems including global optimization applications,” Journal of Global Optimization, vol. 59, no. 4, pp. 865–889, 2014. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  23. M. Abramson, C. Audet, and J. E. Dennis Jr., Optimization using Surrogates for Engineering Design c, IMA Postdoctoral Fellowship Lecture Series, 2002.
  24. M. Harman, P. McMinn, J. Teixeira De Souza, and S. Yoo, “Search based software engineering: techniques, taxonomy, tutorial,” in Empirical Software Engineering and Verification, pp. 1–59, Springer, New York, NY, USA, 2012. View at Google Scholar
  25. M. Harman and J. Clark, “Metrics are fitness functions too,” in Proceedings of the 10th International Symposium on Software Metrics (METRICS '04), pp. 58–69, Chicago, Ill, USA, September 2004. View at Publisher · View at Google Scholar · View at Scopus
  26. A. Junghanns, J. Mauss, and M. Tatar, “Test automation based on computer chess principles,” in Proceedings of the 7th International CTI Symposium Innovative Automotive Transmissions, pp. 2–3, Berlin, Germany, 2008.
  27. M. Gäfvert, J. Hultén, J. Andreasson, A. Junghanns, J. Mauss, and M. Tatar, “Simulation-based automated verification of safety-critical chassis-control systems,” in Proceedings of the 9th International Symposium on Advanced Vehicle Control, Kobe, Japan, 2008.
  28. H. Brückmann, J. Strenkert, U. Keller, B. Wiesner, and A. Junghanns, “Model-based development of a dual-clutch transmission using rapid prototyping and SIL,” in International VDI Congress Transmissions in Vehicles, 2009. View at Google Scholar
  29. M. Tatar, R. Schaich, and T. Breitinger, “Automated test of the AMG speedshift DCT control software,” in Proceedings of the 9th International CTI Symposium Innovative Automotive Transmissions, Berlin, Germany, 2010.
  30. K.-D. Hilf, I. Matheis, J. Mauss, and J. Rauh, “Automated simulation of scenarios to guide the development of a crosswind stabilization function,” in Proceedings of the 6th IFAC Symposium Advances in Automotive Control (AAC '10), pp. 768–772, Munich, Germany, July 2010. View at Publisher · View at Google Scholar · View at Scopus
  31. A. C. Schultz, J. J. Grefenstette, and K. A. De Jong, “Test and evaluation by genetic algorithms,” IEEE expert, vol. 8, no. 5, pp. 9–14, 1993. View at Publisher · View at Google Scholar · View at Scopus
  32. Defense Advanced Research Projects Agency (DARPA), Fast Lightweight Autonomy (FLA), Broad Area Announcement (BAA), 2015.
  33. A. R. Conn, N. I. Gould, and P. Toint, “A globally convergent augmented Lagrangian algorithm for optimization with general constraints and simple bounds,” SIAM Journal on Numerical Analysis, vol. 28, no. 2, pp. 545–572, 1991. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  34. J. Müller, Surrogate Model Algorithms for Computationally Expensive Black-Box Global Optimization Problems, Publication No. 1092, Tampere University of Technology, Tampere, Finland, 2012.