Table of Contents
International Journal of Vehicular Technology
Volume 2013, Article ID 705086, 12 pages
http://dx.doi.org/10.1155/2013/705086
Research Article

Evaluation of a Navigation Radio Using the Think-Aloud Method

1Driver Interface Group, University of Michigan Transportation Research Institute, 2901 Baxter Road, Ann Arbor, MI 48109-2150, USA
2Advanced Vehicle Safety and Dynamics Research Office, Korea Automobile Testing and Research Institute, 200 Samjon-ro, Songsan-myeon, Hwaseong-si, Gyeonggi-do 445-871, Republic of Korea

Received 10 October 2012; Accepted 26 December 2012

Academic Editor: Motoyuki Akamatsu

Copyright © 2013 Paul A. Green and Jin-Seop Park. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. J. Nielsen and R. Mack, Usability Inspection Methods, John Wiley & Sons, New York, NY, USA, 1994.
  2. S. Krug, Rocket Surgery Made Easy: The Do-It-Yourself Guide to Finding and Fixing Usability Problems, New Riders, Berkeley, Calif, USA, 2010.
  3. J. Rubin, D. Chisnell, and J. Spool, Handbook of Usability Testing, John Wiley & Sons, New York, NY, USA, 2008.
  4. R. Jeffries, J. R. Miller, C. Wharton, and K. Uyeda, “User interface evaluation in the real world: a comparison of four techniques,” in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 119–124, 1991.
  5. R. A. Virzi, J. F. Sorce, and L. B. Herbert, “Comparison of three usability evaluation methods: Heuristic, think-aloud, and performance testing,” in Proceedings of the 37th Annual Meeting the Human Factors and Ergonomics Society, pp. 309–313, October 1993. View at Scopus
  6. R. Molich, M. R. Ede, K. Kaasgaard, and B. Karyukin, “Comparative usability evaluation,” Behaviour and Information Technology, vol. 23, no. 1, pp. 65–74, 2004. View at Publisher · View at Google Scholar · View at Scopus
  7. K. Hornbæk, “Current practice in measuring usability: challenges to usability studies and research,” International Journal of Human Computer Studies, vol. 64, no. 2, pp. 79–102, 2006. View at Publisher · View at Google Scholar · View at Scopus
  8. M. W. M. Jaspers, “A comparison of usability methods for testing interactive health technologies: Methodological aspects and empirical evidence,” International Journal of Medical Informatics, vol. 78, no. 5, pp. 340–353, 2009. View at Publisher · View at Google Scholar · View at Scopus
  9. J. Nielsen and R. Molich, “Heuristic evaluation of user interfaces,” in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '90), Association for Computing Machinery, New York, NY, USA, 1990.
  10. A. M. Lund, “Expert ratings of usability maxims,” Ergonomics in Design, vol. 5, no. 7, pp. 15–20, 1997. View at Google Scholar · View at Scopus
  11. E. Hvannberg, E. Law, and M. Lárusdóttir M, “Heuristic evaluation: comparing ways of finding and reporting usability problems,” Interacting with Computers, vol. 19, no. 2, pp. 225–240, 2007. View at Publisher · View at Google Scholar
  12. C. H. Lewis and Using the, “"Thinking Aloud" method in cognitive interface design,” Technical Report IBM RC-9265, IBM Watson Research Center, Yorktown Heights, NY, USA, 1982. View at Google Scholar
  13. P. C. Wright and A. F. Monk, “The use of the Think-Aloud evaluation methods in design,” ACM SIGCHI Bulletin, vol. 23, no. 1, pp. 55–57, 1991. View at Google Scholar
  14. E. Krahmer and N. Ummelen, “Thinking about thinking aloud: a comparison of two verbal protocols for usability testing,” IEEE Transactions on Professional Communication, vol. 47, no. 2, pp. 105–117, 2004. View at Publisher · View at Google Scholar · View at Scopus
  15. M. Norgaard and K. Hornbaek, “What do usability evaluators do in practice? An exploratory study of Think-Aloud testing,” in Proceedings of the 6th conference on Designing Interactive systems (DIS '06), pp. 209–218, 2006.
  16. J. Lewis, “Usability testing,” in Handbook of Human Factors and Ergonomics, G. Salvendy, Ed., chapter 46, pp. 1267–1312, John Wiley & Sons, New York, NY, USA, 4th edition, 2012. View at Google Scholar
  17. D. Manes, P. Green, and D. Hunter, “Prediction of destination entry and retrieval times using keystroke-level models,” Technical Report UMTRI-96-37, University of Michigan Transportation Research Institute, Ann Arbor, Mich, USA, 1997, EECS-ITS LAB FT97-077. View at Google Scholar
  18. P. Green, “Estimating compliance with the 15-Second Rule for driver-interface usability and safety,” in Proceedings of the 43rd Annual Meeting on Human Factors and Ergonomics Society, Human Factors and Ergonomics Society, CD-ROM, Santa Monica, Calif, USA, 1999.
  19. C. Nowakowski and P. Green, “Prediction of menus selection times parked and while driving using the SAE J2365 method,” Technical Report 2000-49, University of Michigan Transportation Research Institute, Ann Arbor, Mich, USA, 2001. View at Google Scholar
  20. Calculation of the Time to Complete in-Vehicle Navigation and Route Guidance Tasks, SAE Recommended Practice J2365, 2002.
  21. S. Schneegass, B. Pfleging, D. Kern, and A. Schmidt, “Support for modeling interaction with automotive user interfaces,” in Proceedings of the the 3rd International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '11), pp. 71–78, 2011.
  22. B. T.-W. Lin, P. Green, T.-P. Kang, A. Mize, A. Best, and K. Su, “Touch screen menu selection time and SAE J2365 predictions of them,” Technical Report UMTRI-2012-9, University of Michigan Transportation Research Institute, Ann Arbor, Mich, USA, 2012. View at Google Scholar
  23. J. Sauro, “Margins of error in usability tests,” 2009, http://www.measuringusability.com/test-margin.php.
  24. J.-S. Park, P. Green, and M. Alter, “Usability assessment of the mobis gen 3 navigation radio,” Technical Report UMTRI-2010-23, University of Michigan Transportation Research Institute, Ann Arbor, Mich, USA, 2010. View at Google Scholar
  25. J. R. Lewis, “Sample sizes for usability tests: mostly math, not magic,” Interactions, vol. 13, no. 6, pp. 29–33, 2006. View at Publisher · View at Google Scholar · View at Scopus
  26. R. A. Virzi, “Refining the test phase of usability evaluation: how many subjects is enough?” Human Factors, vol. 34, no. 4, pp. 457–468, 1992. View at Google Scholar · View at Scopus
  27. J. Sauro and J. R. Lewis, Quantifying the User Experience, Morgan Kaufmann, San Francisco, Calif, USA, 2012.
  28. Y. Kinoe, “The VPA method: a method for formal verbal protocol analysis,” in Designing and Using Human-Computer Interfaces and Knowledge Based Systems, G. Salvendy and M. J. Smith, Eds., pp. 735–742, Elsevier Science, Amsterdam, The Netherlands.
  29. Road Vehicles—Symbols for Controls, Indicators, and Tell-tales, ISO Standard 2575, 2010.
  30. Apple Inc., "OS X Human Interface Guidelines", Apple, Cupertino, Calif, USA, 2012, http://developer.apple.com/library/mac/documentation/userexperience/conceptual/applehiguidelines/OSXHIGuidelines.pdf.
  31. C. Nowakowski, P. Green, and O. Tsimhoni, “Common automotive navigation system usability problems and a standard test protocol to identify them,” in Proceedings of the the ITS-America Annual Meeting (CD-ROM), Intelligent Transportation Society of America, Washington, DC, USA, 2003.
  32. Techsmith, “Morae (software),” Techsmith, Okemos, Mich, USA, 2012, http://www.techsmith.com/morae.html.
  33. J. Reason, Human Error, Cambridge University Press, Cambridge, UK, 1990.
  34. S. A. Shappelland and D. A. Wiegmann, “The human factors analysis and classification system-HFACS,” Final Report DOT/FAA/AM-00/7, Office of Aviation Medicine, Federal Aviation Administration, US Department of Transportation, Washington, DC, USA, 2000. View at Google Scholar
  35. T. S. Andre, H. Rex Hartson, S. M. Belz, and F. A. McCreary, “User action framework: a reliable foundation for usability engineering support tools,” International Journal of Human Computer Studies, vol. 54, no. 1, pp. 107–136, 2001. View at Publisher · View at Google Scholar · View at Scopus
  36. K. Hornbaek and E. Forkjaer, “Comparison of techniques for matching usability problem description,” Interacting With Computers, vol. 20, no. 6, pp. 505–514, 2008. View at Publisher · View at Google Scholar
  37. R. Khajouei, L. W. P. Peute, A. Hasman, and M. W. M. Jaspers, “Classification and prioritization of usability problems using an augmented classification scheme,” Journal of Biomedical Informatics, vol. 44, no. 6, pp. 948–957, 2011. View at Publisher · View at Google Scholar · View at Scopus