Table of Contents Author Guidelines Submit a Manuscript
International Journal of Digital Multimedia Broadcasting
Volume 2008, Article ID 712380, 20 pages
http://dx.doi.org/10.1155/2008/712380
Research Article

Acceptance Threshold: A Bidimensional Research Method for User-Oriented Quality Evaluation Studies

1Tampere University of Technology, Human-Centered Technology, P.O. Box 553, 33101 Tampere, Finland
2Nokia Research Center, P.O. Box 1000, 33721 Tampere, Finland

Received 5 March 2008; Accepted 17 July 2008

Academic Editor: Harald Kosch

Copyright © 2008 S. Jumisko-Pyykkö et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. R. J. Abbott, An Integrated Approach to Software Development, John Wiley & Sons, New York, NY, USA, 1986.
  2. V. Roto, Web browsing on mobile phones—characteristics of user experience, Ph.D. dissertation, Helsinki University of Technology, Helsinki, Finland, 2006.
  3. M. Hassenzahl and N. Tractinsky, “User experience—a research agenda,” Behaviour & Information Technology, vol. 25, no. 2, pp. 91–97, 2006. View at Publisher · View at Google Scholar
  4. S. J. Barnes, “The mobile commerce value chain: analysis and future developments,” International Journal of Information Management, vol. 22, no. 2, pp. 91–108, 2002. View at Publisher · View at Google Scholar
  5. S. Bech and N. Zacharov, Perceptual Audio Evaluation: Theory, Method and Application, John Wiley & Sons, New York, NY, USA, 2006.
  6. P. G. Engeldrum, Psychometric Scaling: A Toolkit for Imaging Systems Development, Imcotek Press, Winchester, Mass, USA, 2000.
  7. H. T. Lawless and H. Heyman, Sensory Evaluation of Food: Principles and Practices, Chapman & Hall/CRC, New York, NY, USA, 1998.
  8. S. Jumisko-Pyykkö, ““I would like to see the subtitles and the face or at least hear the voice”: effects of picture ratio and audio-video bitrate ratio on perception of quality in mobile television,” Multimedia Tools and Applications, vol. 36, no. 1-2, pp. 167–184, 2008. View at Publisher · View at Google Scholar
  9. H. Knoche, J. D. McCarthy, and M. A. Sasse, “Can small be beautiful? Assessing image resolution requirements for mobile TV,” in Proceedings of the 13th Annual ACM International Conference on Multimedia (MULTIMEDIA '05), pp. 829–838, Singapore, November 2005. View at Publisher · View at Google Scholar
  10. H. Knoche, J. McCarthy, and M. A. Sasse, “How low can you go? The effect of low resolutions on shot types in mobile TV,” Multimedia Tools and Applications, vol. 36, no. 1-2, pp. 145–166, 2008. View at Publisher · View at Google Scholar
  11. ITU-T P.911 Recommendation P.911, “Subjective audiovisual quality assessment methods for multimedia application,” International Telecommunication Union - Telecommunication sector, 1998.
  12. G. Ghinea and J. P. Thomas, “QoS impact on user perception and understanding of multimedia video clips,” in Proceedings of the 6th ACM International Conference on Multimedia (MULTIMEDIA '98), pp. 49–54, Bristol, UK, September 1998. View at Publisher · View at Google Scholar
  13. S. R. Gulliver, T. Serif, and G. Ghinea, “Pervasive and standalone computing: the perceptual effects of variable multimedia quality,” International Journal of Human Computer-Studies, vol. 60, no. 5-6, pp. 640–665, 2004. View at Publisher · View at Google Scholar
  14. J. D. McCarthy, M. A. Sasse, and D. Miras, “Sharp or smooth?: comparing the effects of quantization vs. frame rate for streamed video,” in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '04), pp. 535–542, Vienna, Austria, April 2004. View at Publisher · View at Google Scholar
  15. K. Nahrstedt and R. Steinmetz, “Resource management in networked multimedia systems,” Computer, vol. 28, no. 5, pp. 52–63, 1995. View at Publisher · View at Google Scholar
  16. G. Wikstrand, Improving user comprehension and entertainment in wireless streaming media: introducing cognitive quality of service, Ph.D. thesis, Department of Computer Science, Umeå University, Umeå, Sweden, 2003.
  17. S. R. Gulliver and G. Ghinea, “Defining user perception of distributed multimedia quality,” ACM Transactions on Multimedia Computing, Communications and Applications, vol. 2, no. 4, pp. 241–257, 2006. View at Publisher · View at Google Scholar
  18. S. Jumisko-Pyykkö, M. V. Vinod Kumar, M. Liinasuo, and M. M. Hannuksela, “Acceptance of audiovisual quality in erroneous television sequences over a DVB-H channel,” in Proceedings of the 2nd International Workshop in Video Processing and Quality Metrics for Consumer Electronics, Scottsdale, Ariz, USA, January 2006.
  19. S. Jumisko-Pyykkö and J. Häkkinen, “Evaluation of subjective video quality of mobile devices,” in Proceedings of the 13th Annual ACM International Conference on Multimedia (MULTIMEDIA '05), pp. 535–538, Singapore, November 2005. View at Publisher · View at Google Scholar
  20. S. Winkler and C. Faller, “Audiovisual quality evaluation of low-bitrate video,” in Human Vision and Electronic Imaging X, vol. 5666 of Proceedings of SPIE, pp. 139–148, San Jose, Calif, USA, January 2005. View at Publisher · View at Google Scholar
  21. H. Knoche, H. de Meer, and D. Kirsh, “Extremely economical: how key frames affect consonant perception under different audio-visual skews,” in Proceedings of the 16th World Congress on Ergonomics (IEA '06), Maastricht, The Netherlands, July 2006.
  22. M. M. Hannuksela, V. K. Malamal Vadakital, and S. Jumisko-Pyykkö, “Synchronized audio redundancy coding for improved error resilience in streaming over DVB-H,” in Proceedings of the 3rd International Mobile Multimedia Communications Conference (MobiMedia '07), Nafpaktos, Greece, August 2007.
  23. M. M. Hannuksela, V. K. Malamal Vadakital, and S. Jumisko-Pyykkö, “Comparison of error protection methods for audio-video broadcast over DVB-H,” EURASIP Journal on Advances in Signal Processing, vol. 2007, Article ID 71801, 12 pages, 2007. View at Publisher · View at Google Scholar
  24. N. Ravaja, K. Kallinen, T. Saari, and L. Keltikangas-Järvinen, “Suboptimal exposure to facial expressions when viewing video messages from a small screen: effects on emotion, attention, and memory,” Journal of Experimental Psychology: Applied, vol. 10, no. 2, pp. 120–113, 2004. View at Publisher · View at Google Scholar
  25. H. O. Knoche, J. D. McCarthy, and M. A. Sasse, “Reading the fine print: the effect of text legibility on perceived video quality in mobile tv,” in Proceedings of the 14th Annual ACM International Conference on Multimedia (MULTIMEDIA '06), pp. 727–730, Santa Barbara, Calif, USA, October 2006. View at Publisher · View at Google Scholar
  26. A. Köpke, A. Willig, and H. Karl, “Chaotic maps as parsimonious bit error models of wireless channels,” in Proceedings of the 22nd Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM '03), vol. 1, pp. 513–523, San Francisco, Calif, USA, March-April 2003. View at Publisher · View at Google Scholar
  27. A. Willig, M. Kubisch, C. Hoene, and A. Wolisz, “Measurements of a wireless link in an industrial environment using an IEEE 802.11-compliant physical layer,” IEEE Transactions on Industrial Electronics, vol. 49, no. 6, pp. 1265–1282, 2002. View at Publisher · View at Google Scholar
  28. I. S. Reed and G. Solomon, “Polynomial codes over certain finite fields,” SIAM Journal of Applied Mathematics, vol. 8, no. 2, pp. 300–304, 1960. View at Publisher · View at Google Scholar
  29. K. Grill-Spector and R. Malach, “The human visual cortex,” Annual Review of Neuroscience, vol. 27, pp. 649–677, 2004. View at Publisher · View at Google Scholar
  30. M. S. Lewicki, “Efficient coding of natural sounds,” Nature Neuroscience, vol. 5, no. 4, pp. 356–363, 2002. View at Publisher · View at Google Scholar
  31. S. T. Fiske and S. E. Taylor, Social Cognition, McGrow-Hill, Singapore, 1991.
  32. U. Neisser, Cognition and Reality: Principles and Implications of Cognitive Psychology, W.H. Freeman, San Francisco, Calif, USA, 1976.
  33. K. Oatley and J. M. Jenkins, Understanding Emotions, Blackwell, Oxford, UK, 2003.
  34. S. Jumisko-Pyykkö, J. Häkkinen, and G. Nyman, “Experienced quality factors: qualitative evaluation approach to audiovisual quality,” in Multimedia on Mobile Devices 2007, vol. 6507 of Proceedings of SPIE, 65070M, pp. 1–12, San Jose, Calif, USA, January 2007. View at Publisher · View at Google Scholar
  35. M. C. Meilgaard, G. V. Civille, and B. T. Carr, Sensory Evaluation Techniques, CRC Press, New York, NY, USA, 1999.
  36. R. G. Picard, “Mobile telephony and broadcasting: are they compatible for consumers,” International Journal of Mobile Communications, vol. 3, no. 1, pp. 19–28, 2005. View at Publisher · View at Google Scholar
  37. R. G. Picard, “Interacting forces in the development of communication technologies,” European Media Management Review, vol. 1, no. 1, pp. 18–24, 1998. View at Google Scholar
  38. F. D. Davis, “Perceived usefulness, perceived ease of use, and user acceptance of information technology,” MIS Quarterly, vol. 13, no. 3, pp. 319–340, 1989. View at Publisher · View at Google Scholar
  39. V. Venkatesh, M. G. Morris, G. B. Davis, and F. D. Davis, “User acceptance of information technology: toward a unified view,” MIS Quarterly, vol. 27, no. 3, pp. 425–478, 2003. View at Google Scholar
  40. M. Amberg, M. Hirschmeier, and J. Wehrmann, “The compass acceptance model for the analysis and evaluation of mobile services,” International Journal of Mobile Communications, vol. 2, no. 3, pp. 248–259, 2004. View at Google Scholar
  41. E. Kaasinen, User acceptance of mobile services—value, ease of use, trust and ease of adoption, Doctoral thesis, VTT Information Technology, Helsinki, Finland, 2005, VTT publications 566.
  42. M. Pagani, “Determinants of adoption of third generation mobile multimedia services,” Journal of Interactive Marketing, vol. 18, no. 3, pp. 46–59, 2004. View at Publisher · View at Google Scholar
  43. G. C. Bruner II and A. Kumar, “Explaining consumer acceptance of handheld Internet devices,” Journal of Business Research, vol. 58, no. 5, pp. 553–558, 2005. View at Publisher · View at Google Scholar
  44. S. Sarker and J. D. Wells, “Understanding mobile handheld device use and adoption,” Communications of the ACM, vol. 46, no. 12, pp. 35–40, 2003. View at Publisher · View at Google Scholar
  45. R. Aldridge, J. Davidoff, M. Ghanbari, D. Hands, and D. Pearson, “Regency effect in the subjective assessment of digitally-coded television pictures,” in Proceedings of the 5th International Conference on Image Processing and Its Applications (ICIP '95), pp. 336–339, Edinburgh, UK, July 1995.
  46. A. D. Baddley, Working Memory, Oxford University Press, New York, NY, USA, 1998.
  47. M. Ries, R. Puglia, T. Tebaldi, O. Nemethova, and M. Rupp, “Audiovisual quality estimation for mobile streaming services,” in Proceedings of the 2nd International Symposium on Wireless Communications Systems (ISWCS '05), pp. 173–177, Siena, Italy, September 2005. View at Publisher · View at Google Scholar
  48. H. Knoche and J. D. McCarthy, “Good news for mobile TV,” in Proceedings of the 14th Wireless World Research Forum Meeting (WWRF14), San Diego, Calif, USA, July 2005.
  49. R. P. Aidridge, D. S. Hands, D. E. Pearson, and N. K. Lodge, “Continuous quality assessment of digitally-coded television pictures,” IEE Proceedings: Vision, Image and Signal Processing, vol. 145, no. 2, pp. 116–123, 1998. View at Publisher · View at Google Scholar
  50. H. de Ridder and R. Hamberg, “Continuous assessment of image quality,” SMPTE Journal, vol. 106, no. 2, pp. 123–128, 1997. View at Google Scholar
  51. R. Hamberg and H. de Ridder, “Time-varying image quality: modeling the relation between instantaneous and overall quality,” SMPTE Journal, vol. 108, no. 11, pp. 802–811, 1999. View at Google Scholar
  52. A. Bouch and M. A. Sasse, “Case for predictable media quality in networked multimedia applications,” in Multimedia Computing and Networking 2000, K. Nahrstedt and W. Feng, Eds., vol. 3969 of Proceedings of SPIE, pp. 188–195, San Jose, Calif, USA, January 2000. View at Publisher · View at Google Scholar
  53. D. S. Hands and S. E. Avons, “Recency and duration neglect in subjective assessment of television picture quality,” Applied Cognitive Psychology, vol. 15, no. 6, pp. 639–657, 2001. View at Publisher · View at Google Scholar
  54. R. T. Apteker, J. A. Fisher, V. S. Kisimov, and H. Neishlos, “Video acceptability and frame rate,” IEEE Multimedia, vol. 2, no. 3, pp. 32–40, 1995. View at Publisher · View at Google Scholar
  55. D. Wijesekera, J. Srivastava, A. Nerode, and M. Foresti, “Experimental evaluation of loss perception in continuous media,” Multimedia Systems, vol. 7, no. 6, pp. 486–499, 1999. View at Publisher · View at Google Scholar
  56. R. Steinmetz, “Human perception of jitter and media synchronization,” IEEE Journal on Selected Areas in Communications, vol. 14, no. 1, pp. 61–72, 1996. View at Publisher · View at Google Scholar
  57. N. Kitawaki, Y. Arayama, and T. Yamada, “Multimedia opinion model based on media interaction of audiovisual communications,” in Proceedings of the 4th International Conference on Measurement of Speech and Audio Quality in Networks (MESAQIN '05), pp. 5–10, Prague, Czech Republic, June 2005.
  58. A. Watson and M. A. Sasse, “The good, the bad, and the muffled: the impact of different degradations on Internet speech,” in Proceedings of the 8th ACM International Conference on Multimedia (MULTIMEDIA '00), pp. 269–276, Los Angeles, Calif, USA, October-November 2000. View at Publisher · View at Google Scholar
  59. R. Pastrana, J. Gicquel, C. Colomes, and H. Cherifi, “Sporadic Signal Loss Impact on Auditory Quality Perception,” 2004, http://wireless.feld.cvut.cz/mesaqin2004/contributions.html.
  60. R. R. Pastrana-Vidal, J. C. Gicquel, C. Colomes, and H. Cherifi, “Sporadic frame dropping impact on quality perception,” in Human Vision and Electronic Imaging IX, vol. 5292 of Proceedings of SPIE, pp. 182–193, San Jose, Calif, USA, January 2004. View at Publisher · View at Google Scholar
  61. ITU-R BT.500-11, “Methodology for the subjective assessment of the quality of television pictures,” International Telecommunications Union - Radiocommunication sector, 2002.
  62. E. M. Rogers, Diffusion of Innovations, Free Press, New York, NY, USA, 5th edition, 2003.
  63. A. Watson and M. A. Sasse, “Measuring perceived quality of speech and video in multimedia conferencing applications,” in Proceedings of the 6th ACM International Conference on Multimedia (MULTIMEDIA '98), pp. 55–60, Bristol, UK, September 1998. View at Publisher · View at Google Scholar
  64. A. Watson and M. A. Sasse, “Evaluating audio and video quality in low-cost multimedia conferencing systems,” Interacting with Computers, vol. 8, no. 3, pp. 255–275, 1996. View at Publisher · View at Google Scholar
  65. C. Carlsson and P. Walden, “Mobile TV—to live or die by content,” in Proceedings of the 40th Annual Hawaii International Conference on System Sciences (HICSS '07), p. 51, Waikoloa, Hawaii, USA, January 2007. View at Publisher · View at Google Scholar
  66. C. Södergård, Ed., “Mobile television—technology and user experiences,” VTT Publications 506, VTT Information Technology, Espoo, Finland, 2003. View at Google Scholar
  67. ETSI, “Digital Video Broadcasting (DVB); Specification for the use of video and audio coding in DVB services delivered directly over IP,” ETSI standard, ETSI TS 102 005 V1.2.0, 2005.
  68. G. Faria, J. A. Henriksson, E. Stare, and P. Talmola, “DVB-H: digital broadcast services to handheld devices,” Proceedings of the IEEE, vol. 94, no. 1, pp. 194–209, 2006. View at Publisher · View at Google Scholar
  69. ETSI, “Digital Video Broadcasting (DVB): Transmission systems for handheld terminals,” ETSI standard, EN 302 304 V1.1.1, 2004.
  70. ETSI, “Digital Video Broadcasting (DVB): DVB specification for data broadcasting,” ETSI standard, EN 301 192 V1.4.1, 2004.
  71. ITU-T P.920, “Interactive test methods for audiovisual communications,” International Telecommunications Union - Telecommunication sector, 2002.
  72. H. Coolican, Research Methods and Statistics in Psychology, J. W. Arrowsmith, London, UK, 4th edition, 2004.
  73. E. A. Styles, The Psychology of Attention, Psychology Press, Hove, UK, 1997.
  74. U. Reiter and S. Jumisko-Pyykkö, “Watch, press, and catch—impact of divided attention on requirements of audiovisual quality,” in Proceedings of the 12th International Conference on Human-Computer Interaction (HCI '07), pp. 943–952, Beijing, China, July 2007. View at Publisher · View at Google Scholar
  75. V. K. Malamal Vadakital, M. M. Hannuksela, M. Rezaei, and M. Gabbouj, “Method for unequal error protection in DVB-H for mobile television,” in Proceedings of the 17th IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC '06), pp. 1–5, Helsinki, Finland, September 2006. View at Publisher · View at Google Scholar
  76. S. Jumisko-Pyykkö, M. V. Vinod Kumar, and J. Korhonen, “Unacceptability of instantaneous errors in mobile television: from annoying audio to video,” in Proceedings of the 8th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '06), pp. 1–8, Helsinki, Finland, September 2006. View at Publisher · View at Google Scholar
  77. R. M. Hogarth and H. J. Einhorn, “Order effects in belief updating: the belief-adjustment model,” Cognitive Psychology, vol. 24, no. 1, pp. 1–55, 1992. View at Publisher · View at Google Scholar