About this Journal Submit a Manuscript Table of Contents
Advances in Human-Computer Interaction
Volume 2011 (2011), Article ID 206983, 18 pages
http://dx.doi.org/10.1155/2011/206983
Research Article

Modeling Reader's Emotional State Response on Document's Typographic Elements

Department of Informatics and Telecommunications, National and Kapodistrian University of Athens, Panepistimiopolis, 157 84 Athens, Greece

Received 30 July 2010; Revised 31 January 2011; Accepted 25 March 2011

Academic Editor: Kerstin S. Eklundh

Copyright © 2011 Dimitrios Tsonos and Georgios Kouroupetroglou. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. F. Fourli-Kartsouni, K. Slavakis, G. Kouroupetroglou, and S. Theodoridis, “A Bayesian network approach to semantic labelling of text formatting in XML corpora of documents,” in Proceedings of the Human-Computer Interaction International (HCII '07), vol. 4556 of Lecture Notes in Computer Science (LNCS), pp. 299–308, 2007.
  2. G. Xydas and G. Kouroupetroglou, “Text-to-speech scripting interface for appropriate vocalisation of e-texts,” in Proceedings of the European Conference on Speech Communication and Technology (EUROSPEECH '01), pp. 2247–2250, 2001.
  3. G. Xydas and G. Kouroupetroglou, “Augmented auditory representation of e-texts for text-to-speech systems,” in Proceedings of the 4th International Conference on Text, Speech and Dialogue (TSD '01), vol. 2166 of Lecture Notes in Artificial Intelligence (LNAI), pp. 134–141, 2001.
  4. G. Xydas, D. Spiliotopoulos, and G. Kouroupetroglou, “Modelling emphatic events from non-speech aware documents in speech based user interfaces,” in Proceedings of the 10th International Conference on Human-Computer Interaction (HCII '03), pp. 806–810, Lawrence Erlbaum Associates, Mahwah, NJ, USA, 2003.
  5. G. Xydas, V. Argyropoulos, T. Karakosta, and G. Kouroupetroglou, “An experimental approach in recognizing synthesized auditory components in a non-visual interaction with documents,” in Proceedings of the 11th International Conference on Human-Computer Interaction (HCII '05), vol. 3, pp. 411–420, Las Vegas, Nev, USA, 2005.
  6. D. Spiliotopoulos, G. Xydas, G. Kouroupetroglou, V. Argyropoulos, and K. Ikospentaki, “Auditory universal accessibility of data tables using naturally derived prosody specification,” Universal Access in the Information Society, vol. 9, no. 2, pp. 169–183, 2010. View at Publisher · View at Google Scholar · View at Scopus
  7. D. Spiliotopoulos, G. Xydas, G. Kouroupetroglou, and V. Argyropoulos, “Experimentation on spoken format of tables in auditory user interfaces,” in Proceedings of the 11th International Conference on Human-Computer Interaction (HCII '05), pp. 361–370, Las Vegas, Nev, USA, 2005.
  8. D. Spiliotopoulos, G. Xydas, and G. Kouroupetroglou, “Diction based prosody modeling in table-to-speech synthesis,” in Proceedings of the International Conference on Text, Speech and Dialogue (TSD '05), vol. 3658 of Lecture Notes in Computer Science (LNCS), pp. 294–301, 2005.
  9. G. Kouroupetroglou and D. Tsonos, “Multimodal accessibility of documents,” in Advances in Human-Computer Interaction, pp. 451–470, I-Tech Education and Publishing, Vienna, Austria, 2008.
  10. G. Kouroupetroglou, D. Tsonos, and E. Vlahos, “DocEmoX: a system for the typography-derived emotional annotation of documents,” in Proceedings of the International Conference on Universal Access in Human-Computer Interaction, vol. 5616 of Lecture Notes in Computer Science (LNCS), pp. 550–558, 2009.
  11. D. Tsonos and G. Kouroupetroglou, “Accessibility of board and presentations in the classroom: a design-for-all approach,” in Proceedings of the 4th IASTED International Conference on Telehealth and Assistive Technologies (TAT '08), pp. 13–18, ACTA Press, April 2008. View at Scopus
  12. D. Tsonos, K. Ikospentaki, and G. Kouroupetrolgou, “Towards modeling of readers' emotional state response for the automated annotation of documents,” in Proceedings of the IEEE World Congress on Computational Intelligence (WCCI '08), pp. 3253–3260, Hong Kong, 2008. View at Publisher · View at Google Scholar
  13. D. Freitas and G. Kouroupetroglou, “Speech technologies for blind and low vision persons,” Technology and Disability, vol. 20, no. 2, pp. 135–156, 2008. View at Scopus
  14. K. Fellbaum and G. Koroupetroglou, “Principles of electronic speech processing with applications for people with disabilities,” Technology and Disability, vol. 20, no. 2, pp. 55–85, 2008. View at Scopus
  15. M. McLuhan and Q. Fiore, The Medium is the Message, Gingko Press, Berkeley, Calif, USA, 2005.
  16. O. Briggs, S. Champeon, E. Costello, and M. Patterson, Cascading Style Sheets: Separating Content from Presentation, Friends of ED, 2nd edition, 2004.
  17. W. Tracy, Letters of Credit: A View of Type Design, Gordon Fraser, Jersey City, NJ, USA, 1986.
  18. P. Ekman, “An argument for basic emotions,” Cognition and Emotion, vol. 6, no. 3, pp. 169–200, 1992.
  19. M. M. Bradley, “Measuring emotion: the self-assessment manikin and the semantic differential,” Journal of Behavior Therapy and Experimental Psychiatry, vol. 25, no. 1, pp. 49–59, 1994. View at Publisher · View at Google Scholar
  20. M. M. Bradley and P. J. Lang, “Affective reactions to acoustic stimuli,” Psychophysiology, vol. 37, no. 2, pp. 204–215, 2000. View at Publisher · View at Google Scholar
  21. C. Dormann, “Affective experiences in the home: measuring emotions,” in Proceedings of the International Conference on Home Oriented Informatics and Telematics (HOIT '03), Calif, USA, 2003.
  22. T. Partala and V. Surakka, “The effects of affective interventions in human-computer interaction,” Interacting with Computers, vol. 16, no. 2, pp. 295–309, 2004. View at Publisher · View at Google Scholar
  23. K. R. Scherer, “What are emotions? and how can they be measured?” Social Science Information, vol. 44, no. 4, pp. 693–727, 2005. View at Publisher · View at Google Scholar
  24. R. W. Picard, “Affective computing,” Tech. Rep. 321, M.I.T Media Laboratory Perceptual Computing Section, 1995.
  25. P. J. Lang, “The cognitive psychophysiology of emotion: fear and anxiety,” in Anxiety and the Anxiety Disorder, A. Tuma and J. Maser, Eds., pp. 131–170, Lawrence Erlbaum, Mahwah, NJ, USA, 1985.
  26. J. D. Morris, “Observations SAM: the self-assessment manikin- An efficient cross-cultural measurement of emotional response,” Journal of Advertising Research, pp. 63–68, 1995.
  27. R. P. Bagozzi, M. Gopinath, and P. U. Nyer, “The role of emotions in marketing,” Journal of the Academy of Marketing Science, vol. 27, no. 2, pp. 184–206, 1999.
  28. J. Posner, J. A. Russell, and B. S. Peterson, “The circumplex model of affect: an integrative approach to affective neuroscience, cognitive development, and psychopathology,” Development and Psychopathology, vol. 17, no. 3, pp. 715–734, 2005. View at Publisher · View at Google Scholar · View at PubMed
  29. T. Bänziger, V. Tran, and K. Scherer, “The Geneva Emotion Wheel: a tool for the verbal report of emotional reactions,” in Proceedings of the Conference of the International Society for Research on Emotions (ISRE '05), Bari, Italy, 2005.
  30. A. C. Boucouvalas, “Real time text-to-emotion engine for expressive Internet communications,” in Being There: Concepts, Effects and Measurement of User Presence in Synthetic Environments, G. Riva, F. Davide, and W. IJsselsteijn, Eds., vol. 5 of Emerging Communication: Studies on New Technologies and Practices in Communication, pp. 306–318, IOS Press, Amsterdam, The Netherlands, 2003.
  31. X. Zhe, D. John, and A. C. Boucouvalas, “Text-to-Emotion Engine: tests of user preferences,” in Proceedings of the EEE International Symposium on Consumer, 2002.
  32. H. Liu, H. Lieberman, and T. Selker, “A model of textual affect sensing using real-world knowledge,” in Proceedings of the International Conference on Intelligent User Interfaces, pp. 125–132, Miami, Fla, USA, January 2003.
  33. C.-H. Wu, Z.-J. Chuang, and Y.-C. Lin, “Emotion recognition from text using semantic labels and separable mixture models,” ACM Transactions on Asian Language Information Processing, vol. 5, no. 2, pp. 165–182, 2006. View at Publisher · View at Google Scholar
  34. H. J. Min and J. C. Park, “Representing emotions with linguistic acuity,” in Proceedings of the Conference on Intelligent Text Processing and Computational Linguistics, vol. 4394 of Lecture Notes in Computer Science (LNCS), pp. 348–360, 2007.
  35. Z. Yang, L. Li, and D. Zhang, “Embodiment of text based on virtual robotic avatar,” in Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO '07), pp. 1285–1289, December 2007. View at Publisher · View at Google Scholar
  36. A. J. Gill, D. Gergle, R. M. French, and J. Oberlander, “Emotion rating from short blog texts,” in Proceedings of the 26th Annual SIGCHI Conference on Human Factors in Computing Systems (CHI '08), pp. 1121–1124, ACM Press, New York, NY, USA, 2008.
  37. J. T. Hancock, C. Landrigan, and C. Silver, “Expressing emotion in text-based communication,” in Proceedings of the 25th SIGCHI Conference on Human Factors in Computing Systems (CHI '07), pp. 929–932, ACM Press, New York, NY, USA, May 2007. View at Publisher · View at Google Scholar
  38. C. O. Alm, Affect in text and speech, Ph.D. thesis, VDM Verlag Dr. Müller, Saarbrücken, Germany, 2009.
  39. J. Read, “Using emoticons to reduce dependency in machine learning techniques for sentiment classification,” in Proceedings of the Association for Computational Linguistics Student Research Workshop (ACL '05), pp. 43–48, 2005.
  40. R. Cowie, E. Douglas-Cowie, B. Appolloni, J. Taylor, A. Romano, and W. Fellenz, “What a neural net needs to know about emotion words,” in Computational Intelligence and Applications, N. Mastorakis, Ed., pp. 109–114, World Scientific & Engineering Society Press, River Edge, NJ, USA, 1999.
  41. S. Owsley, S. Sood, and J. K. Hammond, “Domain specific affective classification of documents,” in Proceedings of the AAAI of the Spring Symposia on Computational Approaches to Analyzing Weblogs (CAAW '06), 2006.
  42. K. H. Y. Lin, C. Yang, and H. H. Chen, “What emotions do news articles trigger in their readers?” in Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '07), pp. 733–734, ACM Press, New York, NY, USA, July 2007. View at Publisher · View at Google Scholar
  43. C. B. Mills and L. J. Weldon, “Reading Text from computer screens,” Computing Surveys, vol. 19, no. 4, pp. 329–357, 1987.
  44. V. Eglin and S. Bres, “Document page similarity based on layout visual saliency: application to query by example and document classification,” in Proceedings of the 7th International Conference on Document Analysis and Recognition (ICDAR '03), vol. 2, p. 1208, IEEE Computer Society, 2003.
  45. R. H. Hall and P. Hanna, “The impact of web page text-background colour combinations on readability, retention, aesthetics and behavioural intention,” Behaviour and Information Technology, vol. 23, no. 3, pp. 183–195, 2004. View at Publisher · View at Google Scholar
  46. M. C. Dyson and G. J. Kipping, “The legibility of screen formats: are three columns better than one?” Computers and Graphics, vol. 21, no. 6, pp. 703–712, 1997.
  47. N. Holmberg, Eye movement patterns and newspaper design factors. An experimental approach, M.S. thesis, Lund University Cognitive Science, Lund, Sweden, 2004.
  48. K. Holmqvist and C. Wartenberg, “The role of local design factors for newspaper reading behaviour—an eye-tracking respective,” Lund University Cognitive Studies, vol. 127, pp. 1–21, 2005.
  49. C. Wartenberg and K. Holmqvist, Daily Newspaper Layout—Designers’ Predictions of Readers’ Visual Behaviour—A Case Study, Lund University Cognitive Studies, Lund, Sweden, 2005.
  50. A. Hill and L. V. Scharff, “Readability of screen displays with various foreground/background color combinations, font styles, and font types,” in Proceedings of the 11th National Conference on Undergraduate Research (NCUR '97), vol. 2, pp. 742–746, Austin, Tex, USA, 1997.
  51. S. J. Harrington, P. Roetling, J. F. Naveda, R. P. Jones, and N. Thakkar, “Aesthetic measures for automated document layout,” in Proceedings of the ACM Symposium on Document Engineering (DocEng '04), pp. 109–111, ACM Press, New York, NY, USA, October 2004.
  52. T. Porat, R. Liss, and N. Tractinsky, “E-stores design: the influence of E-store design and product type on consumers' emotions and attitudes,” in Proceedings of the Human-Computer Interaction (HCII '07), vol. 4553 of Lecture Notes in Computer Science (LNCS), pp. 712–721, 2007.
  53. F. Calisir, M. Eryazici, and M. R. Lehto, “The effects of text structure and prior knowledge of the learner on computer-based learning,” Computers in Human Behavior, vol. 24, no. 2, pp. 439–450, 2008. View at Publisher · View at Google Scholar
  54. J. Borchers, O. Deussen, A. Klingert, and C. Knörzer, “Layout rules for graphical Web documents,” Computers and Graphics, vol. 20, no. 3, pp. 415–426, 1996. View at Publisher · View at Google Scholar
  55. J. Éthier, P. Hadaya, J. Talbot, and J. Cadieux, “Interface design and emotions experienced on B2C Web sites: empirical testing of a research model,” Computers in Human Behavior, vol. 24, no. 6, pp. 2771–2791, 2008. View at Publisher · View at Google Scholar
  56. J. Laarni, “Effects of color, font type and font style on user preferences,” in Proceedings of the Human-Computer Interaction International (HCII '03), C. Stephanidis, Ed., pp. 31–32, Heraklion, Greece, 2003.
  57. F. Birren, Color & Human Response: Aspects of Light and Color, Bearing on the Reactions of Living Things and the Welfare of Human Beings, John Wiley & Sons, New York, NY, USA, 1984.
  58. J. A. Sánchez, I. Kirschning, J. C. Palacio, and Y. Ostróvskaya, “Towards mood-oriented interfaces for synchronous interaction,” in Proceedings of the Latin American Conference on Human-Computer interaction (CLIHC '05), vol. 124, pp. 1–7, ACM Press, New York, NY, USA, 2005. View at Publisher · View at Google Scholar
  59. J. A. Sánchez, N. P. Hernández, J. C. Penagos, and Y. Ostróvskaya, “Conveying mood and emotion in instant messaging by using a two-dimensional model for affective states,” in Proceedings of the 7th Symposium on Human Factors in Computing Systems (IHC '06), pp. 66–72, ACM Press, New York, NY, USA, 2006. View at Publisher · View at Google Scholar
  60. T. Saari, M. Turpeinen, J. Laarni, N. Ravaja, and K. Kallinen, “Emotionally loaded mobile multimedia messaging,” in Proceedings of the 3rd International Conference on Entertainment Computing (ICEC '04), vol. 3166 of Lecture Notes in Computer Science (LNCS), pp. 476–486, Eindhove, The Netherlands, 2004.
  61. K. Larson, “The technology of text,” IEEE Spectrum, vol. 44, no. 5, pp. 26–31, 2007. View at Publisher · View at Google Scholar
  62. A. Kalra and K. Karahalios, “TextTone: expressing emotion through text,” in Proceedings of the International Conference on Human-Computer Interaction (INTERACT '05), vol. 3585 of Lecture Notes in Computer Science (LNCS), pp. 966–969, Rome, Italy, 2005. View at Publisher · View at Google Scholar
  63. J. Ohene-Djan and R. Shipsey, “E- subtitles: emotional subtitles as a technology to assist the deaf and hearing-impaired when learning from television and film,” in Proceedings of the 6th International Conference on Advanced Learning Technologies (ICALT '06), pp. 464–466, July 2006.
  64. J. Ohene-Djan, J. Wright, and K. Combie-Smith, “Emotional subtitles: a system and potential applications for deaf and hearing impaired people,” in Proceedings of the Conference and Workshop on Assistive Technologies for People with Vision and Hearing Impairments: Assistive Technology for All Ages (CVHI '07), p. 415, Granada, Spain, 2007.
  65. A. Yannicopoulou, “Visual aspects of written texts: preschoolers view comics,” L1-Educational Studies in Language and Literature, vol. 4, no. 2-3, pp. 169–181, 2004.
  66. T. Rosenberger, Prosodic font: between the spoken and the written, Master of Media Arts and Sciences Thesis, Massachusetts Institute of Technology, 1988.
  67. T. Rosenberger and R. MacNeil, “Prosodic font: translating speech into graphics,” in Proceedings of the ACM Conference on Computer-Human Interaction, pp. 252–253, Pittsburgh, Pa, USA, 1999.
  68. C. Bernardini, V. Ambrogi, G. Fardella, L. Perioli, and G. Grandolini, “How to improve the readability of the patient package leaflet: a survey on the use of colour, print size and layout,” Pharmacological Research, vol. 43, no. 5, pp. 437–443, 2001. View at Publisher · View at Google Scholar · View at PubMed
  69. M. L. Bernard, B. S. Chaparro, M. M. Mills, and C. G. Halcomb, “Comparing the effects of text size and format on the readibility of computer-displayed Times New Roman and arial text,” International Journal of Human Computer Studies, vol. 59, no. 6, pp. 823–835, 2003. View at Publisher · View at Google Scholar
  70. J. Ling and P. Van Schaik, “The influence of font type and line length on visual search and information retrieval in web pages,” International Journal of Human Computer Studies, vol. 64, no. 5, pp. 395–404, 2006. View at Publisher · View at Google Scholar
  71. W3C, “Techniques for Accessibility Evaluation and Repair Tools,” 2000, http://www.w3.org/TR/AERT#color-contrast.
  72. W3C, Cascading Style Sheets Level 2 Revision 1 (CSS 2.1) Specification, W3C Candidate Recommendation, September 2009, http://www.w3.org/TR/CSS2/syndata.html#values.
  73. K. E. Schmidt, M. Bauerly, Y. Liu, and S. Sridharan, “Web page aesthetics and performance: a survey and an experimental study,” in Proceedings of the 8th Annual International Conference on Industrial Engineering—Theory, Applications and Practice, 2003.
  74. A. Alsumait, A. Al-Osaimi, and H. Alfedaghi, “Arab children's reading preference for different online fonts,” in Proceedings of the International Conference on Human-Computer Interaction (HCII '09), vol. 5613 of Lecture Notes in Computer Science (LNCS), pp. 3–11, 2009.
  75. P. J. Lang, M. Bradley, and B. Culthbert, “International affective picture system (IAPS): instruction manual and affective ratings,” Tech. Rep. A-6, The Center for Research in Psychophysiology, University of Florida, Gainsville, Fla, USA, 2005.
  76. A. Al-Badi and P. Mayhew, “Cultural perception of user interface of a website: comparative study between liberal and prescriptive cultures (Arab vs. British),” in Proceedings of the IADIS International Conference E-Society, Avila, Spain, 2004.
  77. D. Cyr, M. Head, and H. Larios, “Colour appeal in website design within and across cultures: a multi-method evaluation,” International Journal of Human Computer Studies, vol. 68, no. 1-2, pp. 1–21, 2010. View at Publisher · View at Google Scholar
  78. “Origin 8.0,” 2008, http://www.originlab.com/index.aspx?s=8&lm=10.
  79. M. Schröder, “Expressing degree of activation in synthetic speech,” IEEE Transactions on Audio, Speech and Language Processing, vol. 14, no. 4, pp. 1128–1136, 2006. View at Publisher · View at Google Scholar
  80. D. Tsonos and G. Kouroupetroglou, “A methodology for the extraction of reader' s emotional state triggered from text typography,” in Tools in Artificial Intelligence, pp. 439–455, I-Tech Education and Publishing, Vienna, Austria, 2008.