Advances in Human-Computer Interaction
Volume 2010 (2010), Article ID 209801, 13 pages
doi:10.1155/2010/209801
Research Article

EmoHeart: Conveying Emotions in Second Life Based on Affect Sensing from Text

Alena Neviarouskaya,1 Helmut Prendinger,2 and Mitsuru Ishizuka1

1Department of Information and Communication Engineering, University of Tokyo, R. 111C1/111D2, Engineering Building 2, 11th floor, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656, Japan
2Digital Content and Media Sciences Research Division, National Institute of Informatics, 1613-1B, 16 floor, 2-1-2 Hitotsubashi, Chiyoda-ku, Tokyo 101-8430, Japan

Received 1 April 2009; Accepted 28 September 2009

Academic Editor: Kostas Karpouzis

Copyright © 2010 Alena Neviarouskaya et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. S. Planalp, Communicating Emotion: Social, Moral, and Cultural Processes, Cambridge University Press, Cambridge, UK, 1999.
  2. P. Ekman, “Facial expression and emotion,” American Psychologist, vol. 48, no. 4, pp. 384–392, 1993.
  3. A. J. Fridlund, “The behavioral ecology and sociality of human faces,” Review of Personality and Social Psychology, vol. 13, pp. 90–121, 1992.
  4. U. Dimberg and A. Ohman, “Behold the wrath: psychophysiological responses to facial stimuli,” Motivation and Emotion, vol. 20, no. 2, pp. 149–182, 1996.
  5. D. Keltner, P. Ekman, G. C. Gonzaga, and J. Beer, “Facial expression of emotion,” in Handbook of Affective Science, R. J. Davidson, K. R. Scherer, and H. H. Goldsmith, Eds., pp. 415–432, Oxford University Press, New York, NY, USA, 2003.
  6. N. Frijda, The Emotions, Studies in Emotion and Social Interaction, Cambridge University Press, Cambridge, UK, 1986.
  7. N. Frijda, “Emotions are functional, most of the time,” in The Nature of Emotion: Fundamental Questions, P. Ekman and R. J. Davidson, Eds., Oxford University Press, New York, NY, USA, 1994.
  8. C. Lutz, Unnatural Emotions, University of Chicago Press, Chicago, Ill, USA, 1988.
  9. J. Allwood, “Bodily communication dimensions of expression and content,” in Multimodality in Language and Speech Systems, pp. 7–26, Kluwer Academic Publishers, Dordrecht, The Netherlands, 2002.
  10. J. Reilly and L. Seibert, “Language and emotion,” in Handbook of Affective Science, R. J. Davidson, K. R. Scherer, and H. H. Goldsmith, Eds., pp. 535–559, Oxford University Press, New York, NY, USA, 2003.
  11. R. Peris, M. A. Gimeno, D. Pinazo, et al., “Online chat rooms: virtual spaces of interaction for socially oriented people,” Cyberpsychology and Behavior, vol. 5, no. 1, pp. 43–51, 2002. View at Publisher · View at Google Scholar
  12. Y. Hu, J. F. Wood, V. Smith, and N. Westbrook, “Friendships through IM: examining the relationship between instant messaging and intimacy,” Journal of Computer-Mediated Communication, vol. 10, no. 1, article 6, 2004.
  13. M. Chayko, Connecting: How We Form Social Bonds and Communities in the Internet Age, State University of New York Press, Albany, NY, USA, 2002.
  14. J. Fernback and B. Thompson, “Virtual Communities: Abort, Retry, Failure?” 2004, http://www.well.com/user/hlr/texts/VCcivil.html.
  15. H. Rheingold, The Virtual Community, MIT Press, Cambridge, Mass, USA, 2002.
  16. E. M. Reid, Electropolis: communication and community on Internet relay chat, Honours thesis, University of Melbourne, Melbourne, Australia, 1991.
  17. D. Derks, Exploring the missing wink: emoticons in cyberspace, Ph.D. dissertation, Open University of Netherlands, Leiderdorp, The Netherlands, 2007.
  18. J. B. Walther and K. P. D'Addario, “The impacts of emoticons on message interpretation in computer-mediated communication,” Social Science Computer Review, vol. 19, no. 3, pp. 324–347, 2001.
  19. O.T. Yigit, Emoticon usage in task-oriented and socio-emotional contexts in online discussion board, M.S. thesis, The Florida State University, Tallahassee, Fla, USA, 2005.
  20. K. Rivera, N. J. Cooke, and J. A. Bauhs, “The effects of emotional icons on remote communication,” in Proceedings of the Conference Companion on Human Factors in Computing Systems (CHI '96), pp. 99–100, Vancouver, Canada, April 1996.
  21. P. Persson, “ExMS: an animated and avatar-based messaging system for expressive peer communication,” in Proceedings of the International ACM SIGGROUP Conference on Supporting Group Work, pp. 31–39, Sanibel Island, Fla, USA, November 2003.
  22. R. Picard, Affective Computing, MIT Press, Cambridge, Mass, USA, 1997.
  23. G. Rigas, C. D. Katsis, G. Ganiatsas, and D. I. Fotiadis, “A user independent, biosignal based, emotion recognition method,” in Proceedings of the 11th International Conference on User Modeling, pp. 314–318, Springer, Corfu, Greece, June 2007.
  24. K. Slot, J. Cichosz, and L. Bronakowski, “Emotion recognition with poincare mapping of voiced-speech segments of utterances,” in Proceedings of 9th International Conference on Artificial Intelligence and Soft Computing (ICAISC '08), pp. 886–895, Springer, Zakopane, Poland, June 2008.
  25. C.-H. Wu, J.-F. Yeh, and Z.-J. Chuang, “Emotion perception and recognition from speech,” in Affective Information Processing, J. Tao and T. Tan, Eds., pp. 93–110, Springer, London, UK, 2009.
  26. I. Maglogiannis, D. Vouyioukas, and C. Aggelopoulos, “Face detection and recognition of natural human emotion using Markov random fields,” Personal and Ubiquitous Computing, vol. 13, no. 1, pp. 95–101, 2009. View at Publisher · View at Google Scholar
  27. F. Di Fiore, P. Quax, C. Vanaken, W. Lamotte, and F. Van Reeth, “Conveying emotions through facially animated avatars in networked virtual environments,” in Proceedings of the 1st International Workshop on Motion in Games (MIG '08), vol. 5277 of Lecture Notes in Computer Science, pp. 222–233, Springer, Utrecht, The Netherlands, June 2008.
  28. G. Castellano, L. Kessous, and G. Caridakis, “Emotion recognition through multiple modalities: face, body gesture, speech,” in Affect and Emotion in Human-Computer Interaction, C. Peter and R. Beale, Eds., vol. 4868 of Lecture Notes in Computer Science, pp. 92–103, Springer, Heidelberg, Germany, 2008.
  29. P. D. Turney and M. L. Littman, “Measuring praise and criticism: inference of semantic orientation from association,” ACM Transactions on Information Systems, vol. 21, no. 4, pp. 315–346, 2003. View at Publisher · View at Google Scholar
  30. A. Andreevskaia and S. Bergler, “Mining WordNet for fuzzy sentiment: sentiment tag extraction from WordNet glosses,” in Proceedings of the 11th Conference of the European Chapter of the Association for Computational Linguistics, pp. 209–216, Trento, Italy, April 2006.
  31. A. Esuli and F. Sebastiani, “SentiWordNet: a publicly available lexical resource for opinion mining,” in Proceedings of the 5th International Conference on Language Resources and Evaluation, pp. 417–422, Genoa, Italy, May 2006.
  32. S.-M. Kim and E. Hovy, “Determining the sentiment of opinions,” in Proceedings of the 20th International Conference on Computational Linguistics, pp. 1367–1373, Geneva, Switzerland, August 2004.
  33. T. Mullen and N. Collier, “Sentiment analysis using support vector machines with diverse information sources,” in Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP '04), pp. 412–418, Barcelona, Spain, July 2004.
  34. D. Nadeau, C. Sabourin, J. De Koninck, S. Matwin, and P. D. Turney, “Automatic dream sentiment analysis,” in Proceedings of the 21st National Conference on Artificial Intelligence (AAAI '06), Boston, Mass, USA, July 2006.
  35. T. Nasukawa and J. Yi, “Sentiment analysis: capturing favorability using natural language processing,” in Proceedings of 2nd International Conference on Knowledge Capture, pp. 70–77, Sanibel Island, Fla, USA, October 2003.
  36. K. Moilanen and S. Pulman, “Sentiment composition,” in Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP '07), pp. 378–382, Borovets, Bulgaria, September 2007.
  37. T. Wilson, J. Wiebe, and P. Hoffmann, “Recognizing contextual polarity in phrase-level sentiment analysis,” in Proceedings of Human Language Technology Conference on Empirical Methods in Natural Language Processing (HLT/EMNLP '05), pp. 347–354, Vancouver, Canada, October 2005.
  38. J. Olveres, M. Billinghurst, J. Savage, and A. Holden, “Intelligent, expressive avatars,” in Proceedings of the 1st Workshop on Embodied Conversational Characters (WECC '98), pp. 47–55, Tahoe City, Calif, USA, October 1998.
  39. C. Strapparava, A. Valitutti, and O. Stock, “Dances with words,” in Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI '07), pp. 1719–1724, Hyderabad, India, January 2007.
  40. A. C. Boucouvalas, “Real time text-to-emotion engine for expressive Internet communications,” in Being There: Concepts, Effects and Measurement of User Presence in Synthetic Environments, pp. 306–318, IOS Press, Amsterdam, The Netherlands, 2003.
  41. H. Liu, H. Lieberman, and T. Selker, “A model of textual affect sensing using real-world knowledge,” in Proceedings of International Conference on Intelligent User Interfaces (IUI '03), pp. 125–132, Miami, Fla, USA, 2003.
  42. M. Mulder, A. Nijholt, M. den Uyl, and P. Terpstra, “A lexical grammatical implementation of affect,” in Proceedings of the 7th International Conference on Text, Speech and Dialogue (TSD '04), pp. 171–178, Brno, Czech Republic, September 2004.
  43. C. O. Alm, Affect in text and speech, Ph.D. dissertation, University of Illinois, Urbana, Ill, USA, 2008.
  44. A. Neviarouskaya, H. Prendinger, and M. Ishizuka, “User study of AffectIM, an emotionally intelligent instant messaging system,” in Proceedings of 8th International Conference on Intelligent Virtual Agents (IVA '08), pp. 29–36, Tokyo, Japan, September 2008.
  45. A. Neviarouskaya, H. Prendinger, and M. Ishizuka, “Textual affect sensing for sociable and expressive online communication,” in Proceedings of the 2nd International Conference on Affective Computing and Intelligent Interaction, vol. 4738 of Lecture Notes in Computer Science, pp. 218–229, 2007.
  46. C. E. Izard, Human Emotions, Plenum Press, New York, NY, USA, 1977.
  47. C. Strapparava and A. Valitutti, “WordNet-Affect: an affective extension of WordNet,” in Proceedings of 4th International Conference on Language Resources and Evaluation (LREC '04), pp. 1083–1086, Lisbon, Portugal, May 2004.
  48. A. Neviarouskaya, H. Prendinger, and M. Ishizuka, “Analysis of affect expressed through the evolving language of online communication,” in Proceedings of the International Conference on Intelligent User Interfaces, pp. 278–281, ACM Press, Honolulu, Hawaii, USA, January 2007.
  49. D. Klein and C. D. Manning, “Fast exact inference with a factored model for natural language parsing,” in Advances in Neural Information Processing Systems, vol. 15, pp. 3–10, MIT Press, Cambridge, Mass, USA, 2003.
  50. S. Aman and S. Szpakowicz, “Using Roget's thesaurus for fine-grained emotion recognition,” in Proceedings of the 3rd International Joint Conference on Natural Language Processing (IJCNLP '08), pp. 296–302, Hyderabad, India, January 2008.
  51. S. Aman and S. Szpakowicz, “Identifying expressions of emotion in text,” in Proceedings of the 10th International Conference on Text, Speech and Dialogue, vol. 4629 of Lecture Notes in Computer Science, pp. 196–205, Springer, Plzen, Czech Republic, September 2007.
  52. M. Jarmasz and S. Szpakowicz, “The design and implementation of an electronic lexical knowledge base,” in Proceedings of the 14th Biennial Conference of the Canadian Society for Computational Studies of Intelligence (AI '01), pp. 325–333, Ottawa, Canada, June 2001.
  53. C. E. Izard, The Face of Emotion, Appleton-Century-Crofts, New York, NY, USA, 1971.
  54. L. Harker and D. Keltner, “Expressions of positive emotion in women's college yearbook pictures and their relationship to personality and life outcomes across adulthood,” Journal of Personality and Social Psychology, vol. 80, no. 1, pp. 112–124, 2001. View at Publisher · View at Google Scholar