Table of Contents Author Guidelines Submit a Manuscript
Advances in Human-Computer Interaction
Volume 2010, Article ID 319406, 21 pages
http://dx.doi.org/10.1155/2010/319406
Research Article

The SEMAINE API: Towards a Standards-Based Framework for Building Emotion-Oriented Systems

German Research Center for Artificial Intelligence DFKI GmbH, Stuhlsatzenhausweg 3, 66123 Saarbrücken, Germany

Received 25 March 2009; Accepted 11 October 2009

Academic Editor: Anton Batliner

Copyright © 2010 Marc Schröder. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Citations to this Article [54 citations]

The following is the list of published articles that have cited the current article.

  • Marc Schroder, Elisabetta Bevacqua, Roddy Cowie, Florian Eyben, Hatice Gunes, Dirk Heylen, Mark ter Maat, Gary McKeown, Sathish Pammi, Maja Pantic, Catherine Pelachaud, Bjorn Schuller, Etienne de Sevin, Michel Valstar, and Martin Wollmer, “Building autonomous sensitive artificial listeners (Extended abstract),” 2015 International Conference on Affective Computing and Intelligent Interaction (ACII), pp. 456–462, . View at Publisher · View at Google Scholar
  • Florian Nothdurft, and Wolfgang Minker, “Explanation architecture for companion systems,” 2011 IEEE Jordan Conference on Applied Electrical Engineering and Computing Technologies (AEECT), pp. 1–6, . View at Publisher · View at Google Scholar
  • Hatice Gunes, Bjorn Schuller, Maja Pantic, and Roddy Cowie, “Emotion representation, analysis and synthesis in continuous space: A survey,” Face and Gesture 2011, pp. 827–834, . View at Publisher · View at Google Scholar
  • Marc Schroder, Sathish Pammi, Hatice Gunes, Maja Pantic, Michel F. Valstar, Roddy Cowie, Gary McKeown, Dirk Heylen, Mark ter Maat, Florian Eyben, Bjorn Schuller, Martin Wollmer, Elisabetta Bevacqua, Catherine Pelachaud, and Etienne de Sevin, “Come and have an emotional workout with sensitive artificial listeners!,” Face and Gesture 2011, pp. 646–646, . View at Publisher · View at Google Scholar
  • Akinobu Lee, Keiichiro Oura, and Keiichi Tokuda, “Mmdagent—A fully open-source toolkit for voice interaction systems,” 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 8382–8385, . View at Publisher · View at Google Scholar
  • Damith C Herath, Zhengzi Zhang, and N Yadav, “Thinking Head Framework: An open architecture for human centred robotics,” 2010 Fifth International Conference on Information and Automation for Sustainability, pp. 527–532, . View at Publisher · View at Google Scholar
  • Kevin El Haddad, Hüseyin Çakmak, Emer Gilmartin, Stéphane Dupont, and Thierry Dutoit, “Towards a listening agent: a system generating audiovisual laughs and smiles to show interest,” Proceedings of the 18th ACM International Conference on Multimodal Interaction - ICMI 2016, pp. 248–255, . View at Publisher · View at Google Scholar
  • Susana Castillo, Philipp Hahn, Katharina Legde, and Douglas W. Cunningham, “Personality Analysis of Embodied Conversational Agents,” Proceedings of the 18th International Conference on Intelligent Virtual Agents - IVA '18, pp. 227–232, . View at Publisher · View at Google Scholar
  • Herath, Christian Kroos, Catherine J. Stevens, Lawrence Cavedon, and Prashan Premaratne, “Thinking Head: Towards human centred robotics,” 11th International Conference on Control, Automation, Robotics and Vision, ICARCV 2010, pp. 2042–2047, 2010. View at Publisher · View at Google Scholar
  • Berardina De Carolis, Irene Mazzotta, and Nicole Novielli, “Enhancing conversational access to information through a socially intelligent agent,” Studies in Computational Intelligence, vol. 301, pp. 1–20, 2010. View at Publisher · View at Google Scholar
  • Elisabetta Bevacqua, Sathish Pammi, Sylwia Julia Hyniewska, Marc Schröder, and Catherine Pelachaud, “Multimodal backchannels for embodied conversational agents,” Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 6356, pp. 194–200, 2010. View at Publisher · View at Google Scholar
  • Alexis Heloir, Michael Kipp, Marc Schröder, and Patrick Gebhard, “Realizing multimodal behavior: Closing the gap between behavior planning and embodied agent presentation,” Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 6356, pp. 57–63, 2010. View at Publisher · View at Google Scholar
  • Ivana Kruijff-Korbayová, Georgios Athanasopoulos, Aryel Beck, Piero Cosi, Heriberto Cuayáhuitl, Tomas Dekens, Valentin Enescu, Antoine Hiolle, Bernd Kiefer, Hichem Sahli, Marc Schröder, Giacomo Sommavilla, Fabio Tesser, and Werner Verhelst, “An Event-Based Conversational System for the Nao Robot,” Proceedings of the Paralinguistic Information and its Integration in Spoken Dialogue Systems Workshop, pp. 125–132, 2011. View at Publisher · View at Google Scholar
  • Hamdi Dibeklioǧlu, Marcos Ortega Hortas, Ilkka Kosunen, Petr Zuzánek, Albert Ali Salah, and Theo Gevers, “Design and implementation of an affect-responsive interactive photo frame,” Journal on Multimodal User Interfaces, vol. 4, no. 2, pp. 81–95, 2011. View at Publisher · View at Google Scholar
  • Dennis Reidsma, Iwan de Kok, Daniel Neiberg, Sathish Chandra Pammi, Bart van Straalen, Khiet Truong, and Herwin van Welbergen, “Continuous interaction with a virtual human,” Journal on Multimodal User Interfaces, vol. 4, no. 2, pp. 97–118, 2011. View at Publisher · View at Google Scholar
  • José Augusto Prado, Carlos Simplício, and Jorge Dias, “Robot emotional state through Bayesian visuo-auditory perception,” IFIP Advances in Information and Communication Technology, vol. 349, pp. 165–172, 2011. View at Publisher · View at Google Scholar
  • Mirko Otto, Rafael Friesen, and Dietmar Rösner, “Message oriented middleware for flexible Wizard of Oz experiments in HCI,” Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 6761, no. 1, pp. 121–130, 2011. View at Publisher · View at Google Scholar
  • Walter Ritter, “Benefits of subliminal feedback loops in human-computer interaction,” Advances in Human-Computer Interaction, vol. 2011, 2011. View at Publisher · View at Google Scholar
  • Javier Gonzalez-Sanchez, Maria Elena Chavez-Echeagaray, Robert Atkinson, and Winslow Burlesonpp. 187–193, 2011. View at Publisher · View at Google Scholar
  • Elisabetta Bevacqua, Etienne de Sevin, Sylwia Julia Hyniewska, and Catherine Pelachaud, “A listener model: Introducing personality traits,” Journal on Multimodal User Interfaces, vol. 6, no. 1-2, pp. 27–38, 2012. View at Publisher · View at Google Scholar
  • J. Augusto Prado, Carlos Simplício, Nicolás F. Lori, and Jorge Dias, “Visuo-auditory Multimodal Emotional Structure to Improve Human-Robot-Interaction,” International Journal of Social Robotics, vol. 4, no. 1, pp. 29–51, 2012. View at Publisher · View at Google Scholar
  • Alessandro Vinciarelli, Maja Pantic, Dirk Heylen, Catherine Pelachaud, Isabella Poggi, Francesca D'Errico, and Marc Schröder, “Bridging the gap between social animal and unsocial machine: A survey of social signal processing,” IEEE Transactions on Affective Computing, vol. 3, no. 1, pp. 69–87, 2012. View at Publisher · View at Google Scholar
  • Marc Schröder, Maja Pantic, Catherine Pelachaud, Björn Schuller, Etienne De Sevin, Michel Valstar, Martin Wöllmer, Elisabetta Bevacqua, Roddy Cowie, Florian Eyben, Hatice Gunes, Dirk Heylen, Mark Ter Maat, Gary McKeown, and Sathish Pammi, “Building autonomous sensitive artificial listeners,” IEEE Transactions on Affective Computing, vol. 3, no. 2, pp. 165–183, 2012. View at Publisher · View at Google Scholar
  • Margaret Mcrorie, Ian Sneddon, Gary Mckeown, Elisabetta Bevacqua, Etienne De Sevin, and Catherine Pelachaud, “Evaluation of four designed virtual agent personalities,” IEEE Transactions on Affective Computing, vol. 3, no. 3, pp. 311–322, 2012. View at Publisher · View at Google Scholar
  • Dennis Reidsma, and Herwin Van Welbergen, “Elckerlyc in practice - On the integration of a BML realizer in real applications,” Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, vol. 78, pp. 83–92, 2012. View at Publisher · View at Google Scholar
  • Elisabetta Bevacqua, Martin Wöllmer, Florian Eyben, Dirk Heylen, Mark Ter Maat, Sathish Pammi, Catherine Pelachaud, Marc Schröder, Björn Schuller, and Etienne De Sevin, “Interacting with emotional virtual agents,” Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, vol. 78, pp. 243–245, 2012. View at Publisher · View at Google Scholar
  • Dennis Reidsma, and Herwin van Welbergen, “AsapRealizer in practice – A modular and extensible architecture for a BML Realizer,” Entertainment Computing, vol. 4, no. 3, pp. 157–169, 2013. View at Publisher · View at Google Scholar
  • Hatice Gunes, and Björn Schuller, “Categorical and dimensional affect analysis in continuous input: Current trends and future directions,” Image and Vision Computing, vol. 31, no. 2, pp. 120–136, 2013. View at Publisher · View at Google Scholar
  • Ovidiu Serban, and Alexandre Pauchet, “AgentSlang: A fast and reliable platform for Distributed Interactive Systems,” Proceedings - 2013 IEEE 9th International Conference on Intelligent Computer Communication and Processing, ICCP 2013, pp. 35–42, 2013. View at Publisher · View at Google Scholar
  • Fons Kuijk, Julie Wall, Ebroul Izquierdo, Sigurd Van Broeck, Claude Dareau, Brian Ravenet, Magalie Ochs, Konstantinos Apostolakis, Petros Daras, David Monaghan, and Noel E. O'Connor, “A framework for human-like behavior in an immersive virtual world,” 2013 18th International Conference on Digital Signal Processing, DSP 2013, 2013. View at Publisher · View at Google Scholar
  • Javier Gonzalez-Sanchez, “Toward a software product line for affective-driven self-adaptive systems,” Proceedings - International Conference on Software Engineering, pp. 1381–1384, 2013. View at Publisher · View at Google Scholar
  • Frank Honold, Felix Schuessel, Michael Weber, Florian Nothdurft, Gregor Bertrand, and Wolfgang Minkerpp. 57–64, 2013. View at Publisher · View at Google Scholar
  • Frank Honold, Felix Schuessel, Michael Munding, and Michael Weberpp. 278–281, 2013. View at Publisher · View at Google Scholar
  • Giota Stratou, Arno Hartholt, David Traum, Stacy C. Marsella, Ari Shapiro, Anton Leuski, Louis-Philippe Morency, and Jonathan Gratch, “All together now: Introducing the virtual human toolkit,” Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 8108, pp. 368–381, 2013. View at Publisher · View at Google Scholar
  • Magalie Ochs, Ken Prepin, Catherine Pelachaud, Magalie Ochs, Ken Prepin, and Catherine Pelachaud, “From emotions to interpersonal stances: Multi-levels analysis of smiling virtual characters,” 2013 Humaine Association Conference on Affective Computing and Intelligent, pp. 258–263, 2013. View at Publisher · View at Google Scholar
  • Magalie Ochs, and Catherine Pelachaud, “Socially aware virtual characters: The social signal of smiles [social sciences],” IEEE Signal Processing Magazine, vol. 30, no. 2, pp. 128–132, 2013. View at Publisher · View at Google Scholar
  • Magalie Ochs, Catherine Pelachaud, and Ken Prepin, “Social stances by virtual smiles,” International Workshop on Image Analysis for Multimedia Interactive Services, 2013. View at Publisher · View at Google Scholar
  • Frank Honold, Matthias Rau, Gregor Bertrand, Bastian Seegebarth, Peter Kurzok, Bernd Schattenberg, Wolfgang Minker, Michael Weber, Susanne Biundo, Pascal Bercher, Felix Richter, Florian Nothdurft, Thomas Geier, Roland Barth, Thilo Hornle, Felix Schussel, Stephan Reuter, Frank Honold, Pascal Bercher, Felix Richter, Florian Nothdurft, Thomas Geier, Roland Barth, Thilo Hoernle, Felix Schuessel, Stephan Reuter, Matthias Rau, Gregor Bertrand, Bastian Seegebarth, Peter Kurzok, Bernd Schattenberg, Wolfgang Minker, Michael Weber, and Susanne Biundo, “Companion-technology: Towards user- and situation-adaptive functionality of technical systems,” Proceedings - 2014 International Conference on Intelligent Environments, IE 2014, pp. 378–381, 2014. View at Publisher · View at Google Scholar
  • Frank Honold, Felix Schussel, Michael Weber, Frank Honold, Felix Schuessel, and Michael Weher, “The automated interplay of multimodal fission and fusion in adaptive HCI,” Proceedings - 2014 International Conference on Intelligent Environments, IE 2014, pp. 170–177, 2014. View at Publisher · View at Google Scholar
  • Florian Nothdurft, Frank Honold, Kseniya Zablotskaya, Amr Diab, and Wolfgang Minkerpp. 361–364, 2014. View at Publisher · View at Google Scholar
  • Peter Blanchfield, Martin Flintham, Andry Chowanda, and Michel Valstar, “ERiSA: Building emotionally realistic social game-agents companions,” Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 8637, pp. 134–143, 2014. View at Publisher · View at Google Scholar
  • J. Fernando Sánchez-Rada, and Carlos A. Iglesias, “Onyx: A Linked Data approach to emotion representation,” Information Processing & Management, 2015. View at Publisher · View at Google Scholar
  • Michael Glodek, Günther Palm, Friedhelm Schwenker, Frank Honold, Felix Schüssel, Michael Weber, Thomas Geier, Thilo Hörnle, Susanne Biundo, Gerald Krell, Florian Nothdurft, Wolfgang Minker, Stephan Reuter, and Klaus Dietmayer, “Fusion Paradigms in Cognitive Technical Systems for Human-Computer Interaction,” Neurocomputing, 2015. View at Publisher · View at Google Scholar
  • Pedro Alves Nogueira, Luís Filipe Teófilo, and Pedro Brandão Silva, “Multi-modal natural interaction in game design: a comparative analysis of player experience in a large scale role-playing game,” Journal on Multimodal User Interfaces, 2015. View at Publisher · View at Google Scholar
  • Fons Kuijk, Konstantinos C. Apostolakis, Petros Daras, Brian Ravenet, Haolin Wei, and David S. Monaghanpp. 279–287, 2015. View at Publisher · View at Google Scholar
  • J. Alfredo Sanchez, Ximena Cortes, Oleg Starostenko, Ofelia Cervantes, and Wanggen Wan, “An extensible platform for seamless integration and management of applications for emotion sensing and interpretation,” Journal Of Ambient Intelligence And Smart Environments, vol. 7, no. 1, pp. 5–19, 2015. View at Publisher · View at Google Scholar
  • Sánchez-Rada, Vulcu, Iglesias, and Buitelaarpp. 49–69, 2016. View at Publisher · View at Google Scholar
  • Björn W. Schuller, “Acquisition of Affect,” Emotions and Personality in Personalized Services, pp. 57–80, 2016. View at Publisher · View at Google Scholar
  • Mark Sagar, Mike Seymour, and Annette Henderson, “Creating connection with autonomous facial animation,” Communications of the ACM, vol. 59, no. 12, pp. 82–91, 2016. View at Publisher · View at Google Scholar
  • Bruno Crémilleux, Gaël Lejeune, and François Rioult, “Highlighting psychological features for predicting child interjections during story telling,” Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH, vol. 08-12-, pp. 2056–2059, 2016. View at Publisher · View at Google Scholar
  • Louis-Philippe Morency, and Giota Stratou, “MultiSense - Context-Aware Nonverbal Behavior Analysis Framework: A Psychological Distress Use Case,” IEEE Transactions on Affective Computing, vol. PP, no. 99, 2016. View at Publisher · View at Google Scholar
  • Thilo Hörnle, Michael Tornow, Frank Honold, Reinhard Schwegler, Ralph Heinemann, Susanne Biundo, and Andreas Wendemuth, “Companion-Systems: A Reference Architecture,” Companion Technology, pp. 449–469, 2017. View at Publisher · View at Google Scholar
  • Magalie Ochs, Catherine Pelachaud, and Gary McKeown, “A user perception-based approach to create smiling embodied conversational agents,” ACM Transactions on Interactive Intelligent Systems, vol. 7, no. 1, 2017. View at Publisher · View at Google Scholar
  • Boris Galitsky, and Boris Galitsky, “Chatbot Components and Architectures,” Developing Enterprise Chatbots, pp. 13–51, 2019. View at Publisher · View at Google Scholar