Efthymios Alepis, Maria Virvou, Katerina Kabassi


This paper presents an educational system that incorporates two theories namely SAW and OCC in order to provide an improved affective e-learning environment. Simple additive Weighting (SAW) is used for the recognition of possible emotional states of the users, while the cognitive theory of emotions (OCC) is used for the generation of emotional states by educational agents. The system bases its inferences about users’ emotions on user input evidence from the keyboard and the microphone, as two commonly used modalities of human-computer interaction. The actual combination of evidence from these two modes of interaction has been performed based on a sophisticated inference mechanism for emotions and a multi-attribute decision making theory. At the same time, user action evidence from the two modes of interaction also activates the cognitive mechanisms of the underlying OCC model that proposes emotional behavioural tactics for educational agents who act for pedagogic purposes. The presented educational system provides the important facility to authors to develop tutoring systems that incorporate emotional agents who can be parameterized so as to reflect their vision of teaching behaviour.


  1. Alepis, E., Virvou, M., Kabassi, K., 2007. Knowledge Engineering for Affective Bi-modal Human-Computer Interaction, SIGMAP.
  2. Alepis, ?. & Virvou, ?., 2006. Emotional Intelligence: Constructing user stereotypes for affective bi- modal interaction. In Lecture Notes in Computer Science: “Knowledge-based Intelligent Information and Engineering Systems”, Springer-Verlag Berlin Heidelberg 2006, Volume 4251 LNAI - I, 2006, Pages 435-442
  3. Bernhardt, D., Robinson, P. : Interactive control of music using emotional body expressions, Conference on Human Factors in Computing Systems - Proceedings, pp. 3117-3122 (2008)
  4. Brusilovsky, P., 1999. Adaptive and Intelligent Technologies for Web-based Education. In C. Rollinger and C. Peylo (eds.), Künstliche Intelligenz (4), Special Issue on Intelligent Systems and Teleteaching, 19-25.
  5. Fishburn, P.C., 1967. Additive Utilities with Incomplete Product Set: Applications to Priorities and Assignments, Operations Research.
  6. Goleman, D., 1995. Emotional Intelligence, Bantam Books, New York .
  7. Hwang, C.L., Yoon, K., 1981. Multiple Attribute Decision Making: Methods and Applications. Lecture Notes in Economics and Mathematical Systems 186, Springer, Berlin/Heidelberg/New York.
  8. Jascanu, N., Jascanu, V., Bumbaru, S., 2008. Toward emotional e-commerce: The customer agent, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) Volume 5177 LNAI, Issue PART 1, pp. 202-209
  9. Johnson, W. L, J. Rickel, and Lester, J., 2000. Animated Educational Agents: Face-to-Face Interaction in Interactive Learning Environments. International Journal of Artificial Intelligence in Education, vol. 11, pp. 47-78.
  10. Lane, H.C. 2006. Intelligent Tutoring Systems: Prospects for Guided Practice and Efficient Learning. Whitepaper for the Army's Science of Learning Workshop, Hampton, VA.
  11. Leon, E., Clarke, G., Gallaghan, V., Sepulveda, F., 2007. A user-independent real-time emotion recognition system for software agents in domestic environments. Engineering applications of artificial intelligence, 20 (3): 337-345.
  12. Lester, J., Converse, S., Kahler, S., Barlow, S., Stone, B., and Bhogal, R. 1997. The Persona Effect: affective impact of animated educational agents. In Pemberton S. (Ed.) Human Factors in Computing Systems, CHI' 97, Conference Proceedings, ACM Press, pp. 359-366.
  13. Pantic, M., Rothkrantz, L.J.M., 2003. Toward an affectsensitive multimodal human-cumputer interaction. Vol. 91, Proceedings of the IEEE, Institute of Electrical and Electronics Engineers, pp. 1370-1390.
  14. Picard, R.W., 2003. Affective Computing: Challenges. Int. Journal of Human-Computer Studies, Vol. 59, Issues 1-2, pp. 55-64.
  15. Stathopoulou, I.O., Tsihrintzis, G.A., 2005. Detection and Expression Classification System for Face Images (FADECS), IEEE Workshop on Signal Processing Systems, Athens, Greece.
  16. Virvou, M. & Alepis, E. (2005). Mobile educational features in authoring tools for personalised tutoring. Computers & Education, Volume 44, Issue 1, January 2005, Pages 53-68.

Paper Citation

in Harvard Style

Alepis E., Virvou M. and Kabassi K. (2009). RECOGNITION AND GENERATION OF EMOTIONS IN AFFECTIVE e-LEARNING . In Proceedings of the 4th International Conference on Software and Data Technologies - Volume 2: ICSOFT, ISBN 978-989-674-010-8, pages 273-280. DOI: 10.5220/0002242802730280

in Bibtex Style

author={Efthymios Alepis and Maria Virvou and Katerina Kabassi},
booktitle={Proceedings of the 4th International Conference on Software and Data Technologies - Volume 2: ICSOFT,},

in EndNote Style

JO - Proceedings of the 4th International Conference on Software and Data Technologies - Volume 2: ICSOFT,
SN - 978-989-674-010-8
AU - Alepis E.
AU - Virvou M.
AU - Kabassi K.
PY - 2009
SP - 273
EP - 280
DO - 10.5220/0002242802730280