Identifying Learner’s Engagement in Learning Games - A Qualitative Approach based on Learner’s Traces of Interaction

Patrice Bouvier, Élise Lavoué, Karim Sehaba, Sébastien George

2013

Abstract

This paper proposes a qualitative approach for identifying learners’ engagement from their traces of interactions performed in the learning game. Learners’ engagement is an effective indicator of their motivation, acceptance and attachment to the learning activity. Engagement also informs about the relevance of the content and the effectiveness of the proposed interactive learning game. Designers, practitioners and teachers need information about engagement for analysing, designing and validating the learning game and also for modifying and adapting learning games in order to maintain their effectiveness. Currently, most of the approaches provide quantitative information about learner’s engaged-behaviours. Thus, our objective is to extract qualitative information from learners-generated data. In this paper, we propose an approach in three stages that combines theoretical works on engagement and engaged-behaviours, Activity Theory and Trace Theory. By relying on traces of interactions, this approach enables to identify engaged-behaviours in low-constraint interactive games, directly, continuously, under ecological conditions and over a long time period. Then we present the results of a user study that demonstrate the feasibility and the validity of our approach. This study has been conducted on twelve traces composed of several thousands of learner-generated data.

References

  1. Andersen, E., O'Rourke, E., Liu, Y.-E., Snider, R., Lowdermilk, J., Truong, D., Cooper, S., and Popovic, Z. (2012). The impact of tutorials on games of varying complexity. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 7812, pages 59-68, New York, NY, USA. ACM.
  2. Bardram, J. E. (1997). Plans as situated action: an activity theory approach to workflow systems. In Proceedings of the fifth conference on European Conference on Computer-Supported Cooperative Work, ECSCW'97, pages 17-32. Kluwer Academic Publishers.
  3. Bauckhage, C., Kersting, K., Sifa, R., Thurau, C., Drachen, A., and Canossa, A. (2012). How players lose interest in playing a game: An empirical study based on distributions of total playing times. In S. Lucas, S.-B. Cho, M. S. E., editor, Proceedings of the IEEE Conference on Computational Intelligence and Games (CIG), Granada, Spain.
  4. Beal, C. R., Qu, L., and Lee, H. (2006). Classifying learner engagement through integration of multiple data sources. In Proceedings of the 21st national conference on Artificial intelligence - Volume 1, AAAI'06, pages 151-156. AAAI Press.
  5. Boyle, E. A., Connolly, T. M., Hainey, T., and Boyle, J. M. (2012). Engagement in digital entertainment games: A systematic review. Computers in Human Behavior, 28(3):771-780.
  6. Brien, H. L. O. and Toms, E. G. (2008). What is user engagement ? a conceptual framework for defining user engagement with technology. Journal of the American Society for Information Science, 59(6):938-955.
  7. Brockmyer, J. H., Fox, C. M., Curtiss, K. A., McBroom, E., Burkhart, K. M., and Pidruzny, J. N. (2009). The development of the game engagement questionnaire: A measure of engagement in video game-playing. Journal of Experimental Social Psychology, 45(4):624- 634.
  8. Brown, E. and Cairns, P. (2004). A grounded investigation of game immersion. In CHI 7804 extended abstracts on Human factors in computing systems, CHI EA 7804, pages 1297-1300, New York, NY, USA. ACM.
  9. Canossa, A. and Drachen, A. (2009). Patterns of play: Playpersonas in user-centred game development. In Barry, A., Helen, K., and Tanya, K., editors, Breaking New Ground: Innovation in Games, Play, Practice and Theory: Proceedings of the 2009 Digital Games Research Association Conference, London. Brunel University.
  10. Champalle, O., Sehaba, K., Cosmas, D., Mille, A., and Prié, Y. (2012). Assistance to trainers for the observation and analysis activities of operators trainees on nuclear power plant full-scope simulator. In Xhafa, F., Barolli, L., Pop, F., 0001, X. C., and Cristea, V., editors, International Conference on Intelligent Networking and Collaborative Systems (INCoS 2012), pages 33-40. IEEE Computer Society.
  11. Clauzel, D., Sehaba, K., and Prié, Y. (2011). Enhancing synchronous collaboration by using interactive visualisation of modelled traces. Simulation Modelling Practice and Theory, 19(1):84-97.
  12. Cocea, M. and Weibelzahl, S. (2009). Log file analysis for disengagement detection in e-learning environments. User Modeling and User-Adapted Interaction, 19(4):341-385.
  13. Coleridge, S. T. (1969). The collected works of Samuel Taylor Coleridge. Routledge and K. Paul ; Princeton University Press, [London] : [Princeton] :.
  14. Csikszentmihalyi, M. (1991). Flow: The Psychology of Optimal Experience. Harper Perennial.
  15. de Aguilera, M. and Mendiz, A. (2003). Video games and education: (education in the face of a ”parallel school”). Computers in Entertainment, 1(1):1-10.
  16. Dietterich, T. G. (2002). Machine learning for sequential data: A review. In Proceedings of the Joint IAPR International Workshop on Structural, Syntactic, and Statistical Pattern Recognition, pages 15-30, London, UK. Springer-Verlag.
  17. Dondlinger, M. J. (2007). Educational video game design: A review of the literature. Journal of Applied Educational Technology, 4(1):21-31.
  18. Egenfeldt-Nielsen, S. (2006). Overview of research on the educational use of video games. Digital Kompetanse, 1(3):184-213.
  19. Fredricks, J. A., Blumenfeld, P. C., and Paris, A. H. (2004). School Engagement: Potential of the Concept, State of the Evidence. Review of Educational Research, 74:59-109.
  20. Fredricks, J. A. and McColskey, W. (2012). The measurement of student engagement: A comparative analysis of various methods and student self-report instruments. In Christenson, S. L., Reschly, A. L., and Wylie, C., editors, Handbook of Research on Student Engagement, pages 763-782. Springer US.
  21. Gee, J. P. (2003). What video games have to teach us about learning and literacy. Computers in Entertainment, 1(1):20-20.
  22. Greenhow, C., Robelia, B., and Hughes, J. E. (2009). Learning, Teaching, and Scholarship in a Digital Age: Web 2.0 and Classroom Research-What Path Should We Take ”Now”? Educational Researcher, 38(4):246- 259.
  23. Jennett, C., Cox, A. L., Cairns, P., Dhoparee, S., Epps, A., Tijs, T., and Walton, A. (2008). Measuring and defining the experience of immersion in games. International Journal of Human-Computer Studies, 66(9):641-661.
  24. Kaptelinin, V. (2005). The object of activity: Making sense of the sense-maker. Mind, Culture, and Activity, 12(1):4-18.
  25. Kaptelinin, V. and Nardi, B. A. (2006). Acting with Technology: Activity Theory and Interaction Design. The MIT Press.
  26. Kivikangas, J. M., Chanel, G., Cowley, B., Ekman, I., Salminen, M., Jrvel, S., and Ravaja, N. (2011). A review of the use of psychophysiological methods in game research. Journal of Gaming and Virtual Worlds, 3(3):181-199.
  27. Köck, M. and Paramythis, A. (2011). Activity sequence modelling and dynamic clustering for personalized elearning. User Modeling and User-Adapted Interaction, 21(1-2):51-97.
  28. Lazzaro, N. (2004). Why We Play Games: Four Keys to More Emotion Without Story. In Game Developers Conference.
  29. Leontiev, A. N. (1978). Activity, consciousness and personality. Prentice Hall, Englewood Cliffs, NJ.
  30. Prensky, M. (2007). Paragon House.
  31. Przybylski, A. K., Rigby, C. S., and Ryan, R. M. (2010). A motivational model of video game engagement. Review of General Psychology, 14(2):154-166.
  32. Reeve, J., Jang, H., Carrell, D., Jeon, S., and Barch, J. (2004). Enhancing students' engagement by increasing teachers' autonomy support. Motivation and Emotion, 28:147-169.
  33. Reschly, A. L. and Christenson, S. L. (2006). Research leading to a predictive model of dropout and completion among students with mild disabilities and the role of student engagement. Remedial and Special Education, 27:276-292.
  34. Romero, C. and Ventura, S. (2010). Educational data mining: a review of the state of the art. Transactions on Systems, Man, and Cybernetics-Part C: Applications and Reviews, 40(6):601-618.
  35. Ryan, R. M. and Deci, E. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. The American psychologist, 55:68-78.
  36. Settouti, L. S., Prié, Y., Marty, J.-C., and Mille, A. (2009). A trace-based system for technology-enhanced learning systems personalisation. In Proceedings of the 2009 Ninth IEEE International Conference on Advanced Learning Technologies, ICALT 7809, pages 93- 97, Washington, DC, USA. IEEE Computer Society.
  37. Skinner, E. A. and Belmont, M. J. (1993). Motivation in the classroom: Reciprocal effects of teacher behavior and student engagement across the school year. Journal of Educational Psychology, 85(4):571-581.
  38. Tamborini, R. and Skalski, P. (2006). The role of presence in the experience of electronic games. In Vorderer, P. and Bryant, J., editors, Playing video games - motives, responses, and consequences, pages 225-240. Lawrence Erlbaum.
  39. Vygotsky, L. (1978). Mind in Society: The Development of Higher Psychological Processes. Harvard University Press, Cambridge, MA.
  40. Weber, B. G., Mateas, M., and Jhala, A. (2011). Using data mining to model player experience. In FDG Workshop on Evaluating Player Experience in Games, Bordeaux, France. ACM, ACM.
  41. Yee, N. (2006). Motivations for play in online games. Cyberpsychology and Behavior, 9(6):772-775.
Download


Paper Citation


in Harvard Style

Bouvier P., Lavoué É., Sehaba K. and George S. (2013). Identifying Learner’s Engagement in Learning Games - A Qualitative Approach based on Learner’s Traces of Interaction . In Proceedings of the 5th International Conference on Computer Supported Education - Volume 1: CSEDU, ISBN 978-989-8565-53-2, pages 339-350. DOI: 10.5220/0004386903390350


in Bibtex Style

@conference{csedu13,
author={Patrice Bouvier and Élise Lavoué and Karim Sehaba and Sébastien George},
title={Identifying Learner’s Engagement in Learning Games - A Qualitative Approach based on Learner’s Traces of Interaction},
booktitle={Proceedings of the 5th International Conference on Computer Supported Education - Volume 1: CSEDU,},
year={2013},
pages={339-350},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004386903390350},
isbn={978-989-8565-53-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 5th International Conference on Computer Supported Education - Volume 1: CSEDU,
TI - Identifying Learner’s Engagement in Learning Games - A Qualitative Approach based on Learner’s Traces of Interaction
SN - 978-989-8565-53-2
AU - Bouvier P.
AU - Lavoué É.
AU - Sehaba K.
AU - George S.
PY - 2013
SP - 339
EP - 350
DO - 10.5220/0004386903390350