Comparing Usability, User Experience and Learning Motivation Characteristics of Two Educational Computer Games

Omar Álvarez-Xochihua, Pedro J. Muñoz-Merino, Mario Muñoz-Organero, Carlos Delgado Kloos, José A. González-Fraga

Abstract

Educational computer games are very popular nowadays and can bring a lot of benefits to improve the learning process. Usability, user experience and learning motivation are important factors in the design of educational computer-based games. Although there are existing educational games designed under these principles, there is a need of comparison between different educational tools in order to try to understand which design criteria can make a tool more successful than another. This work presents the results of a comparison between two competitive educational games. The study was conducted with 41 master students evaluating two competition-based educational computer games. The study, based on quantitative and qualitative data, has shown features that might drive to better usability, user experience and learning motivation. Additionally, we found a strong positive correlation among usability and user experience with learning motivation.

References

  1. Berkman, M. I. and Karahoca, D. (2016). Re-assessing the usability metric for user experience (UMUX) scale. J. Usability Studies 11(3), 89-109.
  2. Brooke, J. (1996). SUS: A "quick and dirty" usability scale. In Jordan, P. W., Thomas, B., Weerdmeester, B. A. and McClelland A. L. (Eds.), Usability Evaluation in Industry. London: Taylor and Francis.
  3. Finstad, K. (2010). The Usability Metric for User Experience. Interact. Comput. 22, 5, 323-327. doi:10.1016/j.intcom.2010.04.004.
  4. Finstad, K. (2013). Response to commentaries on "the usability metric for user experience." Interacting with Computers, 25(4), 327-330.
  5. Frederiksen, N. (1984). Implications of cognitive theory for instruction in problem solving. Review of Educational Research. 54(3), 363-407.
  6. Hassenzahl, M. (2003). The thing and I: understanding the relationship between user and product. In Blythe, M., Overbeeke, C., Monk A. F., and Wright P. C. (Eds), Funology: From Usability to Enjoyment, (pp. 31 - 42). Dordrecht: Kluwer.
  7. Hassenzahl, M., Burmester, M. and Koller, F. (2003). AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität. [AttrakDiff: A questionnaire for the measurement of perceived hedonic and pragmatic quality]. In Ziegler, J., Szwillus, G. (Eds.) Mensch & Computer 2003: Interaktion in Bewegung, Teubner, Stuttgart, Germany, pp. 187-196.
  8. IJsselsteijn, W., Poels, K. and de Kort. Y.A.W. de (2008). The Game Experience Questionnaire: Development of a self-report measure to assess player experiences of digital games. TU Eindhoven, Eindhoven, The Netherlands.
  9. ISO 9241-11 (1998). Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs). Part 11: Guidance on Usability. International Standardization Organization (ISO), Switzerland.
  10. Julian-Mateos, M., Muñoz-Merino, P.J., Hernández-Leo, D., Redondo-Martínez, D., Delgado Kloos, C. (2016). Design and Evaluation of a Computer Based Game for Education. In Proceedings of the Frontiers in Education Conference (FIE'16). Erie, Pennsylvania, USA, 1-8. doi= 10.1109/FIE.2016.7757356.
  11. Lewis, J. R. (2013). Critical review of "the usability metric for user experience." Interacting with Computers, 25(4), 320-324.
  12. Lewis, J. R., Utesch, B. S. and Maher. D. E. (2013). UMUX-LITE: when there's no time for the SUS. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 7813). ACM, New York, NY, USA, 2099-2102. doi:10.1145/2470654.2481287.
  13. Muñoz-Merino, P. J., Fernández-Molina, M., MuñozOrganero, M. and Delgado Kloos, C. (2012). An adaptive and innovative question-driven competitionbased intelligent tutoring system for learning. Expert Systems Appl. 39(8), 6932-6948. Doi=10.1016/j.eswa.2012.01.020.
  14. Pribeanu, C. (2016). Comments on the reliability and validity of UMUX and UMUX-LITE short scales. In Proceedings of the ROCHI Conference in HumanComputer Interaction (ROCHI 7816), Iasi Romania, 2099-2102.
  15. Satar, N. S. M. (2007) Does e-learning usability attributes correlate with learning motivation? In Proceeing of the 21st AAOU Annual Conference, Kuala Lumpur, 29-31.
  16. Vermeeren, A. P. O. S., Law, E. L., Roto, V., Obrist, M., Hoonhout, J. and Väänänen-Vainio-Mattila, K. (2010). User experience evaluation methods: current state and development needs. In Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries (NordiCHI 7810). ACM, New York, NY, USA, 521-530. doi=10.1145/1868914.186897.
Download


Paper Citation


in Harvard Style

Álvarez-Xochihua O., Muñoz-Merino P., Muñoz-Organero M., Delgado Kloos C. and González-Fraga J. (2017). Comparing Usability, User Experience and Learning Motivation Characteristics of Two Educational Computer Games . In Proceedings of the 19th International Conference on Enterprise Information Systems - Volume 3: ICEIS, ISBN 978-989-758-249-3, pages 143-150. DOI: 10.5220/0006338901430150


in Bibtex Style

@conference{iceis17,
author={Omar Álvarez-Xochihua and Pedro J. Muñoz-Merino and Mario Muñoz-Organero and Carlos Delgado Kloos and José A. González-Fraga},
title={Comparing Usability, User Experience and Learning Motivation Characteristics of Two Educational Computer Games},
booktitle={Proceedings of the 19th International Conference on Enterprise Information Systems - Volume 3: ICEIS,},
year={2017},
pages={143-150},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006338901430150},
isbn={978-989-758-249-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 19th International Conference on Enterprise Information Systems - Volume 3: ICEIS,
TI - Comparing Usability, User Experience and Learning Motivation Characteristics of Two Educational Computer Games
SN - 978-989-758-249-3
AU - Álvarez-Xochihua O.
AU - Muñoz-Merino P.
AU - Muñoz-Organero M.
AU - Delgado Kloos C.
AU - González-Fraga J.
PY - 2017
SP - 143
EP - 150
DO - 10.5220/0006338901430150