Knowledge Tracking Variables in Intelligent Tutoring Systems

Ani Grubišić, Slavomir Stankov, Branko Žitko, Ines Šarić, Suzana Tomaš, Emil Brajković, Tomislav Volarić, Daniel Vasić, Arta Dodaj


In this research we propose a comprehensive set of knowledge indicators aimed to enhance learners’ self-reflection and awareness in the learning and testing process. Since examined intelligent tutoring systems do not include additional messaging features, the introduction of common set of knowledge indicators differentiates our approach from the previous studies. In order to investigate the relation between proposed knowledge indicators and learner performance, the correlation and regression analysis were performed for 3 different courses and each examined intelligent tutoring system. The results of correlation and regression analysis, as well as learners’ feedback, guided us in discussion about the introduction of knowledge indicators in dashboard-like visualizations of integrated intelligent tutoring system.


  1. Abdous, M. 'hammed, He, W. and Yen, C.-J. (2012), “Using Data Mining for Predicting Relationships between Online Question Theme and Final Grade”, Educational Technology & Society, 15(3), pp. 77-88.
  2. Ausubel, D.P. (1968), Educational Psychology: A Cognitive View, Holt, Rinehart and Winston.
  3. Baker, R.S. (2016), “Stupid Tutoring Systems, Intelligent Humans”, International Journal of Artificial Intelligence in Education, Vol. 26 No. 2, pp. 600-614.
  4. Baker, R.S. and Yacef, K. (2009), “The State of Educational Data Mining in 2009: A Review and Future Visions”, JEDM - Journal of Educational Data Mining, Vol. 1 No. 1, pp. 3-17.
  5. Carnot, M.J., Feltovich, P., Hoffman, R.R., Feltovich, J. and Novak, J.D. (2003), A Summary of Literature Pertaining to the Use of Concept Mapping Techniques and Technologies for Education and Performance Support, Report from the Institute for Human and Machine Cognition, Pensacola, FL.
  6. Field, A. (2005), Discovering Statistics Using SPSS, Second Edition., Sage Publications Ltd, London; Thousand Oaks, Calif.
  7. Grubišic, A. (2012), Adaptive Student's Knowledge Acquisition Model in E-Learning Systems, University of Zagreb, Croatia.
  8. Grubišic, A., Stankov, S. and Žitko, B. (2015), “Adaptive Courseware based on Natural Language Processing (AC & NL Tutor), United States Office of Naval Research grant (N00014-15-1-2789)”.
  9. Koedinger, K.R., Brunskill, E., Baker, R.S., McLaughlin, E.A. and Stamper, J. (2013), “New Potentials for Data-Driven Intelligent Tutoring System Development and Optimization”, AI Magazine, Vol. 34 No. 3, pp. 27-41.
  10. Lin, C.-C. and Chiu, C.-H. (2013), “Correlation between Course Tracking Variables and Academic Performance in Blended Online Courses”, IEEE, pp. 184-188.
  11. Long, P. and Siemens, G. (2011), “Penetrating the fog: Analytics in learning and education”, Educause Review, 46(5), 31-40.
  12. Macfadyen, L.P. and Dawson, S. (2010), “Mining LMS data to develop an 'early warning system' for educators: A proof of concept”, Computers & Education, Vol. 54 No. 2, pp. 588-599.
  13. Morris, L.V., Finnegan, C. and Wu, S.-S. (2005), “Tracking student behavior, persistence, and achievement in online courses”, The Internet and Higher Education, Vol. 8 No. 3, pp. 221-231.
  14. Novak, J.D. and Cañas, A.J. (2008), “The Theory Underlying Concept Maps and How to Construct and Use Them”, available at: oryUnderlyingConceptMaps.pdf (accessed 16 September 2016).
  15. Park, Y. and Jo, I.-H. (2015), “Development of the Learning Analytics Dashboard to Support Students' Learning Performance”, Journal of Universal Computer Science, Vol. 21 No. 1, pp. 110-133.
  16. Romero, C. and Ventura, S. (2007), “Educational Data Mining: A Survey from 1995 to 2005”, Expert Syst. Appl., Vol. 33 No. 1, pp. 135-146.
  17. Žitko, B. (2010), Model of Intelligent Tutoring System Based on Processing of Controlled Language over Ontology, University of Zagreb, Croatia.

Paper Citation

in Harvard Style

Grubišić A., Stankov S., Žitko B., Šarić I., Tomaš S., Brajković E., Volarić T., Vasić D. and Dodaj A. (2017). Knowledge Tracking Variables in Intelligent Tutoring Systems . In Proceedings of the 9th International Conference on Computer Supported Education - Volume 1: CSEDU, ISBN 978-989-758-239-4, pages 513-518. DOI: 10.5220/0006366905130518

in Bibtex Style

author={Ani Grubišić and Slavomir Stankov and Branko Žitko and Ines Šarić and Suzana Tomaš and Emil Brajković and Tomislav Volarić and Daniel Vasić and Arta Dodaj},
title={Knowledge Tracking Variables in Intelligent Tutoring Systems},
booktitle={Proceedings of the 9th International Conference on Computer Supported Education - Volume 1: CSEDU,},

in EndNote Style

JO - Proceedings of the 9th International Conference on Computer Supported Education - Volume 1: CSEDU,
TI - Knowledge Tracking Variables in Intelligent Tutoring Systems
SN - 978-989-758-239-4
AU - Grubišić A.
AU - Stankov S.
AU - Žitko B.
AU - Šarić I.
AU - Tomaš S.
AU - Brajković E.
AU - Volarić T.
AU - Vasić D.
AU - Dodaj A.
PY - 2017
SP - 513
EP - 518
DO - 10.5220/0006366905130518