Experiments with Auto-generated Socratic Dialogue for Source Code Understanding

Zeyad Alshaikh, Lasang Tamang, Vasile Rus

Abstract

Intelligent Tutoring Systems have been proven to generate excellent learning outcomes in many domains such as physics, mathematics and computer programming. However, they have seen relatively little use in training and school classrooms due to the time and cost of designing and authoring. We developed an authoring tool for dialogue-based intelligent tutoring system for programming called Auto-author to reduce the time and cost. The tool allows teachers to create fully functional Socratic tutoring dialogue for learning programming from Java code. First, we conducted a controlled experiment on 45 introductory to programming students to assess auto-authored tutoring dialogues’ learning outcomes. The result shows that the auto-authored dialogues improved students’ programming knowledge by 43% in terms of learning gain. Secondly, we conducted a survey of auto-authored tutoring dialogues by introductory to programming course instructors to evaluate the dialogues’ quality. The result shows that the instructors rated the questions as agree or strongly agree. However, the instructors suggested that more improvement is required to help students develop a robust understanding of programming concepts.

Download


Paper Citation


in Harvard Style

Alshaikh Z., Tamang L. and Rus V. (2021). Experiments with Auto-generated Socratic Dialogue for Source Code Understanding. In Proceedings of the 13th International Conference on Computer Supported Education - Volume 2: CSEDU, ISBN 978-989-758-502-9, pages 35-44. DOI: 10.5220/0010398100350044


in Bibtex Style

@conference{csedu21,
author={Zeyad Alshaikh and Lasang Tamang and Vasile Rus},
title={Experiments with Auto-generated Socratic Dialogue for Source Code Understanding},
booktitle={Proceedings of the 13th International Conference on Computer Supported Education - Volume 2: CSEDU,},
year={2021},
pages={35-44},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010398100350044},
isbn={978-989-758-502-9},
}


in EndNote Style

TY - CONF

JO - Proceedings of the 13th International Conference on Computer Supported Education - Volume 2: CSEDU,
TI - Experiments with Auto-generated Socratic Dialogue for Source Code Understanding
SN - 978-989-758-502-9
AU - Alshaikh Z.
AU - Tamang L.
AU - Rus V.
PY - 2021
SP - 35
EP - 44
DO - 10.5220/0010398100350044