Reflective Dialogue or Prompt Refinement? Effects of Tutor Scaffolding on Students’ Independent LLM Use for Programming
Auteur(s)
Uittenhove, Kim
Perez, Aitor
Jermann, Patrick
Type
Conférence scientifique
Date de publication
2026-06-27
Langue de la référence
Anglais
Résumé
While Large Language Models (LLMs) can provide personalized support in learning, several studies have raised concerns regarding their use in education. Importantly, learning depends on how students engage with LLMs. This study examined how two types of LLM-based tutors shape students’ prompting practices, learning, and subsequent LLM-use: a Socratic-Guidance (SG) tutor, which structures interaction through dialogic questioning, and a Prompt-Refinement (PR) tutor that guides the formulation of effective prompts. We conducted a two-phase study in a graduate-level mobile robotics course: 66 students used either the SG or PR tutor during a 6-week intervention, followed by 52 students using an unconstrained LLM during a 3-week course project. Results show that while the SG- and PR tutors led to similar task performance and prompting patterns during guided use, they differ in learn- ing outcomes and later LLM-use. SG-students, relative to PR-student, achieved higher learning gains in later sessions, and were more likely to adopt understanding-driven prompting strategies, which are predictive of higher understanding, when using an unconstrained LLM. Although learners perceived the SG tutor as less efficient, the findings suggest that Socratic guidance supports the development of students’ capacity to learn with LLMs over time, highlighting its importance for LLM tutor design.
Maison d’édition
Springer Nature Switzerland
Portée (nationale / internationale)
Internationale
Nom de la manifestation
AIED 2026
Date(s) de la manifestation
27 June 2026
Ville de la manifestation
Seoul
Pays de la manifestation
Korea
Portée de la manifestation
internationale
URL permanente
DOI d'un dépôt de données ORD
10.1007/978-3-032-29763-1_37
Fichier(s)![Vignette d'image]()
En cours de chargement...
Texte intégral
Nom
2026_AI_tutor_AIED.pdf
Taille
1.42 MB
Format
Adobe PDF
Checksum (MD5)
e1ccdd5a3390106fe7fc7c77bda3bd28