← All research

AI for Learning

A study found that the instructional design (pedagogical structure) of AI tutors significantly boosts student learning, but the interaction method (voice vs. text) does not affect learning outcomes, even if voice is preferred.

cs.HCBeginner-friendly

When AI Tutors Speak: Evidence from a Randomized Field Experiment

Shihao Yang, Marshall Van Alstyne, Chrysanthos Dellarocas

In plain terms

AI tutors are becoming common, but we don't know how best to design them for student learning, especially regarding *pedagogical structure* (how the AI teaches, like guided questions) and *interaction modality* (how students talk to it, like voice or text). Researchers experimented with 86 graduate students, comparing a *structured AI tutor* designed to guide learning based on course materials against a control group with general AI access. Within the structured group, students alternated weekly between voice and text interaction with the tutor. They found that the structured AI tutor significantly boosted learning, with tutored students scoring 6.63 points higher and showing improved written reasoning. However, interaction modality (voice vs. text) had no impact on learning outcomes, despite voice being preferred and more costly to deliver. This suggests that the "how" an AI teaches (pedagogical structure) is vital for learning, not just making it seem more humanlike through voice.

Why it matters · For anyone designing AI tools for education, this research highlights that focusing on the instructional design and structure of the AI is more critical for learning gains than the fanciness of its interaction method.

About this work · This research explores effective design principles for intelligent tutoring systems, a key area within AI in education that seeks to personalize and enhance learning experiences.

intelligent tutoringLLMspedagogical designexperimental studyvoice vs text