← All research

AI for Learning

This study explores if learning gains from Generative AI-enabled adaptive pretesting last over time, finding initial benefits but stressing the importance of structured AI-supported practice for long-term retention.

cs.CYBeginner-friendly

Do Gains from Generative AI-Enabled Adaptive Pretesting Persist? Evidence from a Retention Study

Mahir Akgun, Sacip Toker

In plain terms

This study looks at whether learning benefits from using "adaptive AI-assisted pretesting"—where an AI tailors introductory questions before instruction—last over a long period. Pretesting is known to help students learn by activating what they already know, but it's unclear if the advantages of *adaptive* pretesting, especially when powered by Generative AI (AI that can create new content), persist over time. Researchers had college students complete an adaptive AI pretesting session, followed by instruction, and then assigned them to one of three different seven-week practice methods: adaptive spaced retrieval, fixed spaced retrieval, or learner-directed AI study. "Spaced retrieval practice" involves reviewing information at increasing intervals to improve memory, and in this study, it was either tailored by AI or fixed. They found that adaptive pretesting did improve initial understanding, but the sustained learning gains depended heavily on the subsequent practice method. Specifically, both retrieval practice groups outperformed the learner-directed AI study group, indicating that structured AI-supported practice is key for long-term retention.

Why it matters · This research highlights that while AI can significantly improve initial learning stages like pretesting, its sustained impact depends heavily on how it's integrated into ongoing study strategies. For newcomers, this emphasizes the need to consider the entire learning journey, not just isolated AI interventions.

About this work · This paper contributes to the growing field of AI in education, specifically focusing on how generative AI can be used to optimize learning strategies like pretesting and spaced practice. The study investigates effective methods for integrating AI tools into pedagogical designs to improve student retention and performance.

Generative AIAdaptive LearningPretestingSpaced PracticeRetention