Do Gains from Generative AI-Enabled Adaptive Pretesting Persist? Evidence from a Retention Study
In plain terms
This study looks at whether learning benefits from using "adaptive AI-assisted pretesting"—where an AI tailors introductory questions before instruction—last over a long period. Pretesting is known to help students learn by activating what they already know, but it's unclear if the advantages of *adaptive* pretesting, especially when powered by Generative AI (AI that can create new content), persist over time. Researchers had college students complete an adaptive AI pretesting session, followed by instruction, and then assigned them to one of three different seven-week practice methods: adaptive spaced retrieval, fixed spaced retrieval, or learner-directed AI study. "Spaced retrieval practice" involves reviewing information at increasing intervals to improve memory, and in this study, it was either tailored by AI or fixed. They found that adaptive pretesting did improve initial understanding, but the sustained learning gains depended heavily on the subsequent practice method. Specifically, both retrieval practice groups outperformed the learner-directed AI study group, indicating that structured AI-supported practice is key for long-term retention.