Reinforcement Learning in Super Mario Bros: Curriculum, Pedagogy, and Optimal Level Design in World 1-1
In plain terms
This research explores whether the famous initial level of Super Mario Bros (World 1-1), known for subtly teaching players game mechanics, truly has an empirically measurable pedagogical structure. The authors implemented World 1-1 as a digital environment and trained different Artificial Intelligence (AI) agents, specifically using Reinforcement Learning (RL) algorithms like Q-Learning and Monte Carlo, to play it. Reinforcement Learning is a type of AI where an agent learns to make decisions by trying actions and receiving rewards or penalties. They found that the Monte Carlo agent was the most successful, especially because it learned to take paths that maximized smaller, intermediate rewards, not just the final win. Crucially, by shuffling the level's segments, they discovered that the original order of World 1-1 significantly accelerates the AI's learning, achieving the highest efficiency and preventing learning failures. This validates its exceptional design as a teaching tool, confirming that its structure measurably accelerates learning.