This paper advocates for using structural causal modeling to assess student competencies, enabling deeper insights into how educational interventions impact learning.

In plain terms

Current methods for assessing student knowledge, like those based on **psychometric models** such as **item response theory**, are good at measuring what students know but struggle to explain *why* they perform a certain way or predict the effect of giving them help. This paper proposes using **structural causal modeling (SCM)**, a framework that explicitly maps out cause-and-effect relationships between different factors in a learning scenario. The authors developed a clear protocol for building these SCMs, which relies on gathering logical rules from experts rather than complex statistical assumptions. They demonstrated how SCM can effectively model the impact of support interventions, like giving a hint, on student performance. Crucially, this approach allows for **interventional reasoning** (understanding what happens if we change something) and **counterfactual reasoning** (exploring "what if" scenarios), which are largely inaccessible with traditional assessment models. This means educators can better predict the outcome of different support strategies and even analyze what might have happened if a student had received different help.