This paper explores using AI to automatically score student-drawn scientific models, proposing a "confidence-aware" system that defers uncertain assessments to human experts to ensure reliability.

In plain terms

In science education, students often create drawings to show their understanding, but having expert teachers score these complex visual responses is time-consuming and expensive, making it hard to use on a large scale. This research addresses this challenge by developing an automated system to score student-generated scientific drawings using a type of artificial intelligence called a Vision Transformer (ViT). A Vision Transformer is an advanced machine learning model specifically designed to process and understand images. The researchers also introduced a "confidence-aware" framework, meaning the AI not only predicts a score but also indicates how certain it is about its prediction. This allows high-confidence scores to be automated, while uncertain cases are flagged for human review. They tested their approach on six middle school science assessment tasks and found it improved scoring reliability, providing a practical way to balance automation with the need for accurate and trustworthy educational assessment.