This paper shows how Large Language Models (LLMs) can automatically identify and categorize common mistakes students make when working with mathematical formalisms, helping to improve educational feedback.

In plain terms

Students often find it tough to work with mathematical formalisms, such as logical formulas or mathematical equations, which are crucial in STEM fields. Identifying the common errors they make is very important for providing helpful feedback and creating better educational tools, but doing this manually for many students is difficult. This paper presents a new method that uses Large Language Models (LLMs), which are advanced AI systems, to automatically find these common mistakes. The LLM suggests ways to correct incorrect student answers (called "bug fixing transformations"), and these suggestions are then verified by computer algorithms. This approach helps to identify, group, and visualize common student errors for instructors and education researchers. They showed this method works well by finding known mistakes in logic and can handle large amounts of student data, making it useful for various types of formalisms.