This paper introduces MUSE, a new benchmark for evaluating Large Vision-Language Models on their ability to understand artistic images in educational contexts, particularly for AI-assisted language learning.

In plain terms

Large Vision-Language Models (LVLMs) are advanced AI models that can understand both images and text. While these models have shown great progress, their abilities in educational settings, especially for tasks like AI-assisted language learning, haven't been fully evaluated. Existing evaluation tools largely ignore artistic educational content, which is crucial for interpreting visuals in a learning context. To address this, researchers developed MUSE, a new benchmark using diverse artistic images, including art from Singaporean, Southeast Asian, and Western traditions. MUSE comprises twelve tasks, from visual perception to understanding emotions, cultural meanings, and compositional reasoning within the art. Their findings showed current LVLMs struggle significantly with tasks involving affective interpretation (understanding emotions) and compositional reasoning, highlighting key challenges for developing reliable AI in education.