← All research

AI for Learning

Academic staff share their experiences implementing a framework designed to redesign university assessments in the age of generative AI.

cs.HCBeginner-friendly

'A bit of chaos and madness': The AI Assessment Scale and the work of assessment reform

Mike Perkins, Darius Postma, Jasper Roe, Susan Sisay +1 more

In plain terms

Generative AI (GenAI), like ChatGPT, is making universities rethink how they assess students, creating pressure to maintain fairness and prevent academic misconduct. The Artificial Intelligence Assessment Scale (AIAS) is one framework designed to help universities adapt their assessment strategies for GenAI. This study examined how academic staff experienced implementing the AIAS at two universities, one in Vietnam and one in the UK, using focus groups with 30 staff members. Staff valued the AIAS for establishing a shared understanding of GenAI use, clarifying boundaries, and prompting reflection on assessment design. However, its implementation was influenced by factors such as university governance, access to AI tools, staff confidence, workload concerns, and the need to align with specific learning outcomes and disciplinary contexts. The findings suggest the AIAS can encourage more authentic assessment and student engagement, but it risks becoming a mere compliance measure if disconnected from teaching goals and staff capacity.

Why it matters · This paper is crucial for understanding the real-world challenges and successes of integrating AI policies into university education, highlighting the human element and practical considerations beyond just technological solutions. It shows that policy adoption doesn't automatically mean pedagogical enactment, a key lesson for anyone looking to implement AI solutions in educational settings.

About this work · This research falls under the growing field of AI in education, specifically focusing on how higher education institutions adapt to and manage the challenges and opportunities presented by new AI technologies like generative AI. It delves into the practical implementation of AI policies and frameworks within university settings.

Generative AIAssessment designHigher educationPolicy implementationAcademic staff experience