The AI Assessment Scale (AIAS) in action: A pilot implementation of GenAI supported assessment- A Preprint

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Furze, Leon, Perkins, Mike, Roe, Jasper, MacVaugh, Jason
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910843485028352
author Furze, Leon
Perkins, Mike
Roe, Jasper
MacVaugh, Jason
author_facet Furze, Leon
Perkins, Mike
Roe, Jasper
MacVaugh, Jason
contents The rapid adoption of Generative Artificial Intelligence (GenAI) technologies in higher education has raised concerns about academic integrity, assessment practices, and student learning. Banning or blocking GenAI tools has proven ineffective, and punitive approaches ignore the potential benefits of these technologies. This paper presents the findings of a pilot study conducted at British University Vietnam (BUV) exploring the implementation of the Artificial Intelligence Assessment Scale (AIAS), a flexible framework for incorporating GenAI into educational assessments. The AIAS consists of five levels, ranging from 'No AI' to 'Full AI', enabling educators to design assessments that focus on areas requiring human input and critical thinking. Following the implementation of the AIAS, the pilot study results indicate a significant reduction in academic misconduct cases related to GenAI, a 5.9% increase in student attainment across the university, and a 33.3% increase in module passing rates. The AIAS facilitated a shift in pedagogical practices, with faculty members incorporating GenAI tools into their modules and students producing innovative multimodal submissions. The findings suggest that the AIAS can support the effective integration of GenAI in HE, promoting academic integrity while leveraging the technology's potential to enhance learning experiences. Refer to published version for final text.
format Preprint
id arxiv_https___arxiv_org_abs_2403_14692
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle The AI Assessment Scale (AIAS) in action: A pilot implementation of GenAI supported assessment- A Preprint
Furze, Leon
Perkins, Mike
Roe, Jasper
MacVaugh, Jason
Computers and Society
Artificial Intelligence
The rapid adoption of Generative Artificial Intelligence (GenAI) technologies in higher education has raised concerns about academic integrity, assessment practices, and student learning. Banning or blocking GenAI tools has proven ineffective, and punitive approaches ignore the potential benefits of these technologies. This paper presents the findings of a pilot study conducted at British University Vietnam (BUV) exploring the implementation of the Artificial Intelligence Assessment Scale (AIAS), a flexible framework for incorporating GenAI into educational assessments. The AIAS consists of five levels, ranging from 'No AI' to 'Full AI', enabling educators to design assessments that focus on areas requiring human input and critical thinking. Following the implementation of the AIAS, the pilot study results indicate a significant reduction in academic misconduct cases related to GenAI, a 5.9% increase in student attainment across the university, and a 33.3% increase in module passing rates. The AIAS facilitated a shift in pedagogical practices, with faculty members incorporating GenAI tools into their modules and students producing innovative multimodal submissions. The findings suggest that the AIAS can support the effective integration of GenAI in HE, promoting academic integrity while leveraging the technology's potential to enhance learning experiences. Refer to published version for final text.
title The AI Assessment Scale (AIAS) in action: A pilot implementation of GenAI supported assessment- A Preprint
topic Computers and Society
Artificial Intelligence
url https://arxiv.org/abs/2403.14692