The Lazy Student's Dream: ChatGPT Passing an Engineering Course on Its Own

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Puthumanaillam, Gokul, Bretl, Timothy, Ornik, Melkior
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908366393049088
author Puthumanaillam, Gokul
Bretl, Timothy
Ornik, Melkior
author_facet Puthumanaillam, Gokul
Bretl, Timothy
Ornik, Melkior
contents This paper presents a comprehensive investigation into the capability of Large Language Models (LLMs) to successfully complete a semester-long undergraduate control systems course. Through evaluation of 115 course deliverables, we assess LLM performance using ChatGPT under a "minimal effort" protocol that simulates realistic student usage patterns. The investigation employs a rigorous testing methodology across multiple assessment formats, from auto-graded multiple choice questions to complex Python programming tasks and long-form analytical writing. Our analysis provides quantitative insights into AI's strengths and limitations in handling mathematical formulations, coding challenges, and theoretical concepts in control systems engineering. The LLM achieved a B-grade performance (82.24\%), approaching but not exceeding the class average (84.99\%), with strongest results in structured assignments and greatest limitations in open-ended projects. The findings inform discussions about course design adaptation in response to AI advancement, moving beyond simple prohibition towards thoughtful integration of these tools in engineering education. Additional materials including syllabus, examination papers, design projects, and example responses can be found at the project website: https://gradegpt.github.io.
format Preprint
id arxiv_https___arxiv_org_abs_2503_05760
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle The Lazy Student's Dream: ChatGPT Passing an Engineering Course on Its Own
Puthumanaillam, Gokul
Bretl, Timothy
Ornik, Melkior
Computers and Society
Artificial Intelligence
This paper presents a comprehensive investigation into the capability of Large Language Models (LLMs) to successfully complete a semester-long undergraduate control systems course. Through evaluation of 115 course deliverables, we assess LLM performance using ChatGPT under a "minimal effort" protocol that simulates realistic student usage patterns. The investigation employs a rigorous testing methodology across multiple assessment formats, from auto-graded multiple choice questions to complex Python programming tasks and long-form analytical writing. Our analysis provides quantitative insights into AI's strengths and limitations in handling mathematical formulations, coding challenges, and theoretical concepts in control systems engineering. The LLM achieved a B-grade performance (82.24\%), approaching but not exceeding the class average (84.99\%), with strongest results in structured assignments and greatest limitations in open-ended projects. The findings inform discussions about course design adaptation in response to AI advancement, moving beyond simple prohibition towards thoughtful integration of these tools in engineering education. Additional materials including syllabus, examination papers, design projects, and example responses can be found at the project website: https://gradegpt.github.io.
title The Lazy Student's Dream: ChatGPT Passing an Engineering Course on Its Own
topic Computers and Society
Artificial Intelligence
url https://arxiv.org/abs/2503.05760