Cover Image

A comparison of Human, GPT-3.5, and GPT-4 Performance in a University-Level Coding Course

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yeadon, Will, Peach, Alex, Testrow, Craig P.
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Can GPT-3.5 Generate and Code Discharge Summaries?
by: Falis, Matúš, et al.
Published: (2024)

100% Elimination of Hallucinations on RAGTruth for GPT-4 and GPT-3.5 Turbo
by: Wood, Michael C., et al.
Published: (2024)

Assessing GPT Performance in a Proof-Based University-Level Course Under Blind Grading
by: Ding, Ming, et al.
Published: (2025)

Is GPT-4 Less Politically Biased than GPT-3.5? A Renewed Investigation of ChatGPT's Political Biases
by: Weber, Erik, et al.
Published: (2024)

Whose LLM is it Anyway? Linguistic Comparison and LLM Attribution for GPT-3.5, GPT-4 and Bard
by: Rosenfeld, Ariel, et al.
Published: (2024)

HateGPT: Unleashing GPT-3.5 Turbo to Combat Hate Speech on X
by: Deroy, Aniket, et al.
Published: (2024)

GPT-3.5 for Grammatical Error Correction
by: Katinskaia, Anisia, et al.
Published: (2024)

Math anxiety and associative knowledge structure are entwined in psychology students but not in Large Language Models like GPT-3.5 and GPT-4o
by: Ciringione, Luciana, et al.
Published: (2025)

Chatbots put to the test in math and logic problems: A preliminary comparison and assessment of ChatGPT-3.5, ChatGPT-4, and Google Bard
by: Plevris, Vagelis, et al.
Published: (2023)

ChatGPT v.s. Media Bias: A Comparative Study of GPT-3.5 and Fine-tuned Language Models
by: Wen, Zehao, et al.
Published: (2024)

Evaluating Students' Open-ended Written Responses with LLMs: Using the RAG Framework for GPT-3.5, GPT-4, Claude-3, and Mistral-Large
by: Jauhiainen, Jussi S., et al.
Published: (2024)

Text Understanding in GPT-4 vs Humans
by: Shultz, Thomas R., et al.
Published: (2024)

Principled Instructions Are All You Need for Questioning LLaMA-1/2, GPT-3.5/4
by: Bsharat, Sondos Mahmoud, et al.
Published: (2023)

Performance of GPT-5 Frontier Models in Ophthalmology Question Answering
by: Antaki, Fares, et al.
Published: (2025)

Bilingual Sexism Classification: Fine-Tuned XLM-RoBERTa and GPT-3.5 Few-Shot Learning
by: Azadi, AmirMohammad, et al.
Published: (2024)

Automated Generation of Multiple-Choice Cloze Questions for Assessing English Vocabulary Using GPT-turbo 3.5
by: Wang, Qiao, et al.
Published: (2024)

GPT-4 vs. Human Translators: A Comprehensive Evaluation of Translation Quality Across Languages, Domains, and Expertise Levels
by: Yan, Jianhao, et al.
Published: (2024)

GPTEval: A Survey on Assessments of ChatGPT and GPT-4
by: Mao, Rui, et al.
Published: (2023)

Generative AI for Enhancing Active Learning in Education: A Comparative Study of GPT-3.5 and GPT-4 in Crafting Customized Test Questions
by: Rouzegar, Hamdireza, et al.
Published: (2024)

GPT-5 Model Corrected GPT-4V's Chart Reading Errors, Not Prompting
by: Yang, Kaichun, et al.
Published: (2025)

A Comparison of Human and ChatGPT Classification Performance on Complex Social Media Data
by: Green, Breanna E., et al.
Published: (2025)

Artificial Intelligence Driven Course Generation: A Case Study Using ChatGPT
by: Rouabhia, Djaber
Published: (2024)

Benchmarking GPT-4 against Human Translators: A Comprehensive Evaluation Across Languages, Domains, and Expertise Levels
by: Yan, Jianhao, et al.
Published: (2024)

MotionGPT3: Human Motion as a Second Modality
by: Zhu, Bingfan, et al.
Published: (2025)

Is GPT-4 a reliable rater? Evaluating Consistency in GPT-4 Text Ratings
by: Hackl, Veronika, et al.
Published: (2023)

DeID-GPT: Zero-shot Medical Text De-Identification by GPT-4
by: Liu, Zhengliang, et al.
Published: (2023)

Evaluating GPT-3.5's Awareness and Summarization Abilities for European Constitutional Texts with Shared Topics
by: Greco, Candida M., et al.
Published: (2024)

For GPT-4 as with Humans: Information Structure Predicts Acceptability of Long-Distance Dependencies
by: Cuneo, Nicole, et al.
Published: (2025)

Prompt Engineering Using GPT for Word-Level Code-Mixed Language Identification in Low-Resource Dravidian Languages
by: Deroy, Aniket, et al.
Published: (2024)

NeuGPT: Unified multi-modal Neural GPT
by: Yang, Yiqian, et al.
Published: (2024)

GPT-4 Technical Report
by: OpenAI, et al.
Published: (2023)

Capabilities of GPT-5 across critical domains: Is it the next breakthrough?
by: Georgiou, Georgios P.
Published: (2025)

DaVinci at SemEval-2024 Task 9: Few-shot prompting GPT-3.5 for Unconventional Reasoning
by: Mathur, Suyash Vardhan, et al.
Published: (2024)

Leveraging a Cognitive Model to Measure Subjective Similarity of Human and GPT-4 Written Content
by: Malloy, Tailia, et al.
Published: (2024)

GPT-Fathom: Benchmarking Large Language Models to Decipher the Evolutionary Path towards GPT-4 and Beyond
by: Zheng, Shen, et al.
Published: (2023)

Analyzing the Performance of ChatGPT in Cardiology and Vascular Pathologies
by: Hariri, Walid
Published: (2023)

Predicting challenge moments from students' discourse: A comparison of GPT-4 to two traditional natural language processing approaches
by: Suraworachet, Wannapon, et al.
Published: (2024)

The Human and the Mechanical: logos, truthfulness, and ChatGPT
by: Giannakidou, Anastasia, et al.
Published: (2024)

Criterion-referenceability determines LLM-as-a-judge validity across physics assessment formats
by: Yeadon, Will, et al.
Published: (2026)

Notes on Applicability of GPT-4 to Document Understanding
by: Borchmann, Łukasz
Published: (2024)