Cover Image

Navigating Pitfalls: Evaluating LLMs in Machine Learning Programming Education

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Kumar, Smitha, Lones, Michael A., Maarek, Manuel, Zantout, Hind
Format:	Preprint
Published:	2025
Subjects:	Computers and Society Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Fine-Tuning Models for Automated Code Review Feedback
by: Kumar, Smitha S, et al.
Published: (2026)

ActDroid: An active learning framework for Android malware detection
by: Muzaffar, Ali, et al.
Published: (2024)

No Size Fits All: The Perils and Pitfalls of Leveraging LLMs Vary with Company Size
by: Urlana, Ashok, et al.
Published: (2024)

Evaluating a Methodology for Increasing AI Transparency: A Case Study
by: Piorkowski, David, et al.
Published: (2022)

The Scenic Route to Deception: Dark Patterns and Explainability Pitfalls in Conversational Navigation
by: Ilyankou, Ilya, et al.
Published: (2026)

It is Too Many Options: Pitfalls of Multiple-Choice Questions in Generative AI and Medical Education
by: Singh, Shrutika, et al.
Published: (2025)

Securing Educational LLMs: A Generalised Taxonomy of Attacks on LLMs and DREAD Risk Assessment
by: Zahid, Farzana, et al.
Published: (2025)

The Psychology of Learning from Machines: Anthropomorphic AI and the Paradox of Automation in Education
by: Qadir, Junaid, et al.
Published: (2026)

Self-Supervised Learning for Pre-training Capsule Networks: Overcoming Medical Imaging Dataset Challenges
by: El-Shimy, Heba, et al.
Published: (2025)

Trustworthiness of Legal Considerations for the Use of LLMs in Education
by: Alaswad, Sara, et al.
Published: (2025)

WHBench: Evaluating Frontier LLMs with Expert-in-the-Loop Validation on Women's Health Topics
by: Maurya, Sneha, et al.
Published: (2026)

Encouraging Responsible Use of Generative AI in Education: A Reward-Based Learning Approach
by: Singh, Aditi, et al.
Published: (2024)

Question the Questions: Auditing Representation in Online Deliberative Processes
by: De, Soham, et al.
Published: (2025)

Machine Unlearning for Responsible and Adaptive AI in Education
by: Mayeku, Betty, et al.
Published: (2025)

Detecting AI-Generated Text in Educational Content: Leveraging Machine Learning and Explainable AI for Academic Integrity
by: Najjar, Ayat A., et al.
Published: (2025)

What Makes an Evaluation Useful? Common Pitfalls and Best Practices
by: Gekker, Gil, et al.
Published: (2025)

The Pitfalls of "Security by Obscurity" And What They Mean for Transparent AI
by: Hall, Peter, et al.
Published: (2025)

Evaluation of Machine Learning Models in Student Academic Performance Prediction
by: Sandeepa, A. G. R., et al.
Published: (2025)

Evaluating Language Models for Generating and Judging Programming Feedback
by: Koutcheme, Charles, et al.
Published: (2024)

The Robots are Here: Navigating the Generative AI Revolution in Computing Education
by: Prather, James, et al.
Published: (2023)

Educating a Responsible AI Workforce: Piloting a Curricular Module on AI Policy in a Graduate Machine Learning Course
by: Weichert, James, et al.
Published: (2025)

Evaluating Code Generation of LLMs in Advanced Computer Science Problems
by: Catir, Emir, et al.
Published: (2025)

Evaluating the Application of Large Language Models to Generate Feedback in Programming Education
by: Jacobs, Sven, et al.
Published: (2024)

The Compute Divide in Machine Learning: A Threat to Academic Contribution and Scrutiny?
by: Besiroglu, Tamay, et al.
Published: (2024)

COMPASS: A Framework for Evaluating Organization-Specific Policy Alignment in LLMs
by: Choi, Dasol, et al.
Published: (2026)

Theory Trace Card: Theory-Driven Socio-Cognitive Evaluation of LLMs
by: Karimi-Malekabadi, Farzan, et al.
Published: (2026)

WARBENCH: A Comprehensive Benchmark for Evaluating LLMs in Military Decision-Making
by: Li, Zongjie, et al.
Published: (2026)

Measuring Teaching with LLMs
by: Hardy, Michael
Published: (2025)

MEDEQUALQA: Evaluating Biases in LLMs with Counterfactual Reasoning
by: Ghosh, Rajarshi, et al.
Published: (2025)

On the Credibility of Evaluating LLMs using Survey Questions
by: Libovický, Jindřich
Published: (2026)

Pedagogical Promise and Peril of AI: A Text Mining Analysis of ChatGPT Research Discussions in Programming Education
by: Grume, Juvy C., et al.
Published: (2026)

Advancing Transformative Education: Generative AI as a Catalyst for Equity and Innovation
by: Bura, Chiranjeevi, et al.
Published: (2024)

Safe for Whom? Rethinking How We Evaluate the Safety of LLMs for Real Users
by: Kempermann, Manon, et al.
Published: (2025)

"Everyone's using it, but no one is allowed to talk about it": College Students' Experiences Navigating the Higher Education Environment in a Generative AI World
by: Fu, Yue, et al.
Published: (2026)

Vibe Learning: Education in the age of AI
by: Florencio, Marcos, et al.
Published: (2025)

MediTools -- Medical Education Powered by LLMs
by: Alshatnawi, Amr, et al.
Published: (2025)

Leveraging Prompts in LLMs to Overcome Imbalances in Complex Educational Text Data
by: McClure, Jeanne, et al.
Published: (2024)

GenAI Voice Mode in Programming Education
by: Jacobs, Sven, et al.
Published: (2025)

Evaluating the Capabilities of LLMs for Supporting Anticipatory Impact Assessment
by: Allaham, Mowafak, et al.
Published: (2024)

Evaluating Cultural Awareness of LLMs for Yoruba, Malayalam, and English
by: Dawson, Fiifi, et al.
Published: (2024)