Cover Image

Autoscoring Anticlimax: A Meta-analytic Understanding of AI's Short-answer Shortcomings and Wording Weaknesses

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Hardy, Michael
Format:	Preprint
Published:	2026
Subjects:	Computation and Language Computers and Society
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Measuring Teaching with LLMs
by: Hardy, Michael
Published: (2025)

Words of Warmth: Trust and Sociability Norms for over 26k English Words
by: Mohammad, Saif M.
Published: (2025)

How effective are VLMs in assisting humans in inferring the quality of mental models from Multimodal short answers?
by: Sil, Pritam, et al.
Published: (2026)

From Prejudice to Parity: A New Approach to Debiasing Large Language Model Word Embeddings
by: Rakshit, Aishik, et al.
Published: (2024)

Exploring LLM Autoscoring Reliability in Large-Scale Writing Assessments Using Generalizability Theory
by: Song, Dan, et al.
Published: (2025)

Using LLMs to create analytical datasets: A case study of reconstructing the historical memory of Colombia
by: Anderson, David, et al.
Published: (2025)

Strategic Insights in Human and Large Language Model Tactics at Word Guessing Games
by: Rikters, Matīss, et al.
Published: (2024)

"I Am the One and Only, Your Cyber BFF": Understanding the Impact of GenAI Requires Understanding the Impact of Anthropomorphic AI
by: Cheng, Myra, et al.
Published: (2024)

RogueGPT: dis-ethical tuning transforms ChatGPT4 into a Rogue AI in 158 Words
by: Buscemi, Alessio, et al.
Published: (2024)

Agree to Disagree? A Meta-Evaluation of LLM Misgendering
by: Subramonian, Arjun, et al.
Published: (2025)

A Comparative Evaluation of Structural Topic Models and BERTopic for Short, Open-Ended Survey Responses
by: Jiang, Yan, et al.
Published: (2026)

The Double Contingency Problem: AI Recursion and the Limits of Interspecies Understanding
by: Bishop, Graham L.
Published: (2025)

AI for social science and social science of AI: A Survey
by: Xu, Ruoxi, et al.
Published: (2024)

AI Safety in Generative AI Large Language Models: A Survey
by: Chua, Jaymari, et al.
Published: (2024)

Can the capability of Large Language Models be described by human ability? A Meta Study
by: Zan, Mingrui, et al.
Published: (2025)

Understanding "Democratization" in NLP and ML Research
by: Subramonian, Arjun, et al.
Published: (2024)

Empowering Bengali Education with AI: Solving Bengali Math Word Problems through Transformer Models
by: Era, Jalisha Jashim, et al.
Published: (2025)

TUX: Measuring Human--AI Tacit Understanding
by: Li, Yueshen, et al.
Published: (2026)

From Complexity to Clarity: How AI Enhances Perceptions of Scientists and the Public's Understanding of Science
by: Markowitz, David M.
Published: (2024)

MetaClimage: A novel database of visual metaphors related to Climate Change, with costs and benefits analysis
by: Scalingi, Biagio, et al.
Published: (2025)

"Would You Want an AI Tutor?" Understanding Stakeholder Perceptions of LLM-based Systems in the Classroom
by: Fuligni, Caterina, et al.
Published: (2025)

Understanding The Effect Of Temperature On Alignment With Human Opinions
by: Pavlovic, Maja, et al.
Published: (2024)

Bike Frames: Understanding the Implicit Portrayal of Cyclists in the News
by: Zhao, Xingmeng, et al.
Published: (2023)

When or What? Understanding Consumer Engagement on Digital Platforms
by: Wu, Jingyi, et al.
Published: (2025)

Understanding Teacher Revisions of Large Language Model-Generated Feedback
by: Borchers, Conrad, et al.
Published: (2026)

AI Ethics by Design: Implementing Customizable Guardrails for Responsible AI Development
by: Šekrst, Kristina, et al.
Published: (2024)

"More Than Words": Linking Music Preferences and Moral Values Through Lyrics
by: Preniqi, Vjosa, et al.
Published: (2022)

Asking an AI for salary negotiation advice is a matter of concern: Controlled experimental perturbation of ChatGPT for protected and non-protected group discrimination on a contextual task with no clear ground truth answers
by: Geiger, R. Stuart, et al.
Published: (2024)

Understanding and Mitigating Risks of Generative AI in Financial Services
by: Gehrmann, Sebastian, et al.
Published: (2025)

Conversational DNA: A New Visual Language for Understanding Dialogue Structure in Human and AI
by: Lin, Baihan
Published: (2025)

When AI Takes Sides on Questions of Faith: Persistent Asymmetries in AI-Mediated Faith Guidance
by: Israelsen, Brett, et al.
Published: (2026)

Text Is Not All You Need: Multimodal Prompting Helps LLMs Understand Humor
by: Baluja, Ashwin
Published: (2024)

Not All Jokes Land: Evaluating Large Language Models Understanding of Workplace Humor
by: Shafiei, Mohammadamin, et al.
Published: (2025)

A Participatory Strategy for AI Ethics in Education and Rehabilitation grounded in the Capability Approach
by: Cesaroni, Valeria, et al.
Published: (2025)

AGGA: A Dataset of Academic Guidelines for Generative AI and Large Language Models
by: Jiao, Junfeng, et al.
Published: (2025)

Towards Weakly-Supervised Hate Speech Classification Across Datasets
by: Jin, Yiping, et al.
Published: (2023)

Quantifying the Climate Risk of Generative AI: Region-Aware Carbon Accounting with G-TRACE and the AI Sustainability Pyramid
by: Kausar, Zahida, et al.
Published: (2025)

Understanding and Meeting Practitioner Needs When Measuring Representational Harms Caused by LLM-Based Systems
by: Harvey, Emma, et al.
Published: (2025)

Techniques for supercharging academic writing with generative AI
by: Lin, Zhicheng
Published: (2023)

SALAD: Smart AI Language Assistant Daily
by: Nihal, Ragib Amin, et al.
Published: (2024)