Cover Image

Perplexed: Understanding When Large Language Models are Confused

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Cooper, Nathan, Scholak, Torsten
Format:	Preprint
Published:	2024
Subjects:	Software Engineering
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Programming Language Confusion: When Code LLMs Can't Keep their Languages Straight
by: Moumoula, Micheline Bénédicte, et al.
Published: (2025)

False Friends in the Shell: Unveiling the Emoticon Semantic Confusion in Large Language Models
by: Jiang, Weipeng, et al.
Published: (2026)

On the Generalizability of Transformer Models to Code Completions of Different Lengths
by: Cooper, Nathan, et al.
Published: (2025)

Towards an Understanding of Large Language Models in Software Engineering Tasks
by: Zheng, Zibin, et al.
Published: (2023)

When Elo Lies: Hidden Biases in Codeforces-Based Evaluation of Large Language Models
by: Zheng, Shenyu, et al.
Published: (2026)

Understanding Large Language Model Supply Chain: Structure, Domain, and Vulnerabilities
by: Hu, Yanzhe, et al.
Published: (2025)

Enhancing Semantic Understanding in Pointer Analysis using Large Language Models
by: Cheng, Baijun, et al.
Published: (2025)

Can Small GenAI Language Models Rival Large Language Models in Understanding Application Behavior?
by: Meymani, Mohammad, et al.
Published: (2025)

How do Humans and LLMs Process Confusing Code?
by: Abdelsalam, Youssef, et al.
Published: (2025)

When Large Language Models Meet UAV Projects: An Empirical Study from Developers' Perspective
by: Chen, Yihua, et al.
Published: (2025)

One Size Does Not Fit All: Investigating Efficacy of Perplexity in Detecting LLM-Generated Code
by: Xu, Jinwei, et al.
Published: (2024)

Towards Understanding the Characteristics of Code Generation Errors Made by Large Language Models
by: Wang, Zhijie, et al.
Published: (2024)

Towards Understanding Bugs in Distributed Training and Inference Frameworks for Large Language Models
by: Yu, Xiao, et al.
Published: (2025)

When Large Language Models Confront Repository-Level Automatic Program Repair: How Well They Done?
by: Chen, Yuxiao, et al.
Published: (2024)

Can Causality Cure Confusion Caused By Correlation (in Software Analytics)?
by: Rayegan, Amirali, et al.
Published: (2026)

Understanding the Role of Large Language Models in Software Engineering: Evidence from an Industry Survey
by: de Brito, Vítor Mateus, et al.
Published: (2025)

Understanding the Effectiveness of Coverage Criteria for Large Language Models: A Special Angle from Jailbreak Attacks
by: Zhou, Shide, et al.
Published: (2024)

Don't Confuse! Redrawing GUI Navigation Flow in Mobile Apps for Visually Impaired Users
by: Zhang, Mengxi, et al.
Published: (2025)

Understanding the Supply Chain and Risks of Large Language Model Applications
by: Ma, Yujie, et al.
Published: (2025)

Stalled, Biased, and Confused: Uncovering Reasoning Failures in LLMs for Cloud-Based Root Cause Analysis
by: Riddell, Evelien, et al.
Published: (2026)

A Systematic Evaluation of Large Code Models in API Suggestion: When, Which, and How
by: Wang, Chaozheng, et al.
Published: (2024)

Leveraging Large Language Models for Enhancing the Understandability of Generated Unit Tests
by: Deljouyi, Amirhossein, et al.
Published: (2024)

An Empirical Study on Capability of Large Language Models in Understanding Code Semantics
by: Nguyen, Thu-Trang, et al.
Published: (2024)

An Empirical Study on the Effectiveness of Large Language Models for Binary Code Understanding
by: Shang, Xiuwei, et al.
Published: (2025)

Bridging Code Graphs and Large Language Models for Better Code Understanding
by: Chen, Zeqi, et al.
Published: (2025)

Data-Oriented Modeling for Spacecraft Design
by: Strange, Nathan
Published: (2026)

LEANCODE: Understanding Models Better for Code Simplification of Pre-trained Large Language Models
by: Wang, Yan, et al.
Published: (2025)

Hotfixing Large Language Models for Code
by: Yang, Zhou, et al.
Published: (2024)

Ecosystem of Large Language Models for Code
by: Yang, Zhou, et al.
Published: (2024)

Greening Large Language Models of Code
by: Shi, Jieke, et al.
Published: (2023)

LONGCODEU: Benchmarking Long-Context Language Models on Long Code Understanding
by: Li, Jia, et al.
Published: (2025)

LUK: Empowering Log Understanding with Expert Knowledge from Large Language Models
by: Ma, Lipeng, et al.
Published: (2024)

Are Large Language Models Robust in Understanding Code Against Semantics-Preserving Mutations?
by: Orvalho, Pedro, et al.
Published: (2025)

On the use of Large Language Models in Model-Driven Engineering
by: Di Rocco, Juri, et al.
Published: (2024)

Can Large Language Models Model Programs Formally?
by: Chen, Zhiyong, et al.
Published: (2026)

Commit Messages in the Age of Large Language Models
by: Lopes, Cristina V., et al.
Published: (2024)

Program Slicing in the Era of Large Language Models
by: Shahandashti, Kimya Khakzad, et al.
Published: (2024)

Normative Requirements Operationalization with Large Language Models
by: Feng, Nick, et al.
Published: (2024)

Efficient Function Orchestration for Large Language Models
by: Liu, Xiaoxia, et al.
Published: (2025)

Testing Framework Migration with Large Language Models
by: Alves, Altino, et al.
Published: (2026)