Cover Image

Why Attention Fails: A Taxonomy of Faults in Attention-Based Neural Networks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Jahan, Sigma, Rajput, Saurabh Singh, Sharma, Tushar, Rahman, Mohammad Masudur
Format:	Preprint
Published:	2025
Subjects:	Software Engineering Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

DEFault++: Automated Fault Detection, Categorization, and Diagnosis for Transformer Architectures
by: Jahan, Sigma, et al.
Published: (2026)

Can Hessian-Based Insights Support Fault Diagnosis in Attention-based Models?
by: Jahan, Sigma, et al.
Published: (2025)

Improved Detection and Diagnosis of Faults in Deep Neural Networks Using Hierarchical and Explainable Classification
by: Jahan, Sigma, et al.
Published: (2025)

Towards Understanding the Challenges of Bug Localization in Deep Learning Systems
by: Jahan, Sigma, et al.
Published: (2024)

Tu(r)ning AI Green: Exploring Energy Efficiency Cascading with Orthogonal Optimizations
by: Rajput, Saurabhsingh, et al.
Published: (2025)

Characterizing Faults in Agentic AI: A Taxonomy of Types, Symptoms, and Root Causes
by: Shah, Mehil B, et al.
Published: (2026)

A Validated Taxonomy on Software Energy Smells
by: Mehditabar, Mohammadjavad, et al.
Published: (2026)

COMET: Generating Commit Messages using Delta Graph Context Representation
by: Mandli, Abhinav Reddy, et al.
Published: (2024)

Imitation Game: Reproducing Deep Learning Bugs Leveraging an Intelligent Agent
by: Shah, Mehil B, et al.
Published: (2025)

WebSuite: Systematically Evaluating Why Web Agents Fail
by: Li, Eric, et al.
Published: (2024)

Improved Bug Localization with AI Agents Leveraging Hypothesis and Dynamic Cognition
by: Samir, Asif Mohammed, et al.
Published: (2026)

Exploring Autonomous Agents: A Closer Look at Why They Fail When Completing Tasks
by: Lu, Ruofan, et al.
Published: (2025)

Five Fatal Assumptions: Why T-Shirt Sizing Systematically Fails for AI Projects
by: Soundaramourty, Raja, et al.
Published: (2026)

Coherence Collapse: Diagnosing Why Code Agents Fail After Reaching the Right Code
by: Kim, Myeongsoo, et al.
Published: (2026)

BugMentor: Generating Answers to Follow-up Questions from Software Bug Reports using Structured Information Retrieval and Neural Text Generation
by: Mukherjee, Usmi, et al.
Published: (2023)

Beyond Self-learned Attention: Mitigating Attention Bias in Transformer-based Models Using Attention Guidance
by: Gesi, Jiri, et al.
Published: (2024)

Where Do AI Coding Agents Fail? An Empirical Study of Failed Agentic Pull Requests in GitHub
by: Ehsani, Ramtin, et al.
Published: (2026)

MAGNET: A Multi-Graph Attentional Network for Code Clone Detection
by: Zhang, Zixian, et al.
Published: (2025)

Energy Flow Graph: Modeling Software Energy Consumption
by: Rajput, Saurabhsingh, et al.
Published: (2026)

CodeGreen: Towards Improving Precision and Portability in Software Energy Measurement
by: Rajput, Saurabhsingh, et al.
Published: (2026)

Enhancing Energy-Awareness in Deep Learning through Fine-Grained Energy Measurement
by: Rajput, Saurabhsingh, et al.
Published: (2023)

Improved IR-based Bug Localization with Intelligent Relevance Feedback
by: Samir, Asif Mohammed, et al.
Published: (2025)

Attention Mechanism and Heuristic Approach: Context-Aware File Ranking Using Multi-Head Self-Attention
by: Sharma, Pradeep Kumar, et al.
Published: (2026)

Explaining Software Bugs Leveraging Code Structures in Neural Machine Translation
by: Mahbub, Parvez, et al.
Published: (2022)

Understanding the Impact of Domain Term Explanation on Duplicate Bug Report Detection
by: Mukherjee, Usmi, et al.
Published: (2025)

Do Internal Software Metrics Have Relationship with Fault-proneness and Change-proneness?
by: Rahman, Md. Masudur, et al.
Published: (2023)

RBT4DNN: Requirements-based Testing of Neural Networks
by: Mozumder, Nusrat Jahan, et al.
Published: (2025)

Challenges in Testing Large Language Model Based Software: A Faceted Taxonomy
by: Dobslaw, Felix, et al.
Published: (2025)

Attention Distance: A Novel Metric for Directed Fuzzing with Large Language Models
by: Bin, Wang, et al.
Published: (2025)

Data Mining-Based Techniques for Software Fault Localization
by: Cellier, Peggy, et al.
Published: (2025)

On the Role of Fault Localization Context for LLM-Based Program Repair
by: Sepidband, Melika, et al.
Published: (2026)

Engineering Reasoning and Instruction (ERI) Benchmark: A Large Taxonomy-driven Dataset for Foundation Models and Agents
by: Naser, MZ, et al.
Published: (2026)

Improving IR-based Bug Localization with Semantics-Driven Query Reduction
by: Samir, Asif Mohammed, et al.
Published: (2025)

Be a Partner, not a Bystander in Software Engineering Practice: Bridging the Gaps between Academia and Industry
by: Rahman, Mohammad Masudur, et al.
Published: (2026)

Nova: Generative Language Models for Assembly Code with Hierarchical Attention and Contrastive Learning
by: Jiang, Nan, et al.
Published: (2023)

Automating Patch Set Generation from Code Review Comments Using Large Language Models
by: Rahman, Tajmilur, et al.
Published: (2024)

An Evaluation of Context Length Extrapolation in Long Code via Positional Embeddings and Efficient Attention
by: Ghosh, Madhusudan, et al.
Published: (2026)

AutoEmpirical: LLM-Based Automated Research for Empirical Software Fault Analysis
by: Yu, Jiongchi, et al.
Published: (2025)

Swiss Cheese Model for AI Safety: A Taxonomy and Reference Architecture for Multi-Layered Guardrails of Foundation Model Based Agents
by: Shamsujjoha, Md, et al.
Published: (2024)

Path Analysis for Effective Fault Localization in Deep Neural Networks
by: Hashemifar, Soroush, et al.
Published: (2023)