Cover Image

Characterizing LLM Abstention Behavior in Science QA with Context Perturbations

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wen, Bingbing, Howe, Bill, Wang, Lucy Lu
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Know Your Limits: A Survey of Abstention in Large Language Models
by: Wen, Bingbing, et al.
Published: (2024)

STOP: Structured On-Policy Pruning of Long-Form Reasoning in Low-Data Regimes
by: Xu, Chenjun, et al.
Published: (2026)

MixAtlas: Uncertainty-aware Data Mixture Optimization for Multimodal LLM Midtraining
by: Wen, Bingbing, et al.
Published: (2026)

Clarify or Answer: Reinforcement Learning for Agentic VQA with Context Under-specification
by: Cao, Zongwan, et al.
Published: (2026)

ML-EAT: A Multilevel Embedding Association Test for Interpretable and Transparent Social Science
by: Wolfe, Robert, et al.
Published: (2024)

Epistemic Alignment: A Mediating Framework for User-LLM Knowledge Delivery
by: Clark, Nicholas, et al.
Published: (2025)

Selective "Selective Prediction": Reducing Unnecessary Abstention in Vision-Language Reasoning
by: Srinivasan, Tejas, et al.
Published: (2024)

Mitigating LLM Hallucinations via Conformal Abstention
by: Yadkori, Yasin Abbasi, et al.
Published: (2024)

Sacred or Synthetic? Evaluating LLM Reliability and Abstention for Religious Questions
by: Atif, Farah, et al.
Published: (2025)

I-CALM: Incentivizing Confidence-Aware Abstention for LLM Hallucination Mitigation
by: Zong, Haotian, et al.
Published: (2026)

Towards Zero-Shot Annotation of the Built Environment with Vision-Language Models (Vision Paper)
by: Han, Bin, et al.
Published: (2024)

CQA-Eval: Designing Reliable Evaluations of Multi-paragraph Clinical QA under Resource Constraints
by: Bologna, Federica, et al.
Published: (2025)

What External Knowledge is Preferred by LLMs? Characterizing and Exploring Chain of Evidence in Imperfect Context for Multi-Hop QA
by: Chang, Zhiyuan, et al.
Published: (2024)

Can Large Language Models Integrate Spatial Data? Empirical Insights into Reasoning Strengths and Computational Weaknesses
by: Han, Bin, et al.
Published: (2025)

NovelHopQA: Diagnosing Multi-Hop Reasoning Failures in Long Narrative Contexts
by: Gupta, Abhay, et al.
Published: (2025)

When to Speak, When to Abstain: Contrastive Decoding with Abstention
by: Kim, Hyuhng Joon, et al.
Published: (2024)

MASH: Modeling Abstention via Selective Help-Seeking
by: Gul, Mustafa Omer, et al.
Published: (2025)

DetectiveQA: Evaluating Long-Context Reasoning on Detective Novels
by: Xu, Zhe, et al.
Published: (2024)

Expect the Unexpected: FailSafe Long Context QA for Finance
by: Kamble, Kiran, et al.
Published: (2025)

KG-MuLQA: A Framework for KG-based Multi-Level QA Extraction and Long-Context LLM Evaluation
by: Tatarinov, Nikita, et al.
Published: (2025)

Representation Bias of Adolescents in AI: A Bilingual, Bicultural Study
by: Wolfe, Robert, et al.
Published: (2024)

Knowledge Graph Guided Evaluation of Abstention Techniques
by: Vasisht, Kinshuk, et al.
Published: (2024)

Geometry-Calibrated Conformal Abstention for Language Models
by: Xu, Rui, et al.
Published: (2026)

Effective Skill Unlearning through Intervention and Abstention
by: Li, Yongce, et al.
Published: (2025)

Dataset Scale and Societal Consistency Mediate Facial Impression Bias in Vision-Language AI
by: Wolfe, Robert, et al.
Published: (2024)

QA-LIGN: Aligning LLMs through Constitutionally Decomposed QA
by: Dineen, Jacob, et al.
Published: (2025)

InfoLossQA: Characterizing and Recovering Information Loss in Text Simplification
by: Trienes, Jan, et al.
Published: (2024)

According to Me: Long-Term Personalized Referential Memory QA
by: Mei, Jingbiao, et al.
Published: (2026)

KnowGuard: Knowledge-Driven Abstention for Multi-Round Clinical Reasoning
by: Dang, Xilin, et al.
Published: (2025)

GRACE: Reinforcement Learning for Grounded Response and Abstention under Contextual Evidence
by: Zhao, Yibo, et al.
Published: (2026)

Augmenting LLM Reasoning with Dynamic Notes Writing for Complex QA
by: Maheshwary, Rishabh, et al.
Published: (2025)

StorySparkQA: Expert-Annotated QA Pairs with Real-World Knowledge for Children's Story-Based Learning
by: Chen, Jiaju, et al.
Published: (2023)

Knowing When Not to Answer: Abstention-Aware Scientific Reasoning
by: Abdaljalil, Samir, et al.
Published: (2026)

MKA: Leveraging Cross-Lingual Consensus for Model Abstention
by: Duwal, Sharad
Published: (2025)

RepoQA: Evaluating Long Context Code Understanding
by: Liu, Jiawei, et al.
Published: (2024)

Do LLM Self-Explanations Help Users Predict Model Behavior? Evaluating Counterfactual Simulatability with Pragmatic Perturbations
by: Hong, Pingjun, et al.
Published: (2026)

TIAR: Trajectory-Informed Advantage Reweighting for LLM Abstention Learning
by: Pan, Muyu, et al.
Published: (2026)

Shuffle the Context: RoPE-Perturbed Self-Distillation for Long-Context Adaptation
by: Li, Zichong, et al.
Published: (2026)

Knowing When Not to Answer: Evaluating Abstention in Multimodal Reasoning Systems
by: Madhusudhan, Nishanth, et al.
Published: (2026)

PaperHelper: Knowledge-Based LLM QA Paper Reading Assistant
by: Yin, Congrui, et al.
Published: (2025)