Cover Image

Think Twice: Measuring the Efficiency of Eliminating Prediction Shortcuts of Question Answering Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Mikula, Lukáš, Štefánik, Michal, Petrovič, Marek, Sojka, Petr
Format:	Preprint
Published:	2023
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Concept-aware Data Construction Improves In-context Learning of Language Models
by: Štefánik, Michal, et al.
Published: (2024)

Can Out-of-Distribution Evaluations Uncover Reliance on Shortcuts? A Case Study in Question Answering
by: Štefánik, Michal, et al.
Published: (2025)

Self-training Language Models for Arithmetic Reasoning
by: Kadlčík, Marek, et al.
Published: (2024)

Negation: A Pink Elephant in the Large Language Models' Room?
by: Vrabcová, Tereza, et al.
Published: (2025)

Don't Think Twice! Over-Reasoning Impairs Confidence Calibration
by: Lacombe, Romain, et al.
Published: (2025)

Think Twice, Generate Once: Safeguarding by Progressive Self-Reflection
by: Phan, Hoang, et al.
Published: (2025)

Measuring Retrieval Complexity in Question Answering Systems
by: Gabburo, Matteo, et al.
Published: (2024)

RTQA : Recursive Thinking for Complex Temporal Knowledge Graph Question Answering with Large Language Models
by: Gong, Zhaoyan, et al.
Published: (2025)

GPTQT: Quantize Large Language Models Twice to Push the Efficiency
by: Guo, Yipin, et al.
Published: (2024)

Ontology-Guided Reverse Thinking Makes Large Language Models Stronger on Knowledge Graph Question Answering
by: Liu, Runxuan, et al.
Published: (2025)

Think Twice Before You Write -- an Entropy-based Decoding Strategy to Enhance LLM Reasoning
by: He, Jiashu, et al.
Published: (2026)

To Think or Not To Think, That is The Question for Large Reasoning Models in Theory of Mind Tasks
by: Gong, Nanxu, et al.
Published: (2026)

MedPAIR: Measuring Physicians and AI Relevance Alignment in Medical Question Answering
by: Hao, Yuexing, et al.
Published: (2025)

Pathways of Thoughts: Multi-Directional Thinking for Long-form Personalized Question Answering
by: Salemi, Alireza, et al.
Published: (2025)

TRAQ: Trustworthy Retrieval Augmented Question Answering via Conformal Prediction
by: Li, Shuo, et al.
Published: (2023)

Measuring and Eliminating Refusals in Military Large Language Models
by: FitzGerald, Jack, et al.
Published: (2026)

The Dog the Cat Chased Stumped the Model: Measuring When Language Models Abandon Structure for Shortcuts
by: Madhusudan, Sangmitra, et al.
Published: (2025)

Language Models Learn Universal Representations of Numbers and Here's Why You Should Care
by: Štefánik, Michal, et al.
Published: (2025)

Efficient Medical Question Answering with Knowledge-Augmented Question Generation
by: Khlaut, Julien, et al.
Published: (2024)

Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering
by: Adlakha, Vaibhav, et al.
Published: (2023)

GSQA: An End-to-End Model for Generative Spoken Question Answering
by: Shih, Min-Han, et al.
Published: (2023)

Mitigating Knowledge Conflicts in Language Model-Driven Question Answering
by: Cao, Han, et al.
Published: (2024)

Multilingual Medical Reasoning for Question Answering with Large Language Models
by: Ferrazzi, Pietro, et al.
Published: (2025)

Uncertainty Estimation of Large Language Models in Medical Question Answering
by: Wu, Jiaxin, et al.
Published: (2024)

Think Twice, Click Once: Enhancing GUI Grounding via Fast and Slow Systems
by: Tang, Fei, et al.
Published: (2025)

QPaug: Question and Passage Augmentation for Open-Domain Question Answering of LLMs
by: Kim, Minsang, et al.
Published: (2024)

Towards Robust Extractive Question Answering Models: Rethinking the Training Methodology
by: Tran, Son Quoc, et al.
Published: (2024)

Collaboration among Multiple Large Language Models for Medical Question Answering
by: Shang, Kexin, et al.
Published: (2025)

Cost-efficient Knowledge-based Question Answering with Large Language Models
by: Dong, Junnan, et al.
Published: (2024)

Multilingual State Space Models for Structured Question Answering in Indic Languages
by: Vats, Arpita, et al.
Published: (2025)

Leveraging Large Language Models in Code Question Answering: Baselines and Issues
by: Andryushchenko, Georgy, et al.
Published: (2024)

Question-to-Question Retrieval for Hallucination-Free Knowledge Access: An Approach for Wikipedia and Wikidata Question Answering
by: Thottingal, Santhosh
Published: (2025)

On Early Detection of Hallucinations in Factual Question Answering
by: Snyder, Ben, et al.
Published: (2023)

Structural Deep Encoding for Table Question Answering
by: Mouravieff, Raphaël, et al.
Published: (2025)

A Collection of Question Answering Datasets for Norwegian
by: Mikhailov, Vladislav, et al.
Published: (2025)

Seek and Solve Reasoning for Table Question Answering
by: Jiang, Ruya, et al.
Published: (2024)

Open Domain Question Answering with Conflicting Contexts
by: Liu, Siyi, et al.
Published: (2024)

HPE:Answering Complex Questions over Text by Hybrid Question Parsing and Execution
by: Liu, Ye, et al.
Published: (2023)

iQUEST: An Iterative Question-Guided Framework for Knowledge Base Question Answering
by: Wang, Shuai, et al.
Published: (2025)

A Learn-Then-Reason Model Towards Generalization in Knowledge Base Question Answering
by: Zhang, Lingxi, et al.
Published: (2024)