Copertina

Reasoning Models are Test Exploiters: Rethinking Multiple-Choice

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Raman, Narun, Lundy, Taylor, Leyton-Brown, Kevin
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

QuickScope: Certifying Hard Questions in Dynamic LLM Benchmarks
di: Lundy, Taylor, et al.
Pubblicazione: (2026)

STEER-ME: Assessing the Microeconomic Reasoning of Large Language Models
di: Raman, Narun, et al.
Pubblicazione: (2025)

STEER: Assessing the Economic Rationality of Large Language Models
di: Raman, Narun, et al.
Pubblicazione: (2024)

NFTs as a Data-Rich Test Bed: Conspicuous Consumption and its Determinants
di: Lundy, Taylor, et al.
Pubblicazione: (2025)

Test-Time Reasoners Are Strategic Multiple-Choice Test-Takers
di: Balepur, Nishant, et al.
Pubblicazione: (2025)

Understanding Understanding: A Pragmatic Framework Motivated by Large Language Models
di: Leyton-Brown, Kevin, et al.
Pubblicazione: (2024)

Rethinking Multiple-Choice Questions for RLVR: Unlocking Potential via Distractor Design
di: Guo, Xu, et al.
Pubblicazione: (2026)

A Study on Large Language Models' Limitations in Multiple-Choice Question Answering
di: Khatun, Aisha, et al.
Pubblicazione: (2024)

Boosting Process-Correct CoT Reasoning by Modeling Solvability of Multiple-Choice QA
di: Schumann, Raphael, et al.
Pubblicazione: (2025)

Plausibly Problematic Questions in Multiple-Choice Benchmarks for Commonsense Reasoning
di: Palta, Shramay, et al.
Pubblicazione: (2024)

Rethinking the Outlier Distribution in Large Language Models: An In-depth Study
di: Raman, Rahul, et al.
Pubblicazione: (2025)

Hypothesis Testing for Quantifying LLM-Human Misalignment in Multiple Choice Settings
di: Hong, Harbin, et al.
Pubblicazione: (2025)

Large Language Models Are Not Robust Multiple Choice Selectors
di: Zheng, Chujie, et al.
Pubblicazione: (2023)

When Choices Become Risks: Safety Failures of Large Language Models under Multiple-Choice Constraints
di: Chen, Yuheng, et al.
Pubblicazione: (2026)

REST: Stress Testing Large Reasoning Models by Asking Multiple Problems at Once
di: Pan, Zhuoshi, et al.
Pubblicazione: (2025)

Hierarchical Vision-Language Reasoning for Multimodal Multiple-Choice Question Answering
di: Zhou, Ao, et al.
Pubblicazione: (2025)

Graph Laplacian Wavelet Transformer via Learnable Spectral Decomposition
di: Kiruluta, Andrew, et al.
Pubblicazione: (2025)

UBench: Benchmarking Uncertainty in Large Language Models with Multiple Choice Questions
di: Wang, Xunzhi, et al.
Pubblicazione: (2024)

GeoChallenge: A Multi-Answer Multiple-Choice Benchmark for Geometric Reasoning with Diagrams
di: Zhang, Yushun, et al.
Pubblicazione: (2026)

Differentiating Choices via Commonality for Multiple-Choice Question Answering
di: Deng, Wenqing, et al.
Pubblicazione: (2024)

None of the Others: a General Technique to Distinguish Reasoning from Memorization in Multiple-Choice LLM Evaluation Benchmarks
di: Salido, Eva Sánchez, et al.
Pubblicazione: (2025)

Think Twice: Branch-and-Rethink Reasoning Reward Model
di: Jiao, Yizhu, et al.
Pubblicazione: (2025)

Multiple Choice Questions: Reasoning Makes Large Language Models (LLMs) More Self-Confident, Especially When They are Wrong
di: Fu, Tairan, et al.
Pubblicazione: (2025)

Multiple-Choice Questions are Efficient and Robust LLM Evaluators
di: Zhang, Ziyin, et al.
Pubblicazione: (2024)

The Role of the Availability Heuristic in Multiple-Choice Answering Behaviour
di: Zotos, Leonidas, et al.
Pubblicazione: (2026)

Refract ICL: Rethinking Example Selection in the Era of Million-Token Models
di: Akula, Arjun R., et al.
Pubblicazione: (2025)

ViMultiChoice: Toward a Method That Gives Explanation for Multiple-Choice Reading Comprehension in Vietnamese
di: Cao, Trung Tien, et al.
Pubblicazione: (2026)

Distractor Generation in Multiple-Choice Tasks: A Survey of Methods, Datasets, and Evaluation
di: Alhazmi, Elaf, et al.
Pubblicazione: (2024)

Math Multiple Choice Question Generation via Human-Large Language Model Collaboration
di: Lee, Jaewook, et al.
Pubblicazione: (2024)

Can Model Uncertainty Function as a Proxy for Multiple-Choice Question Item Difficulty?
di: Zotos, Leonidas, et al.
Pubblicazione: (2024)

Strengthened Symbol Binding Makes Large Language Models Reliable Multiple-Choice Selectors
di: Xue, Mengge, et al.
Pubblicazione: (2024)

MCS-SQL: Leveraging Multiple Prompts and Multiple-Choice Selection For Text-to-SQL Generation
di: Lee, Dongjun, et al.
Pubblicazione: (2024)

FourierNAT: A Fourier-Mixing-Based Non-Autoregressive Transformer for Parallel Sequence Generation
di: Kiruluta, Andrew, et al.
Pubblicazione: (2025)

Beyond Self Attention: A Subquadratic Fourier Wavelet Transformer with Multi Modal Fusion
di: Kiruluta, Andrew, et al.
Pubblicazione: (2021)

MM-PoE: Multiple Choice Reasoning via. Process of Elimination using Multi-Modal Models
di: Chakrabarty, Sayak, et al.
Pubblicazione: (2024)

Self-Correcting Large Language Models: Generation vs. Multiple Choice
di: Rahmani, Hossein A., et al.
Pubblicazione: (2025)

Bridging the Knowledge-Prediction Gap in LLMs on Multiple-Choice Questions
di: Park, Yoonah, et al.
Pubblicazione: (2025)

Pushing the Boundaries of Multiple Choice Evaluation to One Hundred Options
di: Lee, Nahyun, et al.
Pubblicazione: (2026)

Reason to Rote: Rethinking Memorization in Reasoning
di: Du, Yupei, et al.
Pubblicazione: (2025)

Improving Score Reliability of Multiple Choice Benchmarks with Consistency Evaluation and Altered Answer Choices
di: Cavalin, Paulo, et al.
Pubblicazione: (2025)