Imagen de Portada

Addressing Blind Guessing: Calibration of Selection Bias in Multiple-Choice Question Answering by Video Language Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Loginova, Olga, Bezrukov, Oleksandr, Shekhar, Ravi, Kravets, Alexey
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

More Bias, Less Bias: BiasPrompting for Enhanced Multiple-Choice Question Answering
por: Vu, Duc Anh, et al.
Publicado: (2025)

Differentiating Choices via Commonality for Multiple-Choice Question Answering
por: Deng, Wenqing, et al.
Publicado: (2024)

A Study on Large Language Models' Limitations in Multiple-Choice Question Answering
por: Khatun, Aisha, et al.
Publicado: (2024)

Hierarchical Vision-Language Reasoning for Multimodal Multiple-Choice Question Answering
por: Zhou, Ao, et al.
Publicado: (2025)

Deep Temporal Reasoning in Video Language Models: A Cross-Linguistic Evaluation of Action Duration and Completion through Perfect Times
por: Loginova, Olga, et al.
Publicado: (2025)

LLM Distillation for Efficient Few-Shot Multiple Choice Question Answering
por: Sutanto, Patrick, et al.
Publicado: (2024)

Do Large Language Models Plan Answer Positions? Position Bias in Multiple-Choice Question Generation
por: Tang, Xuemei, et al.
Publicado: (2026)

Biomedical Entity Linking as Multiple Choice Question Answering
por: Lin, Zhenxi, et al.
Publicado: (2024)

Calibrated Large Language Models for Binary Question Answering
por: Giovannotti, Patrizio, et al.
Publicado: (2024)

Applying Relation Extraction and Graph Matching to Answering Multiple Choice Questions
por: Shimoda, Naoki, et al.
Publicado: (2025)

Question Calibration and Multi-Hop Modeling for Temporal Question Answering
por: Xue, Chao, et al.
Publicado: (2024)

When Models Decide and When They Bind: A Two-Stage Computation for Multiple-Choice Question-Answering
por: Wong, Hugh Mee, et al.
Publicado: (2026)

Mind the Gap: A Closer Look at Tokenization for Multiple-Choice Question Answering with LLMs
por: Sanz-Guerrero, Mario, et al.
Publicado: (2025)

Assessing Modality Bias in Video Question Answering Benchmarks with Multimodal Large Language Models
por: Park, Jean, et al.
Publicado: (2024)

UBench: Benchmarking Uncertainty in Large Language Models with Multiple Choice Questions
por: Wang, Xunzhi, et al.
Publicado: (2024)

Knowing or Guessing? Robust Medical Visual Question Answering via Joint Consistency and Contrastive Learning
por: Jiang, Songtao, et al.
Publicado: (2025)

Right Answer, Wrong Score: Uncovering the Inconsistencies of LLM Evaluation in Multiple-Choice Question Answering
por: Molfese, Francesco Maria, et al.
Publicado: (2025)

Improving LLM First-Token Predictions in Multiple-Choice Question Answering via Output Prefilling
por: Cappelletti, Silvia, et al.
Publicado: (2025)

Robust Bias Evaluation with FilBBQ: A Filipino Bias Benchmark for Question-Answering Language Models
por: Gamboa, Lance Calvin Lim, et al.
Publicado: (2026)

Adaptive Question Answering: Enhancing Language Model Proficiency for Addressing Knowledge Conflicts with Source Citations
por: Shaier, Sagi, et al.
Publicado: (2024)

Conformal P-Value in Multiple-Choice Question Answering Tasks with Provable Risk Control
por: Ye, Yuanchang
Publicado: (2025)

CAST: Cross-modal Alignment Similarity Test for Vision Language Models
por: Dagan, Gautier, et al.
Publicado: (2024)

BQA: Body Language Question Answering Dataset for Video Large Language Models
por: Ozaki, Shintaro, et al.
Publicado: (2024)

Correctness Coverage Evaluation for Medical Multiple-Choice Question Answering Based on the Enhanced Conformal Prediction Framework
por: Ke, Yusong, et al.
Publicado: (2025)

Mitigating Bias for Question Answering Models by Tracking Bias Influence
por: Ma, Mingyu Derek, et al.
Publicado: (2023)

Benchmarking Uncertainty Calibration in Large Language Model Long-Form Question Answering
por: Müller, Philip, et al.
Publicado: (2026)

On the Calibration of Multilingual Question Answering LLMs
por: Yang, Yahan, et al.
Publicado: (2023)

Math Multiple Choice Question Generation via Human-Large Language Model Collaboration
por: Lee, Jaewook, et al.
Publicado: (2024)

Collaboration among Multiple Large Language Models for Medical Question Answering
por: Shang, Kexin, et al.
Publicado: (2025)

Anchored Answers: Unravelling Positional Bias in GPT-2's Multiple-Choice Questions
por: Li, Ruizhe, et al.
Publicado: (2024)

GuessingGame: Measuring the Informativeness of Open-Ended Questions in Large Language Models
por: Hutson, Dylan, et al.
Publicado: (2025)

The Role of the Availability Heuristic in Multiple-Choice Answering Behaviour
por: Zotos, Leonidas, et al.
Publicado: (2026)

Conformal Sets in Multiple-Choice Question Answering under Black-Box Settings with Provable Coverage Guarantees
por: Yang, Guang, et al.
Publicado: (2025)

(WhyPHI) Fine-Tuning PHI-3 for Multiple-Choice Question Answering: Methodology, Results, and Challenges
por: Abdellatif, Mohamed Hisham
Publicado: (2025)

Social Bias in Popular Question-Answering Benchmarks
por: Kraft, Angelie, et al.
Publicado: (2025)

KS-LLM: Knowledge Selection of Large Language Models with Evidence Document for Question Answering
por: Zheng, Xinxin, et al.
Publicado: (2024)

Selectively Answering Visual Questions
por: Eisenschlos, Julian Martin, et al.
Publicado: (2024)

Positional Bias in Binary Question Answering: How Uncertainty Shapes Model Preferences
por: Labruna, Tiziano, et al.
Publicado: (2025)

Multiple-Choice Question Generation Using Large Language Models: Methodology and Educator Insights
por: Biancini, Giorgio, et al.
Publicado: (2025)

Multiple-Choice Questions are Efficient and Robust LLM Evaluators
por: Zhang, Ziyin, et al.
Publicado: (2024)