Copertina

Multiple-Choice Questions are Efficient and Robust LLM Evaluators

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zhang, Ziyin, Jiang, Zhaokun, Xu, Lizhen, Hao, Hongkun, Wang, Rui
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

From Black Box to Transparency: Enhancing Automated Interpreting Assessment with Explainable AI in College Classrooms
di: Jiang, Zhaokun, et al.
Pubblicazione: (2025)

Convergences and Divergences between Automatic Assessment and Human Evaluation: Insights from Comparing ChatGPT-Generated Translation and Neural Machine Translation
di: Jiang, Zhaokun, et al.
Pubblicazione: (2024)

Distinguishing Translations by Human, NMT, and ChatGPT: A Linguistic and Statistical Approach
di: Jiang, Zhaokun, et al.
Pubblicazione: (2023)

LLM Distillation for Efficient Few-Shot Multiple Choice Question Answering
di: Sutanto, Patrick, et al.
Pubblicazione: (2024)

Differentiating Choices via Commonality for Multiple-Choice Question Answering
di: Deng, Wenqing, et al.
Pubblicazione: (2024)

Right Answer, Wrong Score: Uncovering the Inconsistencies of LLM Evaluation in Multiple-Choice Question Answering
di: Molfese, Francesco Maria, et al.
Pubblicazione: (2025)

Polyglots or Multitudes? Multilingual LLM Answers to Value-laden Multiple-Choice Questions
di: Labat, Léo, et al.
Pubblicazione: (2026)

Is Self-knowledge and Action Consistent or Not: Investigating Large Language Model's Personality
di: Ai, Yiming, et al.
Pubblicazione: (2024)

F2LLM-v2: Inclusive, Performant, and Efficient Embeddings for a Multilingual World
di: Zhang, Ziyin, et al.
Pubblicazione: (2026)

UBench: Benchmarking Uncertainty in Large Language Models with Multiple Choice Questions
di: Wang, Xunzhi, et al.
Pubblicazione: (2024)

Large Language Models Are Not Robust Multiple Choice Selectors
di: Zheng, Chujie, et al.
Pubblicazione: (2023)

Improving LLM First-Token Predictions in Multiple-Choice Question Answering via Output Prefilling
di: Cappelletti, Silvia, et al.
Pubblicazione: (2025)

Evaluating and Calibrating LLM Confidence on Questions with Multiple Correct Answers
di: Wang, Yuhan, et al.
Pubblicazione: (2026)

Automated Generation of Challenging Multiple-Choice Questions for Vision Language Model Evaluation
di: Zhang, Yuhui, et al.
Pubblicazione: (2025)

Rethinking Multiple-Choice Questions for RLVR: Unlocking Potential via Distractor Design
di: Guo, Xu, et al.
Pubblicazione: (2026)

Simulating Training Data Leakage in Multiple-Choice Benchmarks for LLM Evaluation
di: Hidayat, Naila Shafirni, et al.
Pubblicazione: (2025)

Bridging the Knowledge-Prediction Gap in LLMs on Multiple-Choice Questions
di: Park, Yoonah, et al.
Pubblicazione: (2025)

Artifacts or Abduction: How Do LLMs Answer Multiple-Choice Questions Without the Question?
di: Balepur, Nishant, et al.
Pubblicazione: (2024)

Biomedical Entity Linking as Multiple Choice Question Answering
di: Lin, Zhenxi, et al.
Pubblicazione: (2024)

Evaluating the Symbol Binding Ability of Large Language Models for Multiple-Choice Questions in Vietnamese General Education
di: Nguyen, Duc-Vu, et al.
Pubblicazione: (2023)

Correctness Coverage Evaluation for Medical Multiple-Choice Question Answering Based on the Enhanced Conformal Prediction Framework
di: Ke, Yusong, et al.
Pubblicazione: (2025)

Question Difficulty Ranking for Multiple-Choice Reading Comprehension
di: Raina, Vatsal, et al.
Pubblicazione: (2024)

Jigsaw Puzzles: Splitting Harmful Questions to Jailbreak Large Language Models
di: Yang, Hao, et al.
Pubblicazione: (2024)

Beyond Multiple Choice: Verifiable OpenQA for Robust Vision-Language RFT
di: Liu, Yesheng, et al.
Pubblicazione: (2025)

Hierarchical Vision-Language Reasoning for Multimodal Multiple-Choice Question Answering
di: Zhou, Ao, et al.
Pubblicazione: (2025)

Plausibly Problematic Questions in Multiple-Choice Benchmarks for Commonsense Reasoning
di: Palta, Shramay, et al.
Pubblicazione: (2024)

Generating Plausible Distractors for Multiple-Choice Questions via Student Choice Prediction
di: Lee, Yooseop, et al.
Pubblicazione: (2025)

ML-Embed: Inclusive and Efficient Embeddings for a Multilingual World
di: Zhang, Ziyin, et al.
Pubblicazione: (2026)

Option-ID Based Elimination For Multiple Choice Questions
di: Zhu, Zhenhao, et al.
Pubblicazione: (2025)

Distractor Generation in Multiple-Choice Tasks: A Survey of Methods, Datasets, and Evaluation
di: Alhazmi, Elaf, et al.
Pubblicazione: (2024)

MCQG-SRefine: Multiple Choice Question Generation and Evaluation with Iterative Self-Critique, Correction, and Comparison Feedback
di: Yao, Zonghai, et al.
Pubblicazione: (2024)

F2LLM Technical Report: Matching SOTA Embedding Performance with 6 Million Open-Source Data
di: Zhang, Ziyin, et al.
Pubblicazione: (2025)

Automated Generation and Tagging of Knowledge Components from Multiple-Choice Questions
di: Moore, Steven, et al.
Pubblicazione: (2024)

Math Multiple Choice Question Generation via Human-Large Language Model Collaboration
di: Lee, Jaewook, et al.
Pubblicazione: (2024)

Can Model Uncertainty Function as a Proxy for Multiple-Choice Question Item Difficulty?
di: Zotos, Leonidas, et al.
Pubblicazione: (2024)

Applying Relation Extraction and Graph Matching to Answering Multiple Choice Questions
di: Shimoda, Naoki, et al.
Pubblicazione: (2025)

Enhancing Clinical Multiple-Choice Questions Benchmarks with Knowledge Graph Guided Distractor Generation
di: Yang, Running, et al.
Pubblicazione: (2025)

More Bias, Less Bias: BiasPrompting for Enhanced Multiple-Choice Question Answering
di: Vu, Duc Anh, et al.
Pubblicazione: (2025)

Mind the Gap: A Closer Look at Tokenization for Multiple-Choice Question Answering with LLMs
di: Sanz-Guerrero, Mario, et al.
Pubblicazione: (2025)

UnibucLLM: Harnessing LLMs for Automated Prediction of Item Difficulty and Response Time for Multiple-Choice Questions
di: Rogoz, Ana-Cristina, et al.
Pubblicazione: (2024)