Cover Image

LLM Distillation for Efficient Few-Shot Multiple Choice Question Answering

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Sutanto, Patrick, Santoso, Joan, Setiawan, Esther Irawati, Wibawa, Aji Prasetya
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Meta-Adaptive Prompt Distillation for Few-Shot Visual Question Answering
by: Gupta, Akash, et al.
Published: (2025)

Multiple-Choice Questions are Efficient and Robust LLM Evaluators
by: Zhang, Ziyin, et al.
Published: (2024)

Differentiating Choices via Commonality for Multiple-Choice Question Answering
by: Deng, Wenqing, et al.
Published: (2024)

Right Answer, Wrong Score: Uncovering the Inconsistencies of LLM Evaluation in Multiple-Choice Question Answering
by: Molfese, Francesco Maria, et al.
Published: (2025)

Improving LLM First-Token Predictions in Multiple-Choice Question Answering via Output Prefilling
by: Cappelletti, Silvia, et al.
Published: (2025)

Prompting-based Synthetic Data Generation for Few-Shot Question Answering
by: Schmidt, Maximilian, et al.
Published: (2024)

Dynamic Few-Shot Learning for Knowledge Graph Question Answering
by: D'Abramo, Jacopo, et al.
Published: (2024)

Biomedical Entity Linking as Multiple Choice Question Answering
by: Lin, Zhenxi, et al.
Published: (2024)

Few-Shot Data Synthesis for Open Domain Multi-Hop Question Answering
by: Chen, Mingda, et al.
Published: (2023)

Investigating Prompting Techniques for Zero- and Few-Shot Visual Question Answering
by: Awal, Rabiul, et al.
Published: (2023)

FlexKBQA: A Flexible LLM-Powered Framework for Few-Shot Knowledge Base Question Answering
by: Li, Zhenyu, et al.
Published: (2023)

Applying Relation Extraction and Graph Matching to Answering Multiple Choice Questions
by: Shimoda, Naoki, et al.
Published: (2025)

FM2DS: Few-Shot Multimodal Multihop Data Synthesis with Knowledge Distillation for Question Answering
by: Abaskohi, Amirhossein, et al.
Published: (2024)

More Bias, Less Bias: BiasPrompting for Enhanced Multiple-Choice Question Answering
by: Vu, Duc Anh, et al.
Published: (2025)

Mind the Gap: A Closer Look at Tokenization for Multiple-Choice Question Answering with LLMs
by: Sanz-Guerrero, Mario, et al.
Published: (2025)

Hierarchical Vision-Language Reasoning for Multimodal Multiple-Choice Question Answering
by: Zhou, Ao, et al.
Published: (2025)

In-Context Learning Distillation for Efficient Few-Shot Fine-Tuning
by: Duan, Yifei, et al.
Published: (2024)

Accurate Knowledge Distillation with n-best Reranking
by: Setiawan, Hendra
Published: (2023)

Conformal P-Value in Multiple-Choice Question Answering Tasks with Provable Risk Control
by: Ye, Yuanchang
Published: (2025)

A Study on Large Language Models' Limitations in Multiple-Choice Question Answering
by: Khatun, Aisha, et al.
Published: (2024)

Addressing Blind Guessing: Calibration of Selection Bias in Multiple-Choice Question Answering by Video Language Models
by: Loginova, Olga, et al.
Published: (2024)

When Models Decide and When They Bind: A Two-Stage Computation for Multiple-Choice Question-Answering
by: Wong, Hugh Mee, et al.
Published: (2026)

Correctness Coverage Evaluation for Medical Multiple-Choice Question Answering Based on the Enhanced Conformal Prediction Framework
by: Ke, Yusong, et al.
Published: (2025)

Language Model Knowledge Distillation for Efficient Question Answering in Spanish
by: Bazaga, Adrián, et al.
Published: (2023)

CoDi: Conversational Distillation for Grounded Question Answering
by: Huber, Patrick, et al.
Published: (2024)

Polyglots or Multitudes? Multilingual LLM Answers to Value-laden Multiple-Choice Questions
by: Labat, Léo, et al.
Published: (2026)

The Role of the Availability Heuristic in Multiple-Choice Answering Behaviour
by: Zotos, Leonidas, et al.
Published: (2026)

LLM-Driven Data Generation and a Novel Soft Metric for Evaluating Text-to-SQL in Aviation MRO
by: Sutanto, Patrick, et al.
Published: (2025)

Conformal Sets in Multiple-Choice Question Answering under Black-Box Settings with Provable Coverage Guarantees
by: Yang, Guang, et al.
Published: (2025)

(WhyPHI) Fine-Tuning PHI-3 for Multiple-Choice Question Answering: Methodology, Results, and Challenges
by: Abdellatif, Mohamed Hisham
Published: (2025)

LLM Ensemble for RAG: Role of Context Length in Zero-Shot Question Answering for BioASQ Challenge
by: Galat, Dima, et al.
Published: (2025)

Multimodal Commonsense Knowledge Distillation for Visual Question Answering
by: Yang, Shuo, et al.
Published: (2024)

Self-Correction Distillation for Structured Data Question Answering
by: Zhu, Yushan, et al.
Published: (2025)

Few-shot Policy (de)composition in Conversational Question Answering
by: Erwin, Kyle, et al.
Published: (2025)

Bridging the Knowledge-Prediction Gap in LLMs on Multiple-Choice Questions
by: Park, Yoonah, et al.
Published: (2025)

Artifacts or Abduction: How Do LLMs Answer Multiple-Choice Questions Without the Question?
by: Balepur, Nishant, et al.
Published: (2024)

GRAF: Graph Retrieval Augmented by Facts for Romanian Legal Multi-Choice Question Answering
by: Crăciun, Cristian-George, et al.
Published: (2024)

Teaching Sarcasm: Few-Shot Multimodal Sarcasm Detection via Distillation to a Parameter-Efficient Student
by: Jana, Soumyadeep, et al.
Published: (2025)

GeMQuAD : Generating Multilingual Question Answering Datasets from Large Language Models using Few Shot Learning
by: Namboori, Amani, et al.
Published: (2024)

Question Difficulty Ranking for Multiple-Choice Reading Comprehension
by: Raina, Vatsal, et al.
Published: (2024)