Cover Image

Language Model Knowledge Distillation for Efficient Question Answering in Spanish

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Bazaga, Adrián, Liò, Pietro, Micklem, Gos
Format:	Preprint
Published:	2023
Subjects:	Computation and Language Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Unsupervised Pretraining for Fact Verification by Language Model Distillation
by: Bazaga, Adrián, et al.
Published: (2023)

HyperBERT: Mixing Hypergraph-Aware Layers with Language Models for Node Classification on Text-Attributed Hypergraphs
by: Bazaga, Adrián, et al.
Published: (2024)

SQLformer: Deep Auto-Regressive Query Graph Generation for Text-to-SQL Translation
by: Bazaga, Adrián, et al.
Published: (2023)

FLUID-LLM: Learning Computational Fluid Dynamics with Spatiotemporal-aware Large Language Models
by: Zhu, Max, et al.
Published: (2024)

Learning to Reason Over Time: Timeline Self-Reflection for Improved Temporal Reasoning in Language Models
by: Bazaga, Adrián, et al.
Published: (2025)

HealthBranches: Synthesizing Clinically-Grounded Question Answering Datasets via Decision Pathways
by: Cosentino, Cristian, et al.
Published: (2025)

GenRec: Generative Sequential Recommendation with Large Language Models
by: Cao, Panfeng, et al.
Published: (2024)

MEG: Medical Knowledge-Augmented Large Language Models for Question Answering
by: Cabello, Laura, et al.
Published: (2024)

Calibrated Large Language Models for Binary Question Answering
by: Giovannotti, Patrizio, et al.
Published: (2024)

Retrieval-enhanced Knowledge Editing in Language Models for Multi-Hop Question Answering
by: Shi, Yucheng, et al.
Published: (2024)

Dynamic Strategy Planning for Efficient Question Answering with Large Language Models
by: Parekh, Tanmay, et al.
Published: (2024)

Interpretable Question Answering with Knowledge Graphs
by: Aneja, Kartikeya, et al.
Published: (2025)

Quantifying Uncertainty in Natural Language Explanations of Large Language Models for Question Answering
by: Li, Yangyi, et al.
Published: (2025)

Who's Asking? Evaluating LLM Robustness to Inquiry Personas in Factual Question Answering
by: Akpinar, Nil-Jana, et al.
Published: (2025)

Knowledge Distillation of Domain-adapted LLMs for Question-Answering in Telecom
by: Sen, Rishika, et al.
Published: (2025)

Benchmarking Uncertainty Calibration in Large Language Model Long-Form Question Answering
by: Müller, Philip, et al.
Published: (2026)

Fine-Tuning vs. RAG for Multi-Hop Question Answering with Novel Knowledge
by: Yang, Zhuoyi, et al.
Published: (2026)

Challenges and Guidelines in Deep Generative Protein Design: Four Case Studies
by: Zheng, Tianyuan, et al.
Published: (2024)

COMPKE: Complex Question Answering under Knowledge Editing
by: Cheng, Keyuan, et al.
Published: (2025)

Temporal Knowledge Graph Question Answering: A Survey
by: Su, Miao, et al.
Published: (2024)

Do LLMs Understand Romanian Driving Laws? A Study on Multimodal and Fine-Tuned Question Answering
by: Barbu, Eduard, et al.
Published: (2025)

Prophet: Prompting Large Language Models with Complementary Answer Heuristics for Knowledge-based Visual Question Answering
by: Yu, Zhou, et al.
Published: (2023)

LLM-NEO: Parameter Efficient Knowledge Distillation for Large Language Models
by: Yang, Runming, et al.
Published: (2024)

Multi-hop Question Answering under Temporal Knowledge Editing
by: Cheng, Keyuan, et al.
Published: (2024)

Learning Efficient and Generalizable Graph Retriever for Knowledge-Graph Question Answering
by: Yao, Tianjun, et al.
Published: (2025)

Knowledge Distillation from Large Language Models for Household Energy Modeling
by: Takrouri, Mohannad, et al.
Published: (2025)

A Survey on Symbolic Knowledge Distillation of Large Language Models
by: Acharya, Kamal, et al.
Published: (2024)

On the Calibration of Multilingual Question Answering LLMs
by: Yang, Yahan, et al.
Published: (2023)

Structured RAG for Answering Aggregative Questions
by: Koshorek, Omri, et al.
Published: (2025)

On Mechanistic Circuits for Extractive Question-Answering
by: Basu, Samyadeep, et al.
Published: (2025)

ESQA: Event Sequences Question Answering
by: Abdullaeva, Irina, et al.
Published: (2024)

TabMDA: Tabular Manifold Data Augmentation for Any Classifier using Transformers with In-context Subsetting
by: Margeloiu, Andrei, et al.
Published: (2024)

MedLM: Exploring Language Models for Medical Question Answering Systems
by: Yagnik, Niraj, et al.
Published: (2024)

Knowledge Distillation and Dataset Distillation of Large Language Models: Emerging Trends, Challenges, and Future Directions
by: Fang, Luyang, et al.
Published: (2025)

TAID: Temporally Adaptive Interpolated Distillation for Efficient Knowledge Transfer in Language Models
by: Shing, Makoto, et al.
Published: (2025)

On the Necessity of Learnable Sheaf Laplacians
by: Caralt, Ferran Hernandez, et al.
Published: (2026)

Dataless Knowledge Fusion by Merging Weights of Language Models
by: Jin, Xisen, et al.
Published: (2022)

Question-Aware Knowledge Graph Prompting for Enhancing Large Language Models
by: Liu, Haochen, et al.
Published: (2025)

Q-NL Verifier: Leveraging Synthetic Data for Robust Knowledge Graph Question Answering
by: Schwabe, Tim, et al.
Published: (2025)

Feature Alignment and Representation Transfer in Knowledge Distillation for Large Language Models
by: Yang, Junjie, et al.
Published: (2025)