Cover Image

Knowledge Distillation for Large Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	La Torre, Alejandro Paredes, Flores, Barbara, Rodriguez, Diego
Format:	Preprint
Published:	2026
Subjects:	Computation and Language Artificial Intelligence I.2.m
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

PPLqa: An Unsupervised Information-Theoretic Quality Metric for Comparing Generative Large Language Models
by: Friedland, Gerald, et al.
Published: (2024)

ValueDCG: Measuring Comprehensive Human Value Understanding Ability of Language Models
by: Zhang, Zhaowei, et al.
Published: (2023)

The QCET Taxonomy of Standard Quality Criterion Names and Definitions for the Evaluation of NLP Systems
by: Belz, Anya, et al.
Published: (2025)

Semantic Delta: An Interpretable Signal Differentiating Human and LLMs Dialogue
by: Scantamburlo, Riccardo, et al.
Published: (2026)

Exploring Model Invariance with Discrete Search for Ultra-Low-Bit Quantization
by: Wen, Yuqiao, et al.
Published: (2025)

Bielik-Minitron-7B: Compressing Large Language Models via Structured Pruning and Knowledge Distillation for the Polish Language
by: Kinas, Remigiusz, et al.
Published: (2026)

Quo Vadis ChatGPT? From Large Language Models to Large Knowledge Models
by: Venkatasubramanian, Venkat, et al.
Published: (2024)

EBBS: An Ensemble with Bi-Level Beam Search for Zero-Shot Machine Translation
by: Wen, Yuqiao, et al.
Published: (2024)

Enhancing Retrieval-Augmented Generation for Electric Power Industry Customer Support
by: Chan, Hei Yu, et al.
Published: (2025)

Leveraging Synthetic Data for Question Answering with Multilingual LLMs in the Agricultural Domain
by: Kaur, Rishemjit, et al.
Published: (2025)

A Framework for Collaborating a Large Language Model Tool in Brainstorming for Triggering Creative Thoughts
by: Chang, Hung-Fu, et al.
Published: (2024)

A Super-Learner with Large Language Models for Medical Emergency Advising
by: Aityan, Sergey K., et al.
Published: (2025)

The Battle of LLMs: A Comparative Study in Conversational QA Tasks
by: Rangapur, Aryan, et al.
Published: (2024)

Distributed Multi-Layer Editing for Rule-Level Knowledge in Large Language Models
by: Wang, Yating, et al.
Published: (2026)

Evaluating Class Membership Relations in Knowledge Graphs using Large Language Models
by: Allen, Bradley P., et al.
Published: (2024)

KNOW: A Real-World Ontology for Knowledge Capture with Large Language Models
by: Bendiken, Arto
Published: (2024)

Dialogic Pedagogy for Large Language Models: Aligning Conversational AI with Proven Theories of Learning
by: Beale, Russell
Published: (2025)

Opinion Mining on Offshore Wind Energy for Environmental Engineering
by: Bittencourt, Isabele, et al.
Published: (2024)

Text Clustering with Large Language Model Embeddings
by: Petukhova, Alina, et al.
Published: (2024)

Large Language Models Can Better Understand Knowledge Graphs Than We Thought
by: Dai, Xinbang, et al.
Published: (2024)

Prompt-Time Symbolic Knowledge Capture with Large Language Models
by: Çöplü, Tolga, et al.
Published: (2024)

Context-Aware Clustering using Large Language Models
by: Tipirneni, Sindhu, et al.
Published: (2024)

Turning the TIDE: Cross-Architecture Distillation for Diffusion Large Language Models
by: Zhang, Gongbo, et al.
Published: (2026)

Distilling Knowledge from Large Language Models: A Concept Bottleneck Model for Hate and Counter Speech Recognition
by: Labadie-Tamayo, Roberto, et al.
Published: (2025)

Revisiting Parameter-Based Knowledge Editing in Large Language Models: Theoretical Limits and Empirical Evidence
by: Ren, Wanying, et al.
Published: (2026)

Relations Prediction for Knowledge Graph Completion using Large Language Models
by: Alqaaidi, Sakher Khalil, et al.
Published: (2024)

Few-Shot Learning for Mental Disorder Detection: A Continuous Multi-Prompt Engineering Approach with Medical Knowledge Injection
by: Liu, Haoxin, et al.
Published: (2024)

Prompt-Time Ontology-Driven Symbolic Knowledge Capture with Large Language Models
by: Çöplü, Tolga, et al.
Published: (2024)

Extracting Probabilistic Knowledge from Large Language Models for Bayesian Network Parameterization
by: Nafar, Aliakbar, et al.
Published: (2025)

Alif: Advancing Urdu Large Language Models via Multilingual Synthetic Data Distillation
by: Shafique, Muhammad Ali, et al.
Published: (2025)

Evaluating Large Language Models on Historical Health Crisis Knowledge in Resource-Limited Settings: A Hybrid Multi-Metric Study
by: Hasan, Mohammed Rakibul
Published: (2026)

APP: Accelerated Path Patching with Task-Specific Pruning
by: Andersen, Frauke, et al.
Published: (2025)

Beyond Prefixes: Graph-as-Memory Cross-Attention for Knowledge Graph Completion with Large Language Models
by: Liu, Ruitong, et al.
Published: (2025)

Interactive-KBQA: Multi-Turn Interactions for Knowledge Base Question Answering with Large Language Models
by: Xiong, Guanming, et al.
Published: (2024)

Pre-trained Language Model with Prompts for Temporal Knowledge Graph Completion
by: Xu, Wenjie, et al.
Published: (2023)

High-Throughput Phenotyping of Clinical Text Using Large Language Models
by: Hier, Daniel B., et al.
Published: (2024)

What should I say? -- Interacting with AI and Natural Language Interfaces
by: Adkins, Mark
Published: (2024)

Simulating a Bias Mitigation Scenario in Large Language Models
by: Kiashemshaki, Kiana, et al.
Published: (2025)

Eliciting Problem Specifications via Large Language Models
by: Wray, Robert E., et al.
Published: (2024)

Robustness of Large Language Models to Perturbations in Text
by: Singh, Ayush, et al.
Published: (2024)