Imagen de Portada

Knowledge Distillation for Large Language Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	La Torre, Alejandro Paredes, Flores, Barbara, Rodriguez, Diego
Formato:	Preprint
Publicado:	2026
Materias:	Computation and Language Artificial Intelligence I.2.m
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

PPLqa: An Unsupervised Information-Theoretic Quality Metric for Comparing Generative Large Language Models
por: Friedland, Gerald, et al.
Publicado: (2024)

ValueDCG: Measuring Comprehensive Human Value Understanding Ability of Language Models
por: Zhang, Zhaowei, et al.
Publicado: (2023)

The QCET Taxonomy of Standard Quality Criterion Names and Definitions for the Evaluation of NLP Systems
por: Belz, Anya, et al.
Publicado: (2025)

Semantic Delta: An Interpretable Signal Differentiating Human and LLMs Dialogue
por: Scantamburlo, Riccardo, et al.
Publicado: (2026)

Exploring Model Invariance with Discrete Search for Ultra-Low-Bit Quantization
por: Wen, Yuqiao, et al.
Publicado: (2025)

Bielik-Minitron-7B: Compressing Large Language Models via Structured Pruning and Knowledge Distillation for the Polish Language
por: Kinas, Remigiusz, et al.
Publicado: (2026)

Quo Vadis ChatGPT? From Large Language Models to Large Knowledge Models
por: Venkatasubramanian, Venkat, et al.
Publicado: (2024)

EBBS: An Ensemble with Bi-Level Beam Search for Zero-Shot Machine Translation
por: Wen, Yuqiao, et al.
Publicado: (2024)

Enhancing Retrieval-Augmented Generation for Electric Power Industry Customer Support
por: Chan, Hei Yu, et al.
Publicado: (2025)

Leveraging Synthetic Data for Question Answering with Multilingual LLMs in the Agricultural Domain
por: Kaur, Rishemjit, et al.
Publicado: (2025)

A Framework for Collaborating a Large Language Model Tool in Brainstorming for Triggering Creative Thoughts
por: Chang, Hung-Fu, et al.
Publicado: (2024)

A Super-Learner with Large Language Models for Medical Emergency Advising
por: Aityan, Sergey K., et al.
Publicado: (2025)

The Battle of LLMs: A Comparative Study in Conversational QA Tasks
por: Rangapur, Aryan, et al.
Publicado: (2024)

Distributed Multi-Layer Editing for Rule-Level Knowledge in Large Language Models
por: Wang, Yating, et al.
Publicado: (2026)

Evaluating Class Membership Relations in Knowledge Graphs using Large Language Models
por: Allen, Bradley P., et al.
Publicado: (2024)

KNOW: A Real-World Ontology for Knowledge Capture with Large Language Models
por: Bendiken, Arto
Publicado: (2024)

Dialogic Pedagogy for Large Language Models: Aligning Conversational AI with Proven Theories of Learning
por: Beale, Russell
Publicado: (2025)

Opinion Mining on Offshore Wind Energy for Environmental Engineering
por: Bittencourt, Isabele, et al.
Publicado: (2024)

Text Clustering with Large Language Model Embeddings
por: Petukhova, Alina, et al.
Publicado: (2024)

Large Language Models Can Better Understand Knowledge Graphs Than We Thought
por: Dai, Xinbang, et al.
Publicado: (2024)

Prompt-Time Symbolic Knowledge Capture with Large Language Models
por: Çöplü, Tolga, et al.
Publicado: (2024)

Context-Aware Clustering using Large Language Models
por: Tipirneni, Sindhu, et al.
Publicado: (2024)

Turning the TIDE: Cross-Architecture Distillation for Diffusion Large Language Models
por: Zhang, Gongbo, et al.
Publicado: (2026)

Distilling Knowledge from Large Language Models: A Concept Bottleneck Model for Hate and Counter Speech Recognition
por: Labadie-Tamayo, Roberto, et al.
Publicado: (2025)

Revisiting Parameter-Based Knowledge Editing in Large Language Models: Theoretical Limits and Empirical Evidence
por: Ren, Wanying, et al.
Publicado: (2026)

Relations Prediction for Knowledge Graph Completion using Large Language Models
por: Alqaaidi, Sakher Khalil, et al.
Publicado: (2024)

Few-Shot Learning for Mental Disorder Detection: A Continuous Multi-Prompt Engineering Approach with Medical Knowledge Injection
por: Liu, Haoxin, et al.
Publicado: (2024)

Prompt-Time Ontology-Driven Symbolic Knowledge Capture with Large Language Models
por: Çöplü, Tolga, et al.
Publicado: (2024)

Extracting Probabilistic Knowledge from Large Language Models for Bayesian Network Parameterization
por: Nafar, Aliakbar, et al.
Publicado: (2025)

Alif: Advancing Urdu Large Language Models via Multilingual Synthetic Data Distillation
por: Shafique, Muhammad Ali, et al.
Publicado: (2025)

Evaluating Large Language Models on Historical Health Crisis Knowledge in Resource-Limited Settings: A Hybrid Multi-Metric Study
por: Hasan, Mohammed Rakibul
Publicado: (2026)

APP: Accelerated Path Patching with Task-Specific Pruning
por: Andersen, Frauke, et al.
Publicado: (2025)

Beyond Prefixes: Graph-as-Memory Cross-Attention for Knowledge Graph Completion with Large Language Models
por: Liu, Ruitong, et al.
Publicado: (2025)

Interactive-KBQA: Multi-Turn Interactions for Knowledge Base Question Answering with Large Language Models
por: Xiong, Guanming, et al.
Publicado: (2024)

Pre-trained Language Model with Prompts for Temporal Knowledge Graph Completion
por: Xu, Wenjie, et al.
Publicado: (2023)

High-Throughput Phenotyping of Clinical Text Using Large Language Models
por: Hier, Daniel B., et al.
Publicado: (2024)

What should I say? -- Interacting with AI and Natural Language Interfaces
por: Adkins, Mark
Publicado: (2024)

Simulating a Bias Mitigation Scenario in Large Language Models
por: Kiashemshaki, Kiana, et al.
Publicado: (2025)

Eliciting Problem Specifications via Large Language Models
por: Wray, Robert E., et al.
Publicado: (2024)

Robustness of Large Language Models to Perturbations in Text
por: Singh, Ayush, et al.
Publicado: (2024)