Imagen de Portada

Performance-Guided LLM Knowledge Distillation for Efficient Text Classification at Scale

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Di Palo, Flavio, Singhi, Prateek, Fadlallah, Bilal
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

LLM-based Privacy Data Augmentation Guided by Knowledge Distillation with a Distribution Tutor for Medical Text Classification
por: Song, Yiping, et al.
Publicado: (2024)

LLM-Guided Knowledge Distillation for Temporal Knowledge Graph Reasoning
por: Xing, Wang, et al.
Publicado: (2026)

Knowledge Distillation in Automated Annotation: Supervised Text Classification with LLM-Generated Training Labels
por: Pangakis, Nicholas, et al.
Publicado: (2024)

KDH-MLTC: Knowledge Distillation for Healthcare Multi-Label Text Classification
por: Sakai, Hajar, et al.
Publicado: (2025)

Knowledge Hierarchy Guided Biological-Medical Dataset Distillation for Domain LLM Training
por: Cai, Xunxin, et al.
Publicado: (2025)

WAND: Windowed Attention and Knowledge Distillation for Efficient Autoregressive Text-to-Speech Models
por: Lee, Hanna, et al.
Publicado: (2026)

DiSCo: LLM Knowledge Distillation for Efficient Sparse Retrieval in Conversational Search
por: Lupart, Simon, et al.
Publicado: (2024)

PEA-Diffusion: Parameter-Efficient Adapter with Knowledge Distillation in non-English Text-to-Image Generation
por: Ma, Jian, et al.
Publicado: (2023)

LLM-NEO: Parameter Efficient Knowledge Distillation for Large Language Models
por: Yang, Runming, et al.
Publicado: (2024)

Learning from Imperfect Data: Towards Efficient Knowledge Distillation of Autoregressive Language Models for Text-to-SQL
por: Zhong, Qihuang, et al.
Publicado: (2024)

Accurate Scene Text Recognition with Efficient Model Scaling and Cloze Self-Distillation
por: Maracani, Andrea, et al.
Publicado: (2025)

LLM-Guided Semantic Bootstrapping for Interpretable Text Classification with Tsetlin Machines
por: Gao, Jiechao, et al.
Publicado: (2026)

Self-Evolution Knowledge Distillation for LLM-based Machine Translation
por: Song, Yuncheng, et al.
Publicado: (2024)

Pushing The Limit of LLM Capacity for Text Classification
por: Zhang, Yazhou, et al.
Publicado: (2024)

Hierarchical Text Classification with LLM-Refined Taxonomies
por: Golde, Jonas, et al.
Publicado: (2026)

LLM-Oriented Token-Adaptive Knowledge Distillation
por: Xie, Xurong, et al.
Publicado: (2025)

EGAD: Entropy-Guided Adaptive Distillation for Token-Level Knowledge Transfer
por: Zhang, Hao, et al.
Publicado: (2026)

DistillGuard: Evaluating Defenses Against LLM Knowledge Distillation
por: Jiang, Bo
Publicado: (2026)

The Valley of Code Reasoning: Scaling Knowledge Distillation of Large Language Models
por: He, Muyu, et al.
Publicado: (2025)

Language Models as Zero-Shot Trajectory Generators
por: Kwon, Teyun, et al.
Publicado: (2023)

DDK: Distilling Domain Knowledge for Efficient Large Language Models
por: Liu, Jiaheng, et al.
Publicado: (2024)

Knowledge Distillation with Structured Chain-of-Thought for Text-to-SQL
por: Thaker, Khushboo, et al.
Publicado: (2025)

Towards Efficient CoT Distillation: Self-Guided Rationale Selector for Better Performance with Fewer Rationales
por: Yan, Jianzhi, et al.
Publicado: (2025)

Self-Regulated Data-Free Knowledge Amalgamation for Text Classification
por: Vijayaraghavan, Prashanth, et al.
Publicado: (2024)

Text Classification Based on Knowledge Graphs and Improved Attention Mechanism
por: Li, Siyu, et al.
Publicado: (2024)

X-Token: Projection-Guided Cross-Tokenizer Knowledge Distillation
por: Sreenivas, Sharath Turuvekere, et al.
Publicado: (2026)

Flipping Knowledge Distillation: Leveraging Small Models' Expertise to Enhance LLMs in Text Matching
por: Li, Mingzhe, et al.
Publicado: (2025)

Facilitating NSFW Text Detection in Open-Domain Dialogue Systems via Knowledge Distillation
por: Qiu, Huachuan, et al.
Publicado: (2023)

Exploring Variability in Fine-Tuned Models for Text Classification with DistilBERT
por: Lorenzoni, Giuliano, et al.
Publicado: (2024)

Guided by Gut: Efficient Test-Time Scaling with Reinforced Intrinsic Confidence
por: Ghasemabadi, Amirhosein, et al.
Publicado: (2025)

PANDA: Prompt Transfer Meets Knowledge Distillation for Efficient Model Adaptation
por: Zhong, Qihuang, et al.
Publicado: (2022)

LLMEmbed: Rethinking Lightweight LLM's Genuine Function in Text Classification
por: Liu, Chun, et al.
Publicado: (2024)

GOLD: Generalized Knowledge Distillation via Out-of-Distribution-Guided Language Data Generation
por: Gholami, Mohsen, et al.
Publicado: (2024)

Text Classification in the LLM Era -- Where do we stand?
por: Vajjala, Sowmya, et al.
Publicado: (2025)

Token Prediction as Implicit Classification to Identify LLM-Generated Text
por: Chen, Yutian, et al.
Publicado: (2023)

Improving Long Text Understanding with Knowledge Distilled from Summarization Model
por: Liu, Yan, et al.
Publicado: (2024)

Efficient Knowledge Injection in LLMs via Self-Distillation
por: Kujanpää, Kalle, et al.
Publicado: (2024)

Knowledge Distillation of LLM for Automatic Scoring of Science Education Assessments
por: Latif, Ehsan, et al.
Publicado: (2023)

Reinforcement Learning-based Knowledge Distillation with LLM-as-a-Judge
por: Shen, Yiyang, et al.
Publicado: (2026)

Scaling Concept With Text-Guided Diffusion Models
por: Huang, Chao, et al.
Publicado: (2024)