Imagen de Portada

Decoder-based Sense Knowledge Distillation

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Wang, Qitong, Zaki, Mohammed J., Kollias, Georgios, Kalantzis, Vasileios
Formato:	Preprint
Publicado:	2026
Materias:	Computation and Language Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Multi-Sense Embeddings for Language Models and Knowledge Distillation
por: Wang, Qitong, et al.
Publicado: (2025)

Generation Constraint Scaling Can Mitigate Hallucination
por: Kollias, Georgios, et al.
Publicado: (2024)

KERL: Knowledge-Enhanced Personalized Recipe Recommendation using Large Language Models
por: Mohbat, Fnu, et al.
Publicado: (2025)

DistillSpec: Improving Speculative Decoding via Knowledge Distillation
por: Zhou, Yongchao, et al.
Publicado: (2023)

AdaSPEC: Selective Knowledge Distillation for Efficient Speculative Decoders
por: Hu, Yuezhou, et al.
Publicado: (2025)

Needle in the Haystack for Memory Based Large Language Models
por: Nelson, Elliot, et al.
Publicado: (2024)

An Analysis of Decoding Methods for LLM-based Agents for Faithful Multi-Hop Question Answering
por: Murphy, Alexander, et al.
Publicado: (2025)

Efficient Intent-Based Filtering for Multi-Party Conversations Using Knowledge Distillation from LLMs
por: Gody, Reem, et al.
Publicado: (2025)

Distillation Contrastive Decoding: Improving LLMs Reasoning with Contrastive Decoding and Distillation
por: Phan, Phuc, et al.
Publicado: (2024)

DeepEdit: Knowledge Editing as Decoding with Constraints
por: Wang, Yiwei, et al.
Publicado: (2024)

EasyDistill: A Comprehensive Toolkit for Effective Knowledge Distillation of Large Language Models
por: Wang, Chengyu, et al.
Publicado: (2025)

FLAG: Financial Long Document Classification via AMR-based GNN
por: Xia, Bolun "Namir", et al.
Publicado: (2024)

LLM-Oriented Token-Adaptive Knowledge Distillation
por: Xie, Xurong, et al.
Publicado: (2025)

A Novel BERT-based Classifier to Detect Political Leaning of YouTube Videos based on their Titles
por: AlDahoul, Nouar, et al.
Publicado: (2024)

Self-Knowledge Distillation for Learning Ambiguity
por: Park, Hancheol, et al.
Publicado: (2024)

Multi-Stage Balanced Distillation: Addressing Long-Tail Challenges in Sequence-Level Knowledge Distillation
por: Zhou, Yuhang, et al.
Publicado: (2024)

EpMAN: Episodic Memory AttentioN for Generalizing to Longer Contexts
por: Chaudhury, Subhajit, et al.
Publicado: (2025)

Cross-Modal Knowledge Distillation for Speech Large Language Models
por: Wang, Enzhi, et al.
Publicado: (2025)

Speculate, then Collaborate: Fusing Knowledge of Language Models during Decoding
por: Wang, Ziyao, et al.
Publicado: (2025)

Outdated Issue Aware Decoding for Reasoning Questions on Edited Knowledge
por: Sun, Zengkui, et al.
Publicado: (2024)

A Data-Driven Guided Decoding Mechanism for Diagnostic Captioning
por: Kaliosis, Panagiotis, et al.
Publicado: (2024)

Towards Understanding and Improving Knowledge Distillation for Neural Machine Translation
por: Zhang, Songming, et al.
Publicado: (2023)

Survey on Knowledge Distillation for Large Language Models: Methods, Evaluation, and Application
por: Yang, Chuanpeng, et al.
Publicado: (2024)

Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language Models
por: Wu, Taiqiang, et al.
Publicado: (2024)

AdaSwitch: Balancing Exploration and Guidance in Knowledge Distillation via Adaptive Switching
por: Peng, Jingyu, et al.
Publicado: (2025)

Linearly Decoding Refused Knowledge in Aligned Language Models
por: Shrivastava, Aryan, et al.
Publicado: (2025)

Task-Specific Knowledge Distillation via Intermediate Probes
por: Brown, Ryan, et al.
Publicado: (2026)

Dual-Space Knowledge Distillation for Large Language Models
por: Zhang, Songming, et al.
Publicado: (2024)

Multimodal Commonsense Knowledge Distillation for Visual Question Answering
por: Yang, Shuo, et al.
Publicado: (2024)

Speculative Knowledge Distillation: Bridging the Teacher-Student Gap Through Interleaved Sampling
por: Xu, Wenda, et al.
Publicado: (2024)

Scientific Knowledge-driven Decoding Constraints Improving the Reliability of LLMs
por: Ma, Maotian, et al.
Publicado: (2026)

Pedagogically-Inspired Data Synthesis for Language Model Knowledge Distillation
por: He, Bowei, et al.
Publicado: (2026)

Knowledge Distillation of LLM for Automatic Scoring of Science Education Assessments
por: Latif, Ehsan, et al.
Publicado: (2023)

Distilling Event Sequence Knowledge From Large Language Models
por: Wadhwa, Somin, et al.
Publicado: (2024)

SelecTKD: Selective Token-Weighted Knowledge Distillation for LLMs
por: Huang, Haiduo, et al.
Publicado: (2025)

Language Diffusion Models are Associative Memories Capable of Retrieving Unseen Data
por: Pham, Bao, et al.
Publicado: (2026)

CAuSE: Decoding Multimodal Classifiers using Faithful Natural Language Explanation
por: Bandyopadhyay, Dibyanayan, et al.
Publicado: (2025)

Distilling Closed-Source LLM's Knowledge for Locally Stable and Economic Biomedical Entity Linking
por: Ai, Yihao, et al.
Publicado: (2025)

Cerberus: Efficient Inference with Adaptive Parallel Decoding and Sequential Knowledge Enhancement
por: Liu, Yuxuan, et al.
Publicado: (2024)

Retrieval-Constrained Decoding Reveals Underestimated Parametric Knowledge in Language Models
por: Hamdani, Rajaa El, et al.
Publicado: (2025)