Imagen de Portada

Is Modularity Transferable? A Case Study through the Lens of Knowledge Distillation

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Klimaszewski, Mateusz, Andruszkiewicz, Piotr, Birch, Alexandra
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

No Train but Gain: Language Arithmetic for training-free Language Adapters enhancement
por: Klimaszewski, Mateusz, et al.
Publicado: (2024)

Is a Document Educational or Just Wikipedia-Style? -- Pitfalls of Classifier-Based Quality Filtering
por: Klimaszewski, Mateusz, et al.
Publicado: (2026)

EuroGEST: Investigating gender stereotypes in multilingual language models
por: Rowe, Jacqueline, et al.
Publicado: (2025)

DistillLens: Symmetric Knowledge Distillation Through Logit Lens
por: Dhakal, Manish, et al.
Publicado: (2026)

ExpertSteer: Intervening in LLMs through Expert Knowledge
por: Wang, Weixuan, et al.
Publicado: (2025)

Multilingual Retrieval-Augmented Generation for Knowledge-Intensive Task
por: Ranaldi, Leonardo, et al.
Publicado: (2025)

Liaozhai through the Looking-Glass: On Paratextual Explicitation of Culture-Bound Terms in Machine Translation
por: Shen, Sherrie, et al.
Publicado: (2025)

Cache & Distil: Optimising API Calls to Large Language Models
por: Ramírez, Guillem, et al.
Publicado: (2023)

Enhancing Low-Resource NMT with a Multilingual Encoder and Knowledge Distillation: A Case Study
por: Roy, Aniruddha, et al.
Publicado: (2024)

Exploring and Enhancing the Transfer of Distribution in Knowledge Distillation for Autoregressive Language Models
por: Rao, Jun, et al.
Publicado: (2024)

EGAD: Entropy-Guided Adaptive Distillation for Token-Level Knowledge Transfer
por: Zhang, Hao, et al.
Publicado: (2026)

PANDA: Prompt Transfer Meets Knowledge Distillation for Efficient Model Adaptation
por: Zhong, Qihuang, et al.
Publicado: (2022)

Improving Multilingual Retrieval-Augmented Language Models through Dialectic Reasoning Argumentations
por: Ranaldi, Leonardo, et al.
Publicado: (2025)

Optimising Calls to Large Language Models with Uncertainty-Based Two-Tier Selection
por: Ramírez, Guillem, et al.
Publicado: (2024)

Evaluating Long-Term Memory for Long-Context Question Answering
por: Terranova, Alessandra, et al.
Publicado: (2025)

Feature Alignment and Representation Transfer in Knowledge Distillation for Large Language Models
por: Yang, Junjie, et al.
Publicado: (2025)

Sentence-Level or Token-Level? A Comprehensive Study on Knowledge Distillation
por: Wei, Jingxuan, et al.
Publicado: (2024)

Cultural Adaptation of Menus: A Fine-Grained Approach
por: Zhang, Zhonghe, et al.
Publicado: (2024)

Can We Use Probing to Better Understand Fine-tuning and Knowledge Distillation of the BERT NLU?
por: Hościłowicz, Jakub, et al.
Publicado: (2023)

SWITCH: Studying with Teacher for Knowledge Distillation of Large Language Models
por: Koo, Jahyun, et al.
Publicado: (2024)

A Multifaceted Analysis of Negative Bias in Large Language Models through the Lens of Parametric Knowledge
por: Song, Jongyoon, et al.
Publicado: (2025)

Explanation Regularisation through the Lens of Attributions
por: Ferreira, Pedro, et al.
Publicado: (2024)

A Survey of Text Style Transfer: Applications and Ethical Implications
por: Mukherjee, Sourabrata, et al.
Publicado: (2024)

Controlling What You Share: Assessing Language Model Adherence to Privacy Preferences
por: Ramírez, Guillem, et al.
Publicado: (2025)

Transferring BERT Capabilities from High-Resource to Low-Resource Languages Using Vocabulary Matching
por: Rybak, Piotr
Publicado: (2024)

Hermit Kingdom Through the Lens of Multiple Perspectives: A Case Study of LLM Hallucination on North Korea
por: Cho, Eunjung, et al.
Publicado: (2025)

Bridging the Language Gaps in Large Language Models with Inference-Time Cross-Lingual Intervention
por: Wang, Weixuan, et al.
Publicado: (2024)

Demystifying Multilingual Chain-of-Thought in Process Reward Modeling
por: Wang, Weixuan, et al.
Publicado: (2025)

When Does Monolingual Data Help Multilingual Translation: The Role of Domain and Model Scale
por: Baziotis, Christos, et al.
Publicado: (2023)

HBO: Hierarchical Balancing Optimization for Fine-Tuning Large Language Models
por: Wang, Weixuan, et al.
Publicado: (2025)

Learning to Summarize by Learning to Quiz: Adversarial Agentic Collaboration for Long Document Summarization
por: Wang, Weixuan, et al.
Publicado: (2025)

MGen: Millions of Naturally Occurring Generics in Context
por: Cilleruelo, Gustavo, et al.
Publicado: (2025)

The Ups and Downs of Large Language Model Inference with Vocabulary Trimming by Language Heuristics
por: Bogoychev, Nikolay, et al.
Publicado: (2023)

TinyThinker: Distilling Reasoning through Coarse-to-Fine Knowledge Internalization with Self-Reflection
por: Piao, Shengmin, et al.
Publicado: (2024)

ReasoningRank: Teaching Student Models to Rank through Reasoning-Based Knowledge Distillation
por: Ji, Yuelyu, et al.
Publicado: (2024)

Rethinking Selective Knowledge Distillation
por: Tavor, Almog, et al.
Publicado: (2026)

Machine Translation Meta Evaluation through Translation Accuracy Challenge Sets
por: Moghe, Nikita, et al.
Publicado: (2024)

Efficient Interleaved Speech Modeling through Knowledge Distillation
por: Nouriborji, Mohammadmahdi, et al.
Publicado: (2025)

Data Laundering: Artificially Boosting Benchmark Results through Knowledge Distillation
por: Mansurov, Jonibek, et al.
Publicado: (2024)

Scaling Knowledge Graph Construction through Synthetic Data Generation and Distillation
por: Choubey, Prafulla Kumar, et al.
Publicado: (2024)