Image de couverture de livre

Embedding Compression for Teacher-to-Student Knowledge Transfer

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Ding, Yiwei, Lerch, Alexander
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Parameter-Efficient Transfer Learning for Music Foundation Models
par: Ding, Yiwei, et autres
Publié: (2024)

Uncertainty Estimation in the Real World: A Study on Music Emotion Recognition
par: Watcharasupat, Karn N., et autres
Publié: (2025)

CLIP-Embed-KD: Computationally Efficient Knowledge Distillation Using Embeddings as Teachers
par: Nair, Lakshmi
Publié: (2024)

Dual-Forward Path Teacher Knowledge Distillation: Bridging the Capacity Gap Between Teacher and Student
par: Li, Tong, et autres
Publié: (2025)

Latte: Transfering LLMs` Latent-level Knowledge for Few-shot Tabular Learning
par: Shi, Ruxue, et autres
Publié: (2025)

Learning from Stochastic Teacher Representations Using Student-Guided Knowledge Distillation
par: Aslam, Muhammad Haseeb, et autres
Publié: (2025)

Toward Student-Oriented Teacher Network Training For Knowledge Distillation
par: Dong, Chengyu, et autres
Publié: (2022)

Towards Robust Transcription: Exploring Noise Injection Strategies for Training Data Augmentation
par: Kim, Yonghyun, et autres
Publié: (2024)

Transferring Social Network Knowledge from Multiple GNN Teachers to Kolmogorov-Arnold Networks
par: Chao, Yuan-Hung, et autres
Publié: (2025)

Separate This, and All of these Things Around It: Music Source Separation via Hyperellipsoidal Queries
par: Watcharasupat, Karn N., et autres
Publié: (2025)

Low-Complexity Inference in Continual Learning via Compressed Knowledge Transfer
par: Liu, Zhenrong, et autres
Publié: (2025)

Music auto-tagging in the long tail: A few-shot approach
par: Ma, T. Aleksandra, et autres
Publié: (2024)

Generalizing Teacher Networks for Effective Knowledge Distillation Across Student Architectures
par: Binici, Kuluhan, et autres
Publié: (2024)

HPM-KD: Hierarchical Progressive Multi-Teacher Framework for Knowledge Distillation and Efficient Model Compression
par: Haase, Gustavo Coelho, et autres
Publié: (2025)

A Progressive Transformer for Unifying Binary Code Embedding and Knowledge Transfer
par: Lu, Hanxiao, et autres
Publié: (2024)

LEAF: Knowledge Distillation of Text Embedding Models with Teacher-Aligned Representations
par: Vujanic, Robin, et autres
Publié: (2025)

Compressed Concatenation of Small Embedding Models
par: Ayad, Mohamed Ayoub Ben, et autres
Publié: (2025)

Understanding Pedestrian Movement Using Urban Sensing Technologies: The Promise of Audio-based Sensors
par: Han, Chaeyeon, et autres
Publié: (2024)

CrowdTransfer: Enabling Crowd Knowledge Transfer in AIoT Community
par: Liu, Yan, et autres
Publié: (2024)

Aggregating distribution forecasts from deep ensembles
par: Schulz, Benedikt, et autres
Publié: (2022)

A Stem-Agnostic Single-Decoder System for Music Source Separation Beyond Four Stems
par: Watcharasupat, Karn N., et autres
Publié: (2024)

Training Self-localization Models for Unseen Unfamiliar Places via Teacher-to-Student Data-Free Knowledge Transfer
par: Tsukahara, Kenta, et autres
Publié: (2024)

SETrLUSI: Stochastic Ensemble Multi-Source Transfer Learning Using Statistical Invariant
par: Li, Chunna, et autres
Publié: (2025)

Student-Informed Teacher Training
par: Messikommer, Nico, et autres
Publié: (2024)

Resilience in Knowledge Graph Embeddings
par: Sharma, Arnab, et autres
Publié: (2024)

Knowledge-Guided Failure Prediction: Detecting When Object Detectors Miss Safety-Critical Objects
par: Zimmermann, Jakob Paul, et autres
Publié: (2026)

The Strongest Teacher Is Not Always the Best Teacher: Student-Centric Answer Selection
par: Hu, Zhengyu, et autres
Publié: (2026)

A Survey on Knowledge Graph Structure and Knowledge Graph Embeddings
par: Sardina, Jeffrey, et autres
Publié: (2024)

Residual-as-Teacher: Mitigating Bias Propagation in Student--Teacher Estimation
par: Yamamoto, Kakei, et autres
Publié: (2026)

Compressing VAE-Based Out-of-Distribution Detectors for Embedded Deployment
par: Bansal, Aditya, et autres
Publié: (2024)

Distilling Realizable Students from Unrealizable Teachers
par: Kim, Yujin, et autres
Publié: (2025)

A Metamorphic Testing Perspective on Knowledge Distillation for Language Models of Code: Does the Student Deeply Mimic the Teacher?
par: Awal, Md. Abdul, et autres
Publié: (2025)

Beyond Answers: Transferring Reasoning Capabilities to Smaller LLMs Using Multi-Teacher Knowledge Distillation
par: Tian, Yijun, et autres
Publié: (2024)

How to Train the Teacher Model for Effective Knowledge Distillation
par: Hamidi, Shayan Mohajer, et autres
Publié: (2024)

Robust Knowledge Graph Embedding via Denoising
par: Song, Tengwei, et autres
Publié: (2025)

Neural Embedding Compression For Efficient Multi-Task Earth Observation Modelling
par: Gomes, Carlos, et autres
Publié: (2024)

Graph Neural Networks and Spatial Information Learning for Post-Processing Ensemble Weather Forecasts
par: Feik, Moritz, et autres
Publié: (2024)

Learning low-dimensional representations of ensemble forecast fields using autoencoder-based methods
par: Chen, Jieyu, et autres
Publié: (2025)

A Generalized Bandsplit Neural Network for Cinematic Audio Source Separation
par: Watcharasupat, Karn N., et autres
Publié: (2023)

Embedding World Knowledge into Tabular Models: Towards Best Practices for Embedding Pipeline Design
par: Kolomenko, Oksana, et autres
Publié: (2026)