Cover Image

GUIDE: Guided Initialization and Distillation of Embeddings

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Trinh, Khoa, Menghani, Gaurav, Vee, Erik
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Efficient Deep Learning: A Survey on Making Deep Learning Models Smaller, Faster, and Better
by: Menghani, Gaurav
Published: (2021)

Linear Projections of Teacher Embeddings for Few-Class Distillation
by: Loo, Noel, et al.
Published: (2024)

LAuReL: Learned Augmented Residual Layer
by: Menghani, Gaurav, et al.
Published: (2024)

IF-GUIDE: Influence Function-Guided Detoxification of LLMs
by: Coalson, Zachary, et al.
Published: (2025)

Pref-GUIDE Dataset
by: Ji, Zhengran
Published: (2025)

Synthetic Adaptive Guided Embeddings (SAGE): A Novel Knowledge Distillation Method
by: Polat, Suleyman Olcay, et al.
Published: (2025)

From Novelty to Imitation: Self-Distilled Rewards for Offline Reinforcement Learning
by: Chaudhary, Gaurav, et al.
Published: (2025)

Finding Stable Subnetworks at Initialization with Dataset Distillation
by: McDermott, Luke, et al.
Published: (2025)

GUIDE: Guidance-based Incremental Learning with Diffusion Models
by: Cywiński, Bartosz, et al.
Published: (2024)

GUIDE-US: Grade-Informed Unpaired Distillation of Encoder Knowledge from Histopathology to Micro-UltraSound
by: Willis, Emma, et al.
Published: (2026)

GUIDE: Towards Scalable Advising for Research Ideas
by: Liu, Yaowenqi, et al.
Published: (2025)

CancerGUIDE: Cancer Guideline Understanding via Internal Disagreement Estimation
by: Unell, Alyssa, et al.
Published: (2025)

GUIDE: Reinforcement Learning for Behavioral Action Support in Type 1 Diabetes
by: Khamesian, Saman, et al.
Published: (2026)

GUIDE-VAE: Advancing Data Generation with User Information and Pattern Dictionaries
by: Bölat, Kutay, et al.
Published: (2024)

GUIDE: Real-Time Human-Shaped Agents
by: Zhang, Lingyu, et al.
Published: (2024)

Cold-start Recommendation by Personalized Embedding Region Elicitation
by: Nguyen, Hieu Trung, et al.
Published: (2024)

Improving Continual Learning of Knowledge Graph Embeddings via Informed Initialization
by: Pons, Gerard, et al.
Published: (2025)

Metric Embedding Initialization-Based Differentially Private and Explainable Graph Clustering
by: You, Haochen, et al.
Published: (2025)

SeqBattNet: A Discrete-State Physics-Informed Neural Network with Aging Adaptation for Battery Modeling
by: Tran, Khoa, et al.
Published: (2025)

Embedding World Knowledge into Tabular Models: Towards Best Practices for Embedding Pipeline Design
by: Kolomenko, Oksana, et al.
Published: (2026)

Synergistic Graph Fusion via Encoder Embedding
by: Shen, Cencheng, et al.
Published: (2023)

Adaptive Self-Distillation for Minimizing Client Drift in Heterogeneous Federated Learning
by: Yashwanth, M, et al.
Published: (2023)

STRIDE: Structure and Embedding Distillation with Attention for Graph Neural Networks
by: Ahluwalia, Anshul, et al.
Published: (2023)

Random Walk Guided Hyperbolic Graph Distillation
by: Long, Yunbo, et al.
Published: (2025)

Attribution-Guided Distillation of Matryoshka Sparse Autoencoders
by: Martin-Linares, Cristina P., et al.
Published: (2025)

Alignment-Aware Model Adaptation via Feedback-Guided Optimization
by: Bhatt, Gaurav, et al.
Published: (2026)

CLIP-Embed-KD: Computationally Efficient Knowledge Distillation Using Embeddings as Teachers
by: Nair, Lakshmi
Published: (2024)

Fairness and Robustness in Machine Unlearning
by: Tran, Khoa, et al.
Published: (2025)

Knowledge Distillation for Federated Learning: a Practical Guide
by: Mora, Alessio, et al.
Published: (2022)

Refined Graph Encoder Embedding via Self-Training and Latent Community Recovery
by: Shen, Cencheng, et al.
Published: (2024)

Distilling Two-Timed Flow Models by Separately Matching Initial and Terminal Velocities
by: Khungurn, Pramook, et al.
Published: (2025)

ReGUIDE: Data Efficient GUI Grounding via Spatial Reasoning and Search
by: Lee, Hyunseok, et al.
Published: (2025)

Learning from Language Feedback via Variational Policy Distillation
by: Li, Yang, et al.
Published: (2026)

Machine learning approaches to uncover the neural mechanisms of motivated behaviour: from ADHD to individual differences in effort and reward sensitivity
by: Trinh, Nam
Published: (2026)

Generative Latent Alignment for Interpretable Radar Based Occupancy Detection in Ambient Assisted Living
by: Trinh, Huy
Published: (2026)

Learning in the Fisher Subspace: A Guided Initialization for LoRA Fine-Tuning
by: Feng, Zhi-Quan, et al.
Published: (2026)

Reasoning-preserved Efficient Distillation of Large Language Models via Activation-aware Initialization
by: He, Junlin, et al.
Published: (2026)

Token Distillation: Attention-aware Input Embeddings For New Tokens
by: Dobler, Konstantin, et al.
Published: (2025)

Principal Graph Encoder Embedding and Principal Community Detection
by: Shen, Cencheng, et al.
Published: (2025)

CoRe-Fed: Bridging Collaborative and Representation Fairness via Federated Embedding Distillation
by: Mukhtiar, Noorain, et al.
Published: (2026)