Cover Image

Synthetic Adaptive Guided Embeddings (SAGE): A Novel Knowledge Distillation Method

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Polat, Suleyman Olcay, Nemkova, Poli A., Albert, Mark V.
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

LIME-LLM: Probing Models with Fluent Counterfactuals, Not Broken Text
by: Mihaila, George, et al.
Published: (2026)

Comparing LLM Text Annotation Skills: A Study on Human Rights Violations in Social Media Data
by: Nemkova, Poli Apollinaire, et al.
Published: (2025)

GUIDE: Guided Initialization and Distillation of Embeddings
by: Trinh, Khoa, et al.
Published: (2025)

Towards Automated Situation Awareness: A RAG-Based Framework for Peacebuilding Reports
by: Nemkova, Poli A., et al.
Published: (2025)

SAGE: Scale-Aware Gradual Evolution for Continual Knowledge Graph Embedding
by: Li, Yifei, et al.
Published: (2025)

Adaptive Group Robust Ensemble Knowledge Distillation
by: Kenfack, Patrik, et al.
Published: (2024)

SAGE-32B: Agentic Reasoning via Iterative Distillation
by: Jha, Basab, et al.
Published: (2026)

SAGE: Sparse Adaptive Guidance for Dependency-Aware Tabular Data Generation
by: Yang, Shuo, et al.
Published: (2026)

Knowledge Distillation for Federated Learning: a Practical Guide
by: Mora, Alessio, et al.
Published: (2022)

Low-Dimensional Federated Knowledge Graph Embedding via Knowledge Distillation
by: Zhang, Xiaoxiong, et al.
Published: (2024)

SAGE: Sequence-level Adaptive Gradient Evolution for Generative Recommendation
by: Xie, Yu, et al.
Published: (2026)

Do Large Language Models Know Conflict? Investigating Parametric vs. Non-Parametric Knowledge of LLMs for Conflict Forecasting
by: Nemkova, Apollinaire Poli, et al.
Published: (2025)

CLIP-Embed-KD: Computationally Efficient Knowledge Distillation Using Embeddings as Teachers
by: Nair, Lakshmi
Published: (2024)

SAGE: Shaping Anchors for Guided Exploration in RLVR of LLMs
by: Lee, Chanuk, et al.
Published: (2026)

Graph Knowledge Distillation to Mixture of Experts
by: Rumiantsev, Pavel, et al.
Published: (2024)

Collaborative Adaptive Curriculum for Progressive Knowledge Distillation
by: Liu, Jing, et al.
Published: (2026)

Knowledge Distillation Using Frontier Open-source LLMs: Generalizability and the Role of Synthetic Data
by: Shirgaonkar, Anup, et al.
Published: (2024)

InfGraND: An Influence-Guided GNN-to-MLP Knowledge Distillation
by: Eskandari, Amir, et al.
Published: (2026)

Wearable Sensor-Based Few-Shot Continual Learning on Hand Gestures for Motor-Impaired Individuals via Latent Embedding Exploitation
by: Rafiq, Riyad Bin, et al.
Published: (2024)

A Novel Algorithm for Personalized Federated Learning: Knowledge Distillation with Weighted Combination Loss
by: Hu, Hengrui, et al.
Published: (2025)

Distance-Adaptive Quaternion Knowledge Graph Embedding with Bidirectional Rotation
by: Wang, Weihua, et al.
Published: (2024)

Differentially Private Knowledge Distillation via Synthetic Text Generation
by: Flemings, James, et al.
Published: (2024)

CK4Gen: A Knowledge Distillation Framework for Generating High-Utility Synthetic Survival Datasets in Healthcare
by: Kuo, Nicholas I-Hsien, et al.
Published: (2024)

Learning from Stochastic Teacher Representations Using Student-Guided Knowledge Distillation
by: Aslam, Muhammad Haseeb, et al.
Published: (2025)

Adaptive Teaching with Shared Classifier for Knowledge Distillation
by: Jang, Jaeyeon, et al.
Published: (2024)

X-Token: Projection-Guided Cross-Tokenizer Knowledge Distillation
by: Sreenivas, Sharath Turuvekere, et al.
Published: (2026)

Confidence-aware Self-Semantic Distillation on Knowledge Graph Embedding
by: Liu, Yichen, et al.
Published: (2022)

Enhancing Transformer with GNN Structural Knowledge via Distillation: A Novel Approach
by: Duan, Zhihua, et al.
Published: (2025)

A Survey on Recent Random Walk-based Methods for Embedding Knowledge Graphs
by: Bozorgi, Elika, et al.
Published: (2024)

Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Models
by: Bick, Aviv, et al.
Published: (2024)

Integrating Knowledge Distillation Methods: A Sequential Multi-Stage Framework
by: Tian, Yinxi, et al.
Published: (2026)

A Novel Approach To Implementing Knowledge Distillation In Tsetlin Machines
by: Kinateder, Calvin
Published: (2025)

Adaptive Temperature Based on Logits Correlation in Knowledge Distillation
by: Matsuyama, Kazuhiro, et al.
Published: (2025)

Learning to Evolve: Bayesian-Guided Continual Knowledge Graph Embedding
by: Li, Linyu, et al.
Published: (2025)

Hyper-modal Imputation Diffusion Embedding with Dual-Distillation for Federated Multimodal Knowledge Graph Completion
by: Zhang, Ying, et al.
Published: (2025)

LEAF: Knowledge Distillation of Text Embedding Models with Teacher-Aligned Representations
by: Vujanic, Robin, et al.
Published: (2025)

SAGE: Semantic-Aware Shared Sampling for Efficient Diffusion
by: Zhao, Haoran, et al.
Published: (2025)

Distilled Circuits: A Mechanistic Study of Internal Restructuring in Knowledge Distillation
by: Haskins, Reilly, et al.
Published: (2025)

Distill to Delete: Unlearning in Graph Networks with Knowledge Distillation
by: Sinha, Yash, et al.
Published: (2023)

Topology-Guided Knowledge Distillation for Efficient Point Cloud Processing
by: Hai, Luu Tung, et al.
Published: (2025)