Imagen de Portada

FlyKD: Graph Knowledge Distillation on the Fly with Curriculum Learning

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autor principal:	Ku, Eugene
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

FedeKD: Energy-Based Gating for Robust Federated Knowledge Distillation under Heterogeneous Settings
por: Nguyen, Quang-Huy, et al.
Publicado: (2026)

Stronger Graph Transformer with Regularized Attention Scores
por: Ku, Eugene
Publicado: (2023)

On-the-Fly Adaptive Distillation of Transformer to Dual-State Linear Attention
por: Ro, Yeonju, et al.
Publicado: (2025)

BicKD: Bilateral Contrastive Knowledge Distillation
por: Zhu, Jiangnan, et al.
Publicado: (2026)

Learning to Fly in Seconds
por: Eschmann, Jonas, et al.
Publicado: (2023)

MemFly: On-the-Fly Memory Optimization via Information Bottleneck
por: Zhang, Zhenyuan, et al.
Publicado: (2026)

Sim-Anchored Learning for On-the-Fly Adaptation
por: Mabsout, Bassel El, et al.
Publicado: (2023)

ShiftKD: Benchmarking Knowledge Distillation under Distribution Shift
por: Zhang, Songming, et al.
Publicado: (2023)

RMT-KD: Random Matrix Theoretic Causal Knowledge Distillation
por: Ettori, Davide, et al.
Publicado: (2025)

Adversarial Curriculum Graph-Free Knowledge Distillation for Graph Neural Networks
por: Jia, Yuang, et al.
Publicado: (2025)

Learning Aerodynamics for the Control of Flying Humanoid Robots
por: Paolino, Antonello, et al.
Publicado: (2025)

SFedKD: Sequential Federated Learning with Discrepancy-Aware Multi-Teacher Knowledge Distillation
por: Xu, Haotian, et al.
Publicado: (2025)

GraphKD: Exploring Knowledge Distillation Towards Document Object Detection with Structured Graph Creation
por: Banerjee, Ayan, et al.
Publicado: (2024)

TuneShift-KD: Knowledge Distillation and Transfer for Fine-tuned Models
por: Guan, Yushi, et al.
Publicado: (2026)

S^2-KD: Semantic-Spectral Knowledge Distillation Spatiotemporal Forecasting
por: Wang, Wenshuo, et al.
Publicado: (2025)

TabKD: Tabular Knowledge Distillation through Interaction Diversity of Learned Feature Bins
por: Pereira, Shovon Niverd, et al.
Publicado: (2026)

MTL-KD: Multi-Task Learning Via Knowledge Distillation for Generalizable Neural Vehicle Routing Solver
por: Zheng, Yuepeng, et al.
Publicado: (2025)

Agile Interception of a Flying Target using Competitive Reinforcement Learning
por: Gavin, Timothée, et al.
Publicado: (2026)

CLIP-Embed-KD: Computationally Efficient Knowledge Distillation Using Embeddings as Teachers
por: Nair, Lakshmi
Publicado: (2024)

KD-GAT: Combining Knowledge Distillation and Graph Attention Transformer for a Controller Area Network Intrusion Detection System
por: Frenken, Robert, et al.
Publicado: (2025)

AI-KD: Adversarial learning and Implicit regularization for self-Knowledge Distillation
por: Kim, Hyungmin, et al.
Publicado: (2022)

OptiSeq: Ordering Examples On-The-Fly for In-Context Learning
por: Bhope, Rahul Atul, et al.
Publicado: (2025)

Whole-Brain Connectomic Graph Model Enables Whole-Body Locomotion Control in Fruit Fly
por: Jin, Zehao, et al.
Publicado: (2026)

UNIDEAL: Curriculum Knowledge Distillation Federated Learning
por: Yang, Yuwen, et al.
Publicado: (2023)

AdaKD: Dynamic Knowledge Distillation of ASR models using Adaptive Loss Weighting
por: Ganguly, Shreyan, et al.
Publicado: (2024)

C2G-KD: PCA-Constrained Generator for Data-Free Knowledge Distillation
por: Bengtsson, Magnus, et al.
Publicado: (2025)

Adv-KD: Adversarial Knowledge Distillation for Faster Diffusion Sampling
por: Mekonnen, Kidist Amde, et al.
Publicado: (2024)

HPM-KD: Hierarchical Progressive Multi-Teacher Framework for Knowledge Distillation and Efficient Model Compression
por: Haase, Gustavo Coelho, et al.
Publicado: (2025)

Online Adaptation for Flying Quadrotors in Tight Formations
por: Hsieh, Pei-An, et al.
Publicado: (2025)

m2mKD: Module-to-Module Knowledge Distillation for Modular Transformers
por: Lo, Ka Man, et al.
Publicado: (2024)

MemKD: Memory-Discrepancy Knowledge Distillation for Efficient Time Series Classification
por: Udayangani, Nilushika, et al.
Publicado: (2026)

Collaborative Adaptive Curriculum for Progressive Knowledge Distillation
por: Liu, Jing, et al.
Publicado: (2026)

DeepKD: A Deeply Decoupled and Denoised Knowledge Distillation Trainer
por: Huang, Haiduo, et al.
Publicado: (2025)

Can a MISL Fly? Analysis and Ingredients for Mutual Information Skill Learning
por: Zheng, Chongyi, et al.
Publicado: (2024)

Distribution Transformers: Fast Approximate Bayesian Inference With On-The-Fly Prior Adaptation
por: Whittle, George, et al.
Publicado: (2025)

FloE: On-the-Fly MoE Inference on Memory-constrained GPU
por: Zhou, Yuxin, et al.
Publicado: (2025)

Optimizing Resources for On-the-Fly Label Estimation with Multiple Unknown Medical Experts
por: Bary, Tim, et al.
Publicado: (2025)

FedSiKD: Clients Similarity and Knowledge Distillation: Addressing Non-i.i.d. and Constraints in Federated Learning
por: Alsenani, Yousef, et al.
Publicado: (2024)

Discovering Global False Negatives On the Fly for Self-supervised Contrastive Learning
por: Balmaseda, Vicente, et al.
Publicado: (2025)

AuG-KD: Anchor-Based Mixup Generation for Out-of-Domain Knowledge Distillation
por: Tang, Zihao, et al.
Publicado: (2024)