Copertina

Cooperative Knowledge Distillation: A Learner Agnostic Approach

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Livanos, Michael, Davidson, Ian, Wong, Stephen
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Identification and Uses of Deep Learning Backbones via Pattern Mining
di: Livanos, Michael, et al.
Pubblicazione: (2024)

Foundations for Unfairness in Anomaly Detection -- Case Studies in Facial Imaging Data
di: Livanos, Michael, et al.
Pubblicazione: (2024)

Mirage: Model-Agnostic Graph Distillation for Graph Classification
di: Gupta, Mridul, et al.
Pubblicazione: (2023)

Enhancing Transformer with GNN Structural Knowledge via Distillation: A Novel Approach
di: Duan, Zhihua, et al.
Pubblicazione: (2025)

Transformer Is Inherently a Causal Learner
di: Wang, Xinyue, et al.
Pubblicazione: (2026)

Teacher as a Lenient Expert: Teacher-Agnostic Data-Free Knowledge Distillation
di: Shin, Hyunjune, et al.
Pubblicazione: (2024)

Edge-free but Structure-aware: Prototype-Guided Knowledge Distillation from GNNs to MLPs
di: Wu, Taiqiang, et al.
Pubblicazione: (2023)

Boosting Efficiency in Task-Agnostic Exploration through Causal Knowledge
di: Yang, Yupei, et al.
Pubblicazione: (2024)

ChaosMining: A Benchmark to Evaluate Post-Hoc Local Attribution Methods in Low SNR Environments
di: Shi, Ge, et al.
Pubblicazione: (2024)

Graph Knowledge Distillation to Mixture of Experts
di: Rumiantsev, Pavel, et al.
Pubblicazione: (2024)

Dynamic Temperature Scheduler for Knowledge Distillation
di: Islam, Sibgat Ul, et al.
Pubblicazione: (2025)

Membership and Memorization in LLM Knowledge Distillation
di: Zhang, Ziqi, et al.
Pubblicazione: (2025)

Wearable Accelerometer Foundation Models for Health via Knowledge Distillation
di: Abbaspourazad, Salar, et al.
Pubblicazione: (2024)

A Functional Perspective on Knowledge Distillation in Neural Networks
di: Mason-Williams, Israel, et al.
Pubblicazione: (2025)

A Novel Approach To Implementing Knowledge Distillation In Tsetlin Machines
di: Kinateder, Calvin
Pubblicazione: (2025)

Low-Dimensional Federated Knowledge Graph Embedding via Knowledge Distillation
di: Zhang, Xiaoxiong, et al.
Pubblicazione: (2024)

Knowledge Distillation Must Account for What It Loses
di: Wang, Wenshuo
Pubblicazione: (2026)

Reinforcement-aware Knowledge Distillation for LLM Reasoning
di: Zhang, Zhaoyang, et al.
Pubblicazione: (2026)

Collaborative Adaptive Curriculum for Progressive Knowledge Distillation
di: Liu, Jing, et al.
Pubblicazione: (2026)

PathE: Leveraging Entity-Agnostic Paths for Parameter-Efficient Knowledge Graph Embeddings
di: Reklos, Ioannis, et al.
Pubblicazione: (2025)

A Note on Knowledge Distillation Loss Function for Object Classification
di: Chen, Defang
Pubblicazione: (2021)

LLM-NEO: Parameter Efficient Knowledge Distillation for Large Language Models
di: Yang, Runming, et al.
Pubblicazione: (2024)

Approaching Low-Cost Cardiac Intelligence with Semi-Supervised Knowledge Distillation
di: Zhou, Rushuang, et al.
Pubblicazione: (2025)

Teach Harder, Learn Poorer: Rethinking Hard Sample Distillation for GNN-to-MLP Knowledge Distillation
di: Wu, Lirong, et al.
Pubblicazione: (2024)

Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Models
di: Bick, Aviv, et al.
Pubblicazione: (2024)

Practical Insights into Knowledge Distillation for Pre-Trained Models
di: Alballa, Norah, et al.
Pubblicazione: (2024)

Balancing Knowledge Distillation for Imbalance Learning with Bilevel Optimization
di: Nguyen, Anh B. H., et al.
Pubblicazione: (2026)

Online Adversarial Knowledge Distillation for Graph Neural Networks
di: Wang, Can, et al.
Pubblicazione: (2021)

Revisiting Knowledge Distillation: The Hidden Role of Dataset Size
di: Lanzillotta, Giulia, et al.
Pubblicazione: (2025)

Model Merging via Multi-Teacher Knowledge Distillation
di: Dalili, Seyed Arshan, et al.
Pubblicazione: (2025)

Rethinking Momentum Knowledge Distillation in Online Continual Learning
di: Michel, Nicolas, et al.
Pubblicazione: (2023)

Consistently Informative Soft-Label Temperature for Knowledge Distillation
di: Luong, Hoang-Chau, et al.
Pubblicazione: (2026)

Integrating Knowledge Distillation Methods: A Sequential Multi-Stage Framework
di: Tian, Yinxi, et al.
Pubblicazione: (2026)

DistilCLIP-EEG: Enhancing Epileptic Seizure Detection Through Multi-modal Learning and Knowledge Distillation
di: Wang, Zexin, et al.
Pubblicazione: (2025)

Scale-Agnostic Kolmogorov-Arnold Geometry in Neural Networks
di: Vanherreweghe, Mathew, et al.
Pubblicazione: (2025)

Few-shot Class-incremental Fault Diagnosis by Preserving Class-Agnostic Knowledge with Dual-Granularity Representations
di: Yang, Zhendong, et al.
Pubblicazione: (2025)

Instruction-tuned Language Models are Better Knowledge Learners
di: Jiang, Zhengbao, et al.
Pubblicazione: (2024)

Hybrid Learners Do Not Forget: A Brain-Inspired Neuro-Symbolic Approach to Continual Learning
di: Banayeeanzade, Amin, et al.
Pubblicazione: (2025)

Condensed Data Expansion Using Model Inversion for Knowledge Distillation
di: Binici, Kuluhan, et al.
Pubblicazione: (2024)

AdaGMLP: AdaBoosting GNN-to-MLP Knowledge Distillation
di: Lu, Weigang, et al.
Pubblicazione: (2024)