Image de couverture de livre

Teach Harder, Learn Poorer: Rethinking Hard Sample Distillation for GNN-to-MLP Knowledge Distillation

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Wu, Lirong, Liu, Yunfan, Lin, Haitao, Huang, Yufei, Li, Stan Z.
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

AdaGMLP: AdaBoosting GNN-to-MLP Knowledge Distillation
par: Lu, Weigang, et autres
Publié: (2024)

A Simple yet Effective DDG Predictor is An Unsupervised Antibody Optimizer and Explainer
par: Wu, Lirong, et autres
Publié: (2025)

Relation-Aware Equivariant Graph Networks for Epitope-Unknown Antibody Design and Specificity Optimization
par: Wu, Lirong, et autres
Publié: (2024)

Enhancing Protein Predictive Models via Proteins Data Augmentation: A Benchmark and New Directions
par: Sun, Rui, et autres
Publié: (2024)

A Teacher-Free Graph Knowledge Distillation Framework with Dual Self-Distillation
par: Wu, Lirong, et autres
Publié: (2024)

Learning to Model Graph Structural Information on MLPs via Graph Structure Self-Contrasting
par: Wu, Lirong, et autres
Publié: (2024)

Decoupling Weighing and Selecting for Integrating Multiple Graph Pre-training Tasks
par: Fan, Tianyu, et autres
Publié: (2024)

Teaching MLP More Graph Information: A Three-stage Multitask Knowledge Distillation Framework
par: Li, Junxian, et autres
Publié: (2024)

Learning to Predict Mutation Effects of Protein-Protein Interactions by Microenvironment-aware Hierarchical Prompt Learning
par: Wu, Lirong, et autres
Publié: (2024)

LLM and GNN are Complementary: Distilling LLM for Multimodal Graph Learning
par: Xu, Junjie, et autres
Publié: (2024)

PPFlow: Target-aware Peptide Design with Torsional Flow Matching
par: Lin, Haitao, et autres
Publié: (2024)

PSC-CPI: Multi-Scale Protein Sequence-Structure Contrasting for Efficient and Generalizable Compound-Protein Interaction Prediction
par: Wu, Lirong, et autres
Publié: (2024)

Rethinking Momentum Knowledge Distillation in Online Continual Learning
par: Michel, Nicolas, et autres
Publié: (2023)

Enhancing Knowledge Graph Completion with GNN Distillation and Probabilistic Interaction Modeling
par: Wang, Lingzhi, et autres
Publié: (2025)

FoldToken: Learning Protein Language via Vector Quantization and Beyond
par: Gao, Zhangyang, et autres
Publié: (2024)

Cross-Gate MLP with Protein Complex Invariant Embedding is A One-Shot Antibody Designer
par: Tan, Cheng, et autres
Publié: (2023)

Re-Dock: Towards Flexible and Realistic Molecular Docking with Diffusion Bridge
par: Huang, Yufei, et autres
Publié: (2024)

Enhancing Transformer with GNN Structural Knowledge via Distillation: A Novel Approach
par: Duan, Zhihua, et autres
Publié: (2025)

CBGBench: Fill in the Blank of Protein-Molecule Complex Binding Graph
par: Lin, Haitao, et autres
Publié: (2024)

GNN's Uncertainty Quantification using Self-Distillation
par: Daneshvar, Hirad, et autres
Publié: (2025)

DistilCLIP-EEG: Enhancing Epileptic Seizure Detection Through Multi-modal Learning and Knowledge Distillation
par: Wang, Zexin, et autres
Publié: (2025)

Rethinking the shape convention of an MLP
par: Chen, Meng-Hsi, et autres
Publié: (2025)

OPD+: Rethinking the Advantage Design for On-Policy Distillation
par: Zhao, Hanyang, et autres
Publié: (2026)

Teach Me to Trick: Exploring Adversarial Transferability via Knowledge Distillation
par: Pradhan, Siddhartha, et autres
Publié: (2025)

SDMPrune: Self-Distillation MLP Pruning for Efficient Large Language Models
par: Zhu, Hourun, et autres
Publié: (2025)

InfGraND: An Influence-Guided GNN-to-MLP Knowledge Distillation
par: Eskandari, Amir, et autres
Publié: (2026)

Split Knowledge Distillation for Large Models in IoT: Architecture, Challenges, and Solutions
par: Li, Zuguang, et autres
Publié: (2024)

Low-redundancy Distillation for Continual Learning
par: Liu, RuiQi, et autres
Publié: (2023)

Rethinking the Intermediate Features in Adversarial Attacks: Misleading Robotic Models via Adversarial Distillation
par: Zhao, Ke, et autres
Publié: (2024)

Rethinking the Role of Temperature in Large Language Model Distillation
par: Luong, Hoang-Chau, et autres
Publié: (2026)

Balancing Knowledge Distillation for Imbalance Learning with Bilevel Optimization
par: Nguyen, Anh B. H., et autres
Publié: (2026)

How to Backdoor the Knowledge Distillation
par: Wu, Chen, et autres
Publié: (2025)

UniIF: Unified Molecule Inverse Folding
par: Gao, Zhangyang, et autres
Publié: (2024)

Distilled Thompson Sampling: Practical and Efficient Thompson Sampling via Imitation Learning
par: Namkoong, Hongseok, et autres
Publié: (2020)

Collaborative Adaptive Curriculum for Progressive Knowledge Distillation
par: Liu, Jing, et autres
Publié: (2026)

Graph Knowledge Distillation to Mixture of Experts
par: Rumiantsev, Pavel, et autres
Publié: (2024)

Dynamic Temperature Scheduler for Knowledge Distillation
par: Islam, Sibgat Ul, et autres
Publié: (2025)

Membership and Memorization in LLM Knowledge Distillation
par: Zhang, Ziqi, et autres
Publié: (2025)

Learning to Reason: Temporal Saliency Distillation for Interpretable Knowledge Transfer
par: Dehigahawattage, Nilushika Udayangani Hewa, et autres
Publié: (2026)

CADENT: Gated Hybrid Distillation for Sample-Efficient Transfer in Reinforcement Learning
par: Alinejad, Mahyar, et autres
Publié: (2026)