Teaching MLP More Graph Information: A Three-stage Multitask Knowledge Distillation Framework
Fuente:
arXiv
Guardado en:
| Autores principales: | Li, Junxian, Shi, Bin, Cui, Erfei, Wei, Hua, Zheng, Qinghua |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
Teach Harder, Learn Poorer: Rethinking Hard Sample Distillation for GNN-to-MLP Knowledge Distillation
por: Wu, Lirong, et al.
Publicado: (2024)
por: Wu, Lirong, et al.
Publicado: (2024)
AdaGMLP: AdaBoosting GNN-to-MLP Knowledge Distillation
por: Lu, Weigang, et al.
Publicado: (2024)
por: Lu, Weigang, et al.
Publicado: (2024)
Uncertainty-aware Traffic Prediction under Missing Data
por: Mei, Hao, et al.
Publicado: (2023)
por: Mei, Hao, et al.
Publicado: (2023)
CLDG: Contrastive Learning on Dynamic Graphs
por: Xu, Yiming, et al.
Publicado: (2024)
por: Xu, Yiming, et al.
Publicado: (2024)
Enhancing Knowledge Graph Completion with GNN Distillation and Probabilistic Interaction Modeling
por: Wang, Lingzhi, et al.
Publicado: (2025)
por: Wang, Lingzhi, et al.
Publicado: (2025)
Graph Knowledge Distillation to Mixture of Experts
por: Rumiantsev, Pavel, et al.
Publicado: (2024)
por: Rumiantsev, Pavel, et al.
Publicado: (2024)
A Time Series Multitask Framework Integrating a Large Language Model, Pre-Trained Time Series Model, and Knowledge Graph
por: Hao, Shule, et al.
Publicado: (2025)
por: Hao, Shule, et al.
Publicado: (2025)
Aggregation-aware MLP: An Unsupervised Approach for Graph Message-passing
por: Xie, Xuanting, et al.
Publicado: (2025)
por: Xie, Xuanting, et al.
Publicado: (2025)
GraphMLP: A Graph MLP-Like Architecture for 3D Human Pose Estimation
por: Li, Wenhao, et al.
Publicado: (2022)
por: Li, Wenhao, et al.
Publicado: (2022)
Teach Me to Trick: Exploring Adversarial Transferability via Knowledge Distillation
por: Pradhan, Siddhartha, et al.
Publicado: (2025)
por: Pradhan, Siddhartha, et al.
Publicado: (2025)
Smooth-Distill: A Self-distillation Framework for Multitask Learning with Wearable Sensor Data
por: Vu, Hoang-Dieu, et al.
Publicado: (2025)
por: Vu, Hoang-Dieu, et al.
Publicado: (2025)
Be Bayesian by Attachments to Catch More Uncertainty
por: Shen, Shiyu, et al.
Publicado: (2023)
por: Shen, Shiyu, et al.
Publicado: (2023)
Less is More: Denoising Knowledge Graphs For Retrieval Augmented Generation
por: Zheng, Yilun, et al.
Publicado: (2025)
por: Zheng, Yilun, et al.
Publicado: (2025)
From MLP to NeoMLP: Leveraging Self-Attention for Neural Fields
por: Kofinas, Miltiadis, et al.
Publicado: (2024)
por: Kofinas, Miltiadis, et al.
Publicado: (2024)
Low-Dimensional Federated Knowledge Graph Embedding via Knowledge Distillation
por: Zhang, Xiaoxiong, et al.
Publicado: (2024)
por: Zhang, Xiaoxiong, et al.
Publicado: (2024)
SDMPrune: Self-Distillation MLP Pruning for Efficient Large Language Models
por: Zhu, Hourun, et al.
Publicado: (2025)
por: Zhu, Hourun, et al.
Publicado: (2025)
Look Globally and Reason: Two-stage Path Reasoning over Sparse Knowledge Graphs
por: Guan, Saiping, et al.
Publicado: (2024)
por: Guan, Saiping, et al.
Publicado: (2024)
KAN v.s. MLP for Offline Reinforcement Learning
por: Guo, Haihong, et al.
Publicado: (2024)
por: Guo, Haihong, et al.
Publicado: (2024)
Online Adversarial Knowledge Distillation for Graph Neural Networks
por: Wang, Can, et al.
Publicado: (2021)
por: Wang, Can, et al.
Publicado: (2021)
Pre-Training Graph Contrastive Masked Autoencoders are Strong Distillers for EEG
por: Wei, Xinxu, et al.
Publicado: (2024)
por: Wei, Xinxu, et al.
Publicado: (2024)
Less is More: on the Over-Globalizing Problem in Graph Transformers
por: Xing, Yujie, et al.
Publicado: (2024)
por: Xing, Yujie, et al.
Publicado: (2024)
Rethinking the shape convention of an MLP
por: Chen, Meng-Hsi, et al.
Publicado: (2025)
por: Chen, Meng-Hsi, et al.
Publicado: (2025)
Enhancing Heterogeneous Knowledge Graph Completion with a Novel GAT-based Approach
por: Wei, Wanxu, et al.
Publicado: (2024)
por: Wei, Wanxu, et al.
Publicado: (2024)
Ratio law: mathematical descriptions for a universal relationship between AI performance and input samples
por: Kang, Boming, et al.
Publicado: (2024)
por: Kang, Boming, et al.
Publicado: (2024)
Consistently Informative Soft-Label Temperature for Knowledge Distillation
por: Luong, Hoang-Chau, et al.
Publicado: (2026)
por: Luong, Hoang-Chau, et al.
Publicado: (2026)
On Membership Inference Attacks in Knowledge Distillation
por: Cui, Ziyao, et al.
Publicado: (2025)
por: Cui, Ziyao, et al.
Publicado: (2025)
FedMLP: Federated Multi-Label Medical Image Classification under Task Heterogeneity
por: Sun, Zhaobin, et al.
Publicado: (2024)
por: Sun, Zhaobin, et al.
Publicado: (2024)
KAN or MLP: A Fairer Comparison
por: Yu, Runpeng, et al.
Publicado: (2024)
por: Yu, Runpeng, et al.
Publicado: (2024)
Knowledge Distillation on Spatial-Temporal Graph Convolutional Network for Traffic Prediction
por: Izadi, Mohammad, et al.
Publicado: (2024)
por: Izadi, Mohammad, et al.
Publicado: (2024)
AuditVotes: A Framework Towards More Deployable Certified Robustness for Graph Neural Networks
por: Lai, Yuni, et al.
Publicado: (2025)
por: Lai, Yuni, et al.
Publicado: (2025)
SimMLP: Training MLPs on Graphs without Supervision
por: Wang, Zehong, et al.
Publicado: (2024)
por: Wang, Zehong, et al.
Publicado: (2024)
Integrating Knowledge Distillation Methods: A Sequential Multi-Stage Framework
por: Tian, Yinxi, et al.
Publicado: (2026)
por: Tian, Yinxi, et al.
Publicado: (2026)
M3-Net: A Cost-Effective Graph-Free MLP-Based Model for Traffic Prediction
por: Jin, Guangyin, et al.
Publicado: (2025)
por: Jin, Guangyin, et al.
Publicado: (2025)
Towards Few-Shot Adaptation of Foundation Models via Multitask Finetuning
por: Xu, Zhuoyan, et al.
Publicado: (2024)
por: Xu, Zhuoyan, et al.
Publicado: (2024)
Layer Embedding Deep Fusion Graph Neural Network
por: Xu, Taihua, et al.
Publicado: (2026)
por: Xu, Taihua, et al.
Publicado: (2026)
Multi-Scenario Highway Lane-Change Intention Prediction: A Physics-Informed AI Framework for Three-Class Classification
por: Shi, Jiazhao, et al.
Publicado: (2025)
por: Shi, Jiazhao, et al.
Publicado: (2025)
DistilCLIP-EEG: Enhancing Epileptic Seizure Detection Through Multi-modal Learning and Knowledge Distillation
por: Wang, Zexin, et al.
Publicado: (2025)
por: Wang, Zexin, et al.
Publicado: (2025)
Robust Knowledge Distillation Based on Feature Variance Against Backdoored Teacher Model
por: Chen, Jinyin, et al.
Publicado: (2024)
por: Chen, Jinyin, et al.
Publicado: (2024)
RAFT: Data Refinement and Adaptive Distillation for Domain Fine-Tuning with Alleviated Forgetting
por: Li, Yuduo, et al.
Publicado: (2026)
por: Li, Yuduo, et al.
Publicado: (2026)
Multitask Learning for Earth Observation Data Classification with Hybrid Quantum Network
por: Fan, Fan, et al.
Publicado: (2026)
por: Fan, Fan, et al.
Publicado: (2026)
Ejemplares similares
-
Teach Harder, Learn Poorer: Rethinking Hard Sample Distillation for GNN-to-MLP Knowledge Distillation
por: Wu, Lirong, et al.
Publicado: (2024) -
AdaGMLP: AdaBoosting GNN-to-MLP Knowledge Distillation
por: Lu, Weigang, et al.
Publicado: (2024) -
Uncertainty-aware Traffic Prediction under Missing Data
por: Mei, Hao, et al.
Publicado: (2023) -
CLDG: Contrastive Learning on Dynamic Graphs
por: Xu, Yiming, et al.
Publicado: (2024) -
Enhancing Knowledge Graph Completion with GNN Distillation and Probabilistic Interaction Modeling
por: Wang, Lingzhi, et al.
Publicado: (2025)