Cover Image

Teaching MLP More Graph Information: A Three-stage Multitask Knowledge Distillation Framework

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Li, Junxian, Shi, Bin, Cui, Erfei, Wei, Hua, Zheng, Qinghua
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Teach Harder, Learn Poorer: Rethinking Hard Sample Distillation for GNN-to-MLP Knowledge Distillation
by: Wu, Lirong, et al.
Published: (2024)

AdaGMLP: AdaBoosting GNN-to-MLP Knowledge Distillation
by: Lu, Weigang, et al.
Published: (2024)

Uncertainty-aware Traffic Prediction under Missing Data
by: Mei, Hao, et al.
Published: (2023)

CLDG: Contrastive Learning on Dynamic Graphs
by: Xu, Yiming, et al.
Published: (2024)

Enhancing Knowledge Graph Completion with GNN Distillation and Probabilistic Interaction Modeling
by: Wang, Lingzhi, et al.
Published: (2025)

Graph Knowledge Distillation to Mixture of Experts
by: Rumiantsev, Pavel, et al.
Published: (2024)

A Time Series Multitask Framework Integrating a Large Language Model, Pre-Trained Time Series Model, and Knowledge Graph
by: Hao, Shule, et al.
Published: (2025)

Aggregation-aware MLP: An Unsupervised Approach for Graph Message-passing
by: Xie, Xuanting, et al.
Published: (2025)

GraphMLP: A Graph MLP-Like Architecture for 3D Human Pose Estimation
by: Li, Wenhao, et al.
Published: (2022)

Teach Me to Trick: Exploring Adversarial Transferability via Knowledge Distillation
by: Pradhan, Siddhartha, et al.
Published: (2025)

Smooth-Distill: A Self-distillation Framework for Multitask Learning with Wearable Sensor Data
by: Vu, Hoang-Dieu, et al.
Published: (2025)

Be Bayesian by Attachments to Catch More Uncertainty
by: Shen, Shiyu, et al.
Published: (2023)

Less is More: Denoising Knowledge Graphs For Retrieval Augmented Generation
by: Zheng, Yilun, et al.
Published: (2025)

From MLP to NeoMLP: Leveraging Self-Attention for Neural Fields
by: Kofinas, Miltiadis, et al.
Published: (2024)

Low-Dimensional Federated Knowledge Graph Embedding via Knowledge Distillation
by: Zhang, Xiaoxiong, et al.
Published: (2024)

SDMPrune: Self-Distillation MLP Pruning for Efficient Large Language Models
by: Zhu, Hourun, et al.
Published: (2025)

Look Globally and Reason: Two-stage Path Reasoning over Sparse Knowledge Graphs
by: Guan, Saiping, et al.
Published: (2024)

KAN v.s. MLP for Offline Reinforcement Learning
by: Guo, Haihong, et al.
Published: (2024)

Online Adversarial Knowledge Distillation for Graph Neural Networks
by: Wang, Can, et al.
Published: (2021)

Pre-Training Graph Contrastive Masked Autoencoders are Strong Distillers for EEG
by: Wei, Xinxu, et al.
Published: (2024)

Less is More: on the Over-Globalizing Problem in Graph Transformers
by: Xing, Yujie, et al.
Published: (2024)

Rethinking the shape convention of an MLP
by: Chen, Meng-Hsi, et al.
Published: (2025)

Enhancing Heterogeneous Knowledge Graph Completion with a Novel GAT-based Approach
by: Wei, Wanxu, et al.
Published: (2024)

Ratio law: mathematical descriptions for a universal relationship between AI performance and input samples
by: Kang, Boming, et al.
Published: (2024)

Consistently Informative Soft-Label Temperature for Knowledge Distillation
by: Luong, Hoang-Chau, et al.
Published: (2026)

On Membership Inference Attacks in Knowledge Distillation
by: Cui, Ziyao, et al.
Published: (2025)

FedMLP: Federated Multi-Label Medical Image Classification under Task Heterogeneity
by: Sun, Zhaobin, et al.
Published: (2024)

KAN or MLP: A Fairer Comparison
by: Yu, Runpeng, et al.
Published: (2024)

Knowledge Distillation on Spatial-Temporal Graph Convolutional Network for Traffic Prediction
by: Izadi, Mohammad, et al.
Published: (2024)

AuditVotes: A Framework Towards More Deployable Certified Robustness for Graph Neural Networks
by: Lai, Yuni, et al.
Published: (2025)

SimMLP: Training MLPs on Graphs without Supervision
by: Wang, Zehong, et al.
Published: (2024)

Integrating Knowledge Distillation Methods: A Sequential Multi-Stage Framework
by: Tian, Yinxi, et al.
Published: (2026)

M3-Net: A Cost-Effective Graph-Free MLP-Based Model for Traffic Prediction
by: Jin, Guangyin, et al.
Published: (2025)

Towards Few-Shot Adaptation of Foundation Models via Multitask Finetuning
by: Xu, Zhuoyan, et al.
Published: (2024)

Layer Embedding Deep Fusion Graph Neural Network
by: Xu, Taihua, et al.
Published: (2026)

Multi-Scenario Highway Lane-Change Intention Prediction: A Physics-Informed AI Framework for Three-Class Classification
by: Shi, Jiazhao, et al.
Published: (2025)

DistilCLIP-EEG: Enhancing Epileptic Seizure Detection Through Multi-modal Learning and Knowledge Distillation
by: Wang, Zexin, et al.
Published: (2025)

Robust Knowledge Distillation Based on Feature Variance Against Backdoored Teacher Model
by: Chen, Jinyin, et al.
Published: (2024)

RAFT: Data Refinement and Adaptive Distillation for Domain Fine-Tuning with Alleviated Forgetting
by: Li, Yuduo, et al.
Published: (2026)

Multitask Learning for Earth Observation Data Classification with Hybrid Quantum Network
by: Fan, Fan, et al.
Published: (2026)