Cover Image

Edge-free but Structure-aware: Prototype-Guided Knowledge Distillation from GNNs to MLPs

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wu, Taiqiang, Zhao, Zhe, Wang, Jiahao, Bai, Xingyu, Wang, Lei, Wong, Ngai, Yang, Yujiu
Format:	Preprint
Published:	2023
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language Models
by: Wu, Taiqiang, et al.
Published: (2024)

LLM-NEO: Parameter Efficient Knowledge Distillation for Large Language Models
by: Yang, Runming, et al.
Published: (2024)

Mixture-of-Subspaces in Low-Rank Adaptation
by: Wu, Taiqiang, et al.
Published: (2024)

Timber: Training-free Instruct Model Refining with Base via Effective Rank
by: Wu, Taiqiang, et al.
Published: (2025)

Revisiting Model Interpolation for Efficient Reasoning
by: Wu, Taiqiang, et al.
Published: (2025)

Shadow-FT: Tuning Instruct Model via Training on Paired Base Model
by: Wu, Taiqiang, et al.
Published: (2025)

ProFit: Leveraging High-Value Signals in SFT via Probability-Guided Token Selection
by: Liu, Tao, et al.
Published: (2026)

The Art of Efficient Reasoning: Data, Reward, and Optimization
by: Wu, Taiqiang, et al.
Published: (2026)

Weight-Inherited Distillation for Task-Agnostic BERT Compression
by: Wu, Taiqiang, et al.
Published: (2023)

LoCa: Logit Calibration for Knowledge Distillation
by: Yang, Runming, et al.
Published: (2024)

VQGraph: Rethinking Graph Representation Space for Bridging GNNs and MLPs
by: Yang, Ling, et al.
Published: (2023)

MCUBERT: Memory-Efficient BERT Inference on Commodity Microcontrollers
by: Yang, Zebin, et al.
Published: (2024)

Structure-Aware Prototype Guided Trusted Multi-View Classification
by: Huang, Haojian, et al.
Published: (2025)

Efficient Protein Optimization via Structure-aware Hamiltonian Dynamics
by: Wang, Jiahao, et al.
Published: (2026)

A Survey of Reasoning in Autonomous Driving Systems: Open Challenges and Emerging Paradigms
by: Yu, Kejin, et al.
Published: (2026)

Heuristic Methods are Good Teachers to Distill MLPs for Graph Link Prediction
by: Qin, Zongyue, et al.
Published: (2025)

Learning to Model Graph Structural Information on MLPs via Graph Structure Self-Contrasting
by: Wu, Lirong, et al.
Published: (2024)

A Survey on the Honesty of Large Language Models
by: Li, Siheng, et al.
Published: (2024)

FedTAD: Topology-aware Data-free Knowledge Distillation for Subgraph Federated Learning
by: Zhu, Yinlin, et al.
Published: (2024)

Diffusion-Assisted Distillation for Self-Supervised Graph Representation Learning with MLPs
by: Ahn, Seong Jin, et al.
Published: (2025)

Reinforcement-aware Knowledge Distillation for LLM Reasoning
by: Zhang, Zhaoyang, et al.
Published: (2026)

PGAD: Prototype-Guided Adaptive Distillation for Multi-Modal Learning in AD Diagnosis
by: Li, Yanfei, et al.
Published: (2025)

Online Adversarial Knowledge Distillation for Graph Neural Networks
by: Wang, Can, et al.
Published: (2021)

Taming Lookup Tables for Efficient Image Retouching
by: Yang, Sidi, et al.
Published: (2024)

GCoDE: Efficient Device-Edge Co-Inference for GNNs via Architecture-Mapping Co-Search
by: Zhou, Ao, et al.
Published: (2025)

Message Passing on the Edge: Towards Scalable and Expressive GNNs
by: Barceló, Pablo, et al.
Published: (2025)

Confidence-aware Self-Semantic Distillation on Knowledge Graph Embedding
by: Liu, Yichen, et al.
Published: (2022)

Knowledge Probing for Graph Representation Learning
by: Zhao, Mingyu, et al.
Published: (2024)

Unlink to Unlearn: Simplifying Edge Unlearning in GNNs
by: Tan, Jiajun, et al.
Published: (2024)

Lightweight Remote Sensing Scene Classification on Edge Devices via Knowledge Distillation and Early-exit
by: Zhao, Yang, et al.
Published: (2025)

Training MLPs on Graphs without Supervision
by: Wang, Zehong, et al.
Published: (2024)

Multimodal Prototype-Enhanced Network for Few-Shot Action Recognition
by: Ni, Xinzhe, et al.
Published: (2022)

GraphEdge: Dynamic Graph Partition and Task Scheduling for GNNs Computing in Edge Network
by: Xiao, Wenjing, et al.
Published: (2025)

Empowering GNNs via Edge-Aware Weisfeiler-Leman Algorithm
by: Liu, Meng, et al.
Published: (2022)

On Negative-aware Preference Optimization for Recommendation
by: Ding, Chenlu, et al.
Published: (2025)

Mitigating Reversal Curse in Large Language Models via Semantic-aware Permutation Training
by: Guo, Qingyan, et al.
Published: (2024)

TIP and Polish: Text-Image-Prototype Guided Multi-Modal Generation via Commonality-Discrepancy Modeling and Refinement
by: Ma, Zhiyong, et al.
Published: (2025)

Improving Subgraph-GNNs via Edge-Level Ego-Network Encodings
by: Alvarez-Gonzalez, Nurudin, et al.
Published: (2023)

Cooperative Knowledge Distillation: A Learner Agnostic Approach
by: Livanos, Michael, et al.
Published: (2024)

FaLW: A Forgetting-aware Loss Reweighting for Long-tailed Unlearning
by: Yu, Liheng, et al.
Published: (2026)