Cover Image

InfGraND: An Influence-Guided GNN-to-MLP Knowledge Distillation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Eskandari, Amir, Anand, Aman, Rashno, Elyas, Zulkernine, Farhana
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Depth-Guided Self-Supervised Human Keypoint Detection via Cross-Modal Distillation
by: Anand, Aman, et al.
Published: (2024)

Survey: Transformer-based Models in Data Modality Conversion
by: Rashno, Elyas, et al.
Published: (2024)

SDA-GRIN for Adaptive Spatial-Temporal Multivariate Time Series Imputation
by: Eskandari, Amir, et al.
Published: (2024)

ASMa: Asymmetric Spatio-temporal Masking for Skeleton Action Representation Learning
by: Anand, Aman, et al.
Published: (2026)

AdaGMLP: AdaBoosting GNN-to-MLP Knowledge Distillation
by: Lu, Weigang, et al.
Published: (2024)

Teach Harder, Learn Poorer: Rethinking Hard Sample Distillation for GNN-to-MLP Knowledge Distillation
by: Wu, Lirong, et al.
Published: (2024)

ProGMLP: A Progressive Framework for GNN-to-MLP Knowledge Distillation with Efficient Trade-offs
by: Lu, Weigang, et al.
Published: (2025)

Comparative Analysis of Open-Source Language Models in Summarizing Medical Text Data
by: Chen, Yuhao, et al.
Published: (2024)

Z0-Inf: Zeroth Order Approximation for Data Influence
by: Kokhlikyan, Narine, et al.
Published: (2025)

TimeInf: Time Series Data Contribution via Influence Functions
by: Zhang, Yizi, et al.
Published: (2024)

Teaching MLP More Graph Information: A Three-stage Multitask Knowledge Distillation Framework
by: Li, Junxian, et al.
Published: (2024)

Enhancing Knowledge Graph Completion with GNN Distillation and Probabilistic Interaction Modeling
by: Wang, Lingzhi, et al.
Published: (2025)

Enhancing Transformer with GNN Structural Knowledge via Distillation: A Novel Approach
by: Duan, Zhihua, et al.
Published: (2025)

TimeDistill: Efficient Long-Term Time Series Forecasting with MLP via Cross-Architecture Distillation
by: Ni, Juntong, et al.
Published: (2025)

Knowledge Distillation with Training Wheels
by: Liu, Guanlin, et al.
Published: (2025)

PreND: Enhancing Intrinsic Motivation in Reinforcement Learning through Pre-trained Network Distillation
by: Davoodabadi, Mohammadamin, et al.
Published: (2024)

DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models
by: Kwon, Yongchan, et al.
Published: (2023)

Understanding MLP-Mixer as a Wide and Sparse MLP
by: Hayase, Tomohiro, et al.
Published: (2023)

An LLM-Guided Query-Aware Inference System for GNN Models on Large Knowledge Graphs
by: Afandi, Waleed, et al.
Published: (2026)

GNN's Uncertainty Quantification using Self-Distillation
by: Daneshvar, Hirad, et al.
Published: (2025)

Knowledge Distillation for Federated Learning: a Practical Guide
by: Mora, Alessio, et al.
Published: (2022)

GraSS: Combining Graph Neural Networks with Expert Knowledge for SAT Solver Selection
by: Zhang, Zhanguang, et al.
Published: (2024)

SDMPrune: Self-Distillation MLP Pruning for Efficient Large Language Models
by: Zhu, Hourun, et al.
Published: (2025)

Stochastic Modeling of Human-Machine Authentication Channels under Partial Information Leakage
by: Chakraborty, Nilesh, et al.
Published: (2026)

LLM and GNN are Complementary: Distilling LLM for Multimodal Graph Learning
by: Xu, Junjie, et al.
Published: (2024)

From MLP to NeoMLP: Leveraging Self-Attention for Neural Fields
by: Kofinas, Miltiadis, et al.
Published: (2024)

GraSP: Simple yet Effective Graph Similarity Predictions
by: Zheng, Haoran, et al.
Published: (2024)

Synthetic Adaptive Guided Embeddings (SAGE): A Novel Knowledge Distillation Method
by: Polat, Suleyman Olcay, et al.
Published: (2025)

Learning from Stochastic Teacher Representations Using Student-Guided Knowledge Distillation
by: Aslam, Muhammad Haseeb, et al.
Published: (2025)

MissionGNN: Hierarchical Multimodal GNN-based Weakly Supervised Video Anomaly Recognition with Mission-Specific Knowledge Graph Generation
by: Yun, Sanggeon, et al.
Published: (2024)

Diversity-Guided MLP Reduction for Efficient Large Vision Transformers
by: Shen, Chengchao, et al.
Published: (2025)

X-Token: Projection-Guided Cross-Tokenizer Knowledge Distillation
by: Sreenivas, Sharath Turuvekere, et al.
Published: (2026)

GraIP: A Benchmarking Framework For Neural Graph Inverse Problems
by: Cantürk, Semih, et al.
Published: (2026)

GraVAC: Adaptive Compression for Communication-Efficient Distributed DL Training
by: Tyagi, Sahil, et al.
Published: (2023)

GraCo -- A Graph Composer for Integrated Circuits
by: Uhlich, Stefan, et al.
Published: (2024)

Rethinking the shape convention of an MLP
by: Chen, Meng-Hsi, et al.
Published: (2025)

Spatial Transfer Learning with Simple MLP
by: Yang, Hongjian
Published: (2024)

ADMP-GNN: Adaptive Depth Message Passing GNN
by: Abbahaddou, Yassine, et al.
Published: (2025)

LogicDiff: Logic-Guided Denoising Improves Zero-Shot Reasoning in Masked Diffusion Language Models
by: Aman, Shaik
Published: (2026)

Distill to Delete: Unlearning in Graph Networks with Knowledge Distillation
by: Sinha, Yash, et al.
Published: (2023)