Copertina

Enhancing Transformer with GNN Structural Knowledge via Distillation: A Novel Approach

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Duan, Zhihua, Wang, Jialin
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Enhancing Knowledge Graph Completion with GNN Distillation and Probabilistic Interaction Modeling
di: Wang, Lingzhi, et al.
Pubblicazione: (2025)

AdaGMLP: AdaBoosting GNN-to-MLP Knowledge Distillation
di: Lu, Weigang, et al.
Pubblicazione: (2024)

Teach Harder, Learn Poorer: Rethinking Hard Sample Distillation for GNN-to-MLP Knowledge Distillation
di: Wu, Lirong, et al.
Pubblicazione: (2024)

Structural Rationale Distillation via Reasoning Space Compression
di: Yang, Jialin, et al.
Pubblicazione: (2026)

GNN's Uncertainty Quantification using Self-Distillation
di: Daneshvar, Hirad, et al.
Pubblicazione: (2025)

LLM and GNN are Complementary: Distilling LLM for Multimodal Graph Learning
di: Xu, Junjie, et al.
Pubblicazione: (2024)

A Novel Approach To Implementing Knowledge Distillation In Tsetlin Machines
di: Kinateder, Calvin
Pubblicazione: (2025)

$β$-GNN: A Robust Ensemble Approach Against Graph Structure Perturbation
di: Aslan, Haci Ismail, et al.
Pubblicazione: (2025)

Cooperative Knowledge Distillation: A Learner Agnostic Approach
di: Livanos, Michael, et al.
Pubblicazione: (2024)

Tackling Oversmoothing in GNN via Graph Sparsification: A Truss-based Approach
di: Hossain, Tanvir, et al.
Pubblicazione: (2024)

Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Models
di: Bick, Aviv, et al.
Pubblicazione: (2024)

CaT-GNN: Enhancing Credit Card Fraud Detection via Causal Temporal Graph Neural Networks
di: Duan, Yifan, et al.
Pubblicazione: (2024)

Intelligent Spark Agents: A Modular LangGraph Framework for Scalable, Visualized, and Enhanced Big Data Machine Learning Workflows
di: Wang, Jialin, et al.
Pubblicazione: (2024)

Enhancing Heterogeneous Knowledge Graph Completion with a Novel GAT-based Approach
di: Wei, Wanxu, et al.
Pubblicazione: (2024)

DistilCLIP-EEG: Enhancing Epileptic Seizure Detection Through Multi-modal Learning and Knowledge Distillation
di: Wang, Zexin, et al.
Pubblicazione: (2025)

Multilingual Safety Alignment via Self-Distillation
di: Qin, Ruiyang, et al.
Pubblicazione: (2026)

Low-Dimensional Federated Knowledge Graph Embedding via Knowledge Distillation
di: Zhang, Xiaoxiong, et al.
Pubblicazione: (2024)

Edge-free but Structure-aware: Prototype-Guided Knowledge Distillation from GNNs to MLPs
di: Wu, Taiqiang, et al.
Pubblicazione: (2023)

Agent AI with LangGraph: A Modular Framework for Enhancing Machine Translation Using Large Language Models
di: Wang, Jialin, et al.
Pubblicazione: (2024)

Model Merging via Multi-Teacher Knowledge Distillation
di: Dalili, Seyed Arshan, et al.
Pubblicazione: (2025)

Knowledge Distillation Must Account for What It Loses
di: Wang, Wenshuo
Pubblicazione: (2026)

Improve Knowledge Distillation via Label Revision and Data Selection
di: Lan, Weichao, et al.
Pubblicazione: (2024)

Knowledge Graph Sparsification for GNN-based Rare Disease Diagnosis
di: Cara, Premt, et al.
Pubblicazione: (2025)

Logical Structure as Knowledge: Enhancing LLM Reasoning via Structured Logical Knowledge Density Estimation
di: Bi, Zhen, et al.
Pubblicazione: (2025)

Not All Timesteps Matter Equally: Selective Alignment Knowledge Distillation for Spiking Neural Networks
di: Sun, Kai, et al.
Pubblicazione: (2026)

DistillSpec: Improving Speculative Decoding via Knowledge Distillation
di: Zhou, Yongchao, et al.
Pubblicazione: (2023)

An Empirical Study of Realized GNN Expressiveness
di: Wang, Yanbo, et al.
Pubblicazione: (2023)

Efficient GNN Training Through Structure-Aware Randomized Mini-Batching
di: Balaji, Vignesh, et al.
Pubblicazione: (2025)

SFR-GNN: Simple and Fast Robust GNNs against Structural Attacks
di: Ai, Xing, et al.
Pubblicazione: (2024)

Enhancing Transformer-based models for Long Sequence Time Series Forecasting via Structured Matrix
di: Zhang, Zhicheng, et al.
Pubblicazione: (2024)

Online Adversarial Knowledge Distillation for Graph Neural Networks
di: Wang, Can, et al.
Pubblicazione: (2021)

Teach Me to Trick: Exploring Adversarial Transferability via Knowledge Distillation
di: Pradhan, Siddhartha, et al.
Pubblicazione: (2025)

Post-Pruning Accuracy Recovery via Data-Free Knowledge Distillation
di: Tripurwar, Chinmay, et al.
Pubblicazione: (2025)

AdvSynGNN: Structure-Adaptive Graph Neural Nets via Adversarial Synthesis and Self-Corrective Propagation
di: Fu, Rong, et al.
Pubblicazione: (2026)

GNN for Structural Displacement Prediction
di: Chang, Hung-Fu, et al.
Pubblicazione: (2026)

Geometric Limits of Knowledge Distillation: A Minimum-Width Theorem via Superposition Theory
di: Sarkar, Nilesh, et al.
Pubblicazione: (2026)

OpenGrok: Enhancing SNS Data Processing with Distilled Knowledge and Mask-like Mechanisms
di: AI, Lumen, et al.
Pubblicazione: (2025)

FedKDX: Federated Learning with Negative Knowledge Distillation for Enhanced Healthcare AI Systems
di: Pham, Quang-Tu, et al.
Pubblicazione: (2026)

LinkThief: Combining Generalized Structure Knowledge with Node Similarity for Link Stealing Attack against GNN
di: Zhang, Yuxing, et al.
Pubblicazione: (2024)

Enhancing Graph Neural Networks with Limited Labeled Data by Actively Distilling Knowledge from Large Language Models
di: Li, Quan, et al.
Pubblicazione: (2024)