Cover Image

GSTAM: Efficient Graph Distillation with Structural Attention-Matching

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Rasti-Meymandi, Arash, Sajedi, Ahmad, Xu, Zhaopan, Plataniotis, Konstantinos N.
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

DataDAM: Efficient Dataset Distillation with Attention Matching
by: Sajedi, Ahmad, et al.
Published: (2023)

Prioritize Alignment in Dataset Distillation
by: Li, Zekai, et al.
Published: (2024)

Active Inference and Reinforcement Learning: A unified inference on continuous state and action spaces under partial observability
by: Malekzadeh, Parvin, et al.
Published: (2022)

FedD2S: Personalized Data-Free Federated Knowledge Distillation
by: Atapour, Kawa, et al.
Published: (2024)

Data-to-Model Distillation: Data-Efficient Learning Framework
by: Sajedi, Ahmad, et al.
Published: (2024)

SAS: Semantic-aware Sampling for Generative Dataset Distillation
by: Li, Mingzhuo, et al.
Published: (2026)

ProbMCL: Simple Probabilistic Contrastive Learning for Multi-label Visual Classification
by: Sajedi, Ahmad, et al.
Published: (2024)

Information-Guided Diffusion Sampling for Dataset Distillation
by: Ye, Linfeng, et al.
Published: (2025)

The Missing Point in Vision Transformers for Universal Image Segmentation
by: Shahabodini, Sajjad, et al.
Published: (2025)

Path-Guided Flow Matching for Dataset Distillation
by: Li, Xuhui, et al.
Published: (2026)

Online Policy Distillation with Decision-Attention
by: Yu, Xinqiang, et al.
Published: (2024)

IoMT-based Automated Leukemia Classification using CNN and Higher Order Singular Value
by: Marzijarani, Shabnam Bagheri, et al.
Published: (2025)

Value of Information-Enhanced Exploration in Bootstrapped DQN
by: Plataniotis, Stergios, et al.
Published: (2025)

Transition Matching Distillation for Fast Video Generation
by: Nie, Weili, et al.
Published: (2026)

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction
by: Xia, Xiaojie, et al.
Published: (2026)

Efficient and Robust Knowledge Distillation from A Stronger Teacher Based on Correlation Matching
by: Niu, Wenqi, et al.
Published: (2024)

Distilling Genomic Models for Efficient mRNA Representation Learning via Embedding Matching
by: Haidari, Rasched, et al.
Published: (2026)

Are Graph Attention Networks Able to Model Structural Information?
by: Noravesh, Farshad, et al.
Published: (2025)

Normalized Conditional Mutual Information Surrogate Loss for Deep Neural Classifiers
by: Ye, Linfeng, et al.
Published: (2026)

Emphasizing Discriminative Features for Dataset Distillation in Complex Scenarios
by: Wang, Kai, et al.
Published: (2024)

VecFormer: Towards Efficient and Generalizable Graph Transformer with Graph Token Attention
by: Zhou, Jingbo, et al.
Published: (2026)

Graph Neural Thompson Sampling
by: Wu, Shuang, et al.
Published: (2024)

Weighted Graph Structure Learning with Attention Denoising for Node Classification
by: Wang, Tingting, et al.
Published: (2025)

HGATSolver: A Heterogeneous Graph Attention Solver for Fluid-Structure Interaction
by: Zhang, Qin-Yi, et al.
Published: (2026)

Distillation of Large Language Models via Concrete Score Matching
by: Kim, Yeongmin, et al.
Published: (2025)

LLM and GNN are Complementary: Distilling LLM for Multimodal Graph Learning
by: Xu, Junjie, et al.
Published: (2024)

Mitigating Degree Bias in Graph Representation Learning with Learnable Structural Augmentation and Structural Self-Attention
by: Hoang, Van Thuy, et al.
Published: (2025)

Distil-xLSTM: Learning Attention Mechanisms through Recurrent Structures
by: Thiombiano, Abdoul Majid O., et al.
Published: (2025)

KD-GAT: Combining Knowledge Distillation and Graph Attention Transformer for a Controller Area Network Intrusion Detection System
by: Frenken, Robert, et al.
Published: (2025)

Mirage: Model-Agnostic Graph Distillation for Graph Classification
by: Gupta, Mridul, et al.
Published: (2023)

Hybrid Linear Attention Done Right: Efficient Distillation and Effective Architectures for Extremely Long Contexts
by: Chen, Yingfa, et al.
Published: (2026)

Curriculum Learning for Efficient Chain-of-Thought Distillation via Structure-Aware Masking and GRPO
by: Yu, Bowen, et al.
Published: (2026)

DistDD: Distributed Data Distillation Aggregation through Gradient Matching
by: Wang, Peiran, et al.
Published: (2024)

One-step Diffusion Models with $f$-Divergence Distribution Matching
by: Xu, Yilun, et al.
Published: (2025)

Logical Distillation of Graph Neural Networks
by: Pluska, Alexander, et al.
Published: (2024)

Graph Knowledge Distillation to Mixture of Experts
by: Rumiantsev, Pavel, et al.
Published: (2024)

Neighbourhood Transformer: Switchable Attention for Monophily-Aware Graph Learning
by: Luo, Yi, et al.
Published: (2026)

Distilling Two-Timed Flow Models by Separately Matching Initial and Terminal Velocities
by: Khungurn, Pramook, et al.
Published: (2025)

Preference-Based Self-Distillation: Beyond KL Matching via Reward Regularization
by: Yu, Xin, et al.
Published: (2026)

Dispatch-Aware Ragged Attention for Pruned Vision Transformers
by: Abdellatif, Seifeldin, et al.
Published: (2026)