Cover Image

Relieving the Over-Aggregating Effect in Graph Transformers

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Sun, Junshu, Chang, Wanxing, Yang, Chenxue, Huang, Qingming, Wang, Shuhui
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Scalable Graph Compressed Convolutions
by: Sun, Junshu, et al.
Published: (2024)

Towards Dynamic Message Passing on Graphs
by: Sun, Junshu, et al.
Published: (2024)

Edit Less, Achieve More: Dynamic Sparse Neuron Masking for Lifelong Knowledge Editing in LLMs
by: Liu, Jinzhe, et al.
Published: (2025)

VL-SAE: Interpreting and Enhancing Vision-Language Alignment with a Unified Concept Set
by: Shen, Shufan, et al.
Published: (2025)

Kernelized Sparse Fine-Tuning with Bi-level Parameter Competition for Vision Models
by: Shen, Shufan, et al.
Published: (2025)

Expanding Sparse Tuning for Low Memory Usage
by: Shen, Shufan, et al.
Published: (2024)

Enhancing Pre-trained Representation Classifiability can Boost its Interpretability
by: Shen, Shufan, et al.
Published: (2025)

Less is More: on the Over-Globalizing Problem in Graph Transformers
by: Xing, Yujie, et al.
Published: (2024)

Locate-then-Sparsify: Attribution Guided Sparse Strategy for Visual Hallucination Mitigation
by: Dang, Tiantian, et al.
Published: (2026)

HGOE: Hybrid External and Internal Graph Outlier Exposure for Graph Out-of-Distribution Detection
by: He, Junwei, et al.
Published: (2024)

GoMS: Graph of Molecule Substructure Network for Molecule Property Prediction
by: Qu, Shuhui, et al.
Published: (2025)

Boosting Graph Robustness Against Backdoor Attacks: An Over-Similarity Perspective
by: Liu, Chang, et al.
Published: (2025)

Multi-intent Aware Contrastive Learning for Sequential Recommendation
by: Huang, Junshu, et al.
Published: (2024)

Alleviating Over-Smoothing via Aggregation over Compact Manifolds
by: Zhou, Dongzhuoran, et al.
Published: (2024)

Theoretical Insights into Line Graph Transformation on Graph Learning
by: Yang, Fan, et al.
Published: (2024)

Accumulated Aggregated D-Optimal Designs for Estimating Main Effects in Black-Box Models
by: Chang, Chih-Yu, et al.
Published: (2025)

VFA: Relieving Vector Operations in Flash Attention with Global Maximum Pre-computation
by: Sun, Yupeng, et al.
Published: (2026)

ABKD: Pursuing a Proper Allocation of the Probability Mass in Knowledge Distillation via $α$-$β$-Divergence
by: Wang, Guanghui, et al.
Published: (2025)

HyperAggregation: Aggregating over Graph Edges with Hypernetworks
by: Lell, Nicolas, et al.
Published: (2024)

HAGNN: Hybrid Aggregation for Heterogeneous Graph Neural Networks
by: Zhu, Guanghui, et al.
Published: (2023)

Quantifying the Optimization and Generalization Advantages of Graph Neural Networks Over Multilayer Perceptrons
by: Huang, Wei, et al.
Published: (2023)

Multi-Source Unsupervised Domain Adaptation with Prototype Aggregation
by: Huang, Min, et al.
Published: (2024)

Subgraph Aggregation for Out-of-Distribution Generalization on Graphs
by: Liu, Bowen, et al.
Published: (2024)

DeepRicci: Self-supervised Graph Structure-Feature Co-Refinement for Alleviating Over-squashing
by: Sun, Li, et al.
Published: (2024)

SSE-SAM: Balancing Head and Tail Classes Gradually through Stage-Wise SAM
by: Lyu, Xingyu, et al.
Published: (2024)

Hgformer: Hyperbolic Graph Transformer for Recommendation
by: Yang, Xin, et al.
Published: (2024)

Over-Tokenized Transformer: Vocabulary is Generally Worth Scaling
by: Huang, Hongzhi, et al.
Published: (2025)

OpenworldAUC: Towards Unified Evaluation and Optimization for Open-world Prompt Tuning
by: Hua, Cong, et al.
Published: (2025)

Implicit Graph Neural Diffusion Networks: Convergence, Generalization, and Over-Smoothing
by: Fu, Guoji, et al.
Published: (2023)

FedIA: Towards Domain-Robust Aggregation in Federated Graph Learning
by: Zhou, Zhanting, et al.
Published: (2025)

How Universal Polynomial Bases Enhance Spectral Graph Neural Networks: Heterophily, Over-smoothing, and Over-squashing
by: Huang, Keke, et al.
Published: (2024)

Graph Neural Aggregation-diffusion with Metastability
by: Cui, Kaiyuan, et al.
Published: (2024)

PRAGA: Prototype-aware Graph Adaptive Aggregation for Spatial Multi-modal Omics Analysis
by: Huang, Xinlei, et al.
Published: (2024)

Random Aggregate Beamforming for Over-the-Air Federated Learning in Large-Scale Networks
by: Xu, Chunmei, et al.
Published: (2024)

Topology-Informed Graph Transformer
by: Choi, Yun Young, et al.
Published: (2024)

Scalable and Resource-Efficient Second-Order Federated Learning via Over-the-Air Aggregation
by: Ghalkha, Abdulmomen, et al.
Published: (2024)

GeoAggregator: An Efficient Transformer Model for Geo-Spatial Tabular Data
by: Deng, Rui, et al.
Published: (2025)

Aggregate to Adapt: Node-Centric Aggregation for Multi-Source-Free Graph Domain Adaptation
by: Zhang, Zhen, et al.
Published: (2025)

Towards Federated Clustering: A Client-wise Private Graph Aggregation Framework
by: He, Guanxiong, et al.
Published: (2025)

Focal-SAM: Focal Sharpness-Aware Minimization for Long-Tailed Classification
by: Li, Sicong, et al.
Published: (2025)