Copertina

Exploring the Global-to-Local Attention Scheme in Graph Transformers: An Empirical Study

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Wu, Gang, Wang, Zhengwei
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

VecFormer: Towards Efficient and Generalizable Graph Transformer with Graph Token Attention
di: Zhou, Jingbo, et al.
Pubblicazione: (2026)

Scaling Graph Transformers: A Comparative Study of Sparse and Dense Attention
di: Dimitrov, Leon
Pubblicazione: (2025)

Bridging Local and Global Knowledge via Transformer in Board Games
di: Ju, Yan-Ru, et al.
Pubblicazione: (2024)

Towards Mechanistic Interpretability of Graph Transformers via Attention Graphs
di: El, Batu, et al.
Pubblicazione: (2025)

Graph Convolutions Enrich the Self-Attention in Transformers!
di: Choi, Jeongwhan, et al.
Pubblicazione: (2023)

Less is More: on the Over-Globalizing Problem in Graph Transformers
di: Xing, Yujie, et al.
Pubblicazione: (2024)

Hybrid Focal and Full-Range Attention Based Graph Transformers
di: Zhu, Minhong, et al.
Pubblicazione: (2023)

Neighbourhood Transformer: Switchable Attention for Monophily-Aware Graph Learning
di: Luo, Yi, et al.
Pubblicazione: (2026)

k-Maximum Inner Product Attention for Graph Transformers and the Expressive Power of GraphGPS
di: De Schouwer, Jonas, et al.
Pubblicazione: (2026)

Graph Dimension Attention Networks for Enterprise Credit Assessment
di: Wei, Shaopeng, et al.
Pubblicazione: (2024)

CVTGAD: Simplified Transformer with Cross-View Attention for Unsupervised Graph-level Anomaly Detection
di: Li, Jindong, et al.
Pubblicazione: (2024)

Spacetime $E(n)$-Transformer: Equivariant Attention for Spatio-temporal Graphs
di: Charles, Sergio G.
Pubblicazione: (2024)

Attention Dispersion in Dynamic Graph Transformers: Diagnosis and a Transferable Fix
di: Zhang, Jinhao, et al.
Pubblicazione: (2026)

Cardinality-Preserving Attention Channels for Graph Transformers in Molecular Property Prediction
di: Gupta, Abhijit
Pubblicazione: (2026)

In-Context Learning in Linear vs. Quadratic Attention Models: An Empirical Study on Regression Tasks
di: Goel, Ayush, et al.
Pubblicazione: (2026)

LGRPool: Hierarchical Graph Pooling Via Local-Global Regularisation
di: Noravesh, Farshad, et al.
Pubblicazione: (2025)

Exploring the Efficacy of Federated-Continual Learning Nodes with Attention-Based Classifier for Robust Web Phishing Detection: An Empirical Investigation
di: M, Jesher Joshua, et al.
Pubblicazione: (2024)

B-TGAT: A Bi-directional Temporal Graph Attention Transformer for Clustering Multivariate Spatiotemporal Data
di: Nji, Francis Ndikum, et al.
Pubblicazione: (2025)

Spatial-temporal Graph Convolutional Networks with Diversified Transformation for Dynamic Graph Representation Learning
di: Wang, Ling, et al.
Pubblicazione: (2024)

Graph Diffusion Transformers are In-Context Molecular Designers
di: Liu, Gang, et al.
Pubblicazione: (2025)

DuetGraph: Coarse-to-Fine Knowledge Graph Reasoning with Dual-Pathway Global-Local Fusion
di: Li, Jin, et al.
Pubblicazione: (2025)

LocalGCL: Local-aware Contrastive Learning for Graphs
di: Jiang, Haojun, et al.
Pubblicazione: (2024)

Global and Local Topology-Aware Attention with Persistent Homology and Euler Biases for Time-Series Forecasting
di: Faghihi, Usef, et al.
Pubblicazione: (2026)

An Empirical Study of Realized GNN Expressiveness
di: Wang, Yanbo, et al.
Pubblicazione: (2023)

DGTN: Graph-Enhanced Transformer with Diffusive Attention Gating Mechanism for Enzyme DDG Prediction
di: Lin, Abigail
Pubblicazione: (2025)

YZS-model: A Predictive Model for Organic Drug Solubility Based on Graph Convolutional Networks and Transformer-Attention
di: Wang, Chenxu, et al.
Pubblicazione: (2024)

Nexusformer: Nonlinear Attention Expansion for Stable and Inheritable Transformer Scaling
di: Zhao, Weijie, et al.
Pubblicazione: (2026)

A Model-Agnostic Graph Neural Network for Integrating Local and Global Information
di: Zhou, Wenzhuo, et al.
Pubblicazione: (2023)

Multi-Level Temporal Graph Networks with Local-Global Fusion for Industrial Fault Diagnosis
di: Aryal, Bibek, et al.
Pubblicazione: (2026)

Supercharging Graph Transformers with Advective Diffusion
di: Wu, Qitian, et al.
Pubblicazione: (2023)

Enhanced Graph Transformer with Serialized Graph Tokens
di: Wang, Ruixiang, et al.
Pubblicazione: (2026)

Integrating Locality-Aware Attention with Transformers for General Geometry PDEs
di: Koh, Minsu, et al.
Pubblicazione: (2025)

Reasoning Language Model Inference Serving Unveiled: An Empirical Study
di: Li, Qi, et al.
Pubblicazione: (2025)

Local Linear Attention: An Optimal Interpolation of Linear and Softmax Attention For Test-Time Regression
di: Zuo, Yifei, et al.
Pubblicazione: (2025)

The Bayesian Geometry of Transformer Attention
di: Agarwal, Naman, et al.
Pubblicazione: (2025)

Time-Transformer: Integrating Local and Global Features for Better Time Series Generation (Extended Version)
di: Liu, Yuansan, et al.
Pubblicazione: (2023)

GTHNA: Local-global Graph Transformer with Memory Reconstruction for Holistic Node Anomaly Evaluation
di: Li, Mingkang, et al.
Pubblicazione: (2025)

Graph Propagation Transformer for Graph Representation Learning
di: Chen, Zhe, et al.
Pubblicazione: (2023)

GSA-Forecaster: Forecasting Graph-Based Time-Dependent Data with Graph Sequence Attention
di: Li, Yang, et al.
Pubblicazione: (2021)

QSpec: Speculative Decoding with Complementary Quantization Schemes
di: Zhao, Juntao, et al.
Pubblicazione: (2024)