Image de couverture de livre

k-Maximum Inner Product Attention for Graph Transformers and the Expressive Power of GraphGPS

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	De Schouwer, Jonas, Borde, Haitz Sáez de Ocáriz, Dong, Xiaowen
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Towards Quantifying Long-Range Interactions in Graph Machine Learning: a Large Graph Dataset and a Measurement
par: Liang, Huidong, et autres
Publié: (2025)

Beyond Parallelism: Synergistic Computational Graph Effects in Multi-Head Attention
par: Borde, Haitz Sáez de Ocáriz
Publié: (2025)

Mathematical Foundations of Geometric Deep Learning
par: Borde, Haitz Sáez de Ocáriz, et autres
Publié: (2025)

Fine-Tuning Next-Scale Visual Autoregressive Models with Group Relative Policy Optimization
par: Gallici, Matteo, et autres
Publié: (2025)

LoRA Fine-Tuning Without GPUs: A CPU-Efficient Meta-Generation Framework for LLMs
par: Arabpour, Reza, et autres
Publié: (2025)

Scalable Message Passing Neural Networks: No Need for Attention in Large Graph Representation Learning
par: Borde, Haitz Sáez de Ocáriz, et autres
Publié: (2024)

Metric Learning for Clifford Group Equivariant Neural Networks
par: Ali, Riccardo, et autres
Publié: (2024)

Neural Snowflakes: Universal Latent Graph Inference via Trainable Latent Geometries
par: Borde, Haitz Sáez de Ocáriz, et autres
Publié: (2023)

Sharp Generalization Bounds for Foundation Models with Asymmetric Randomized Low-Rank Adapters
par: Kratsios, Anastasis, et autres
Publié: (2025)

The Stepwise Informativeness Assumption: Why are Entropy Dynamics and Reasoning Correlated in LLMs?
par: Català, Mar Gonzàlez I, et autres
Publié: (2026)

Bridging Graph and State-Space Modeling for Intensive Care Unit Length of Stay Prediction
par: Zi, Shuqi, et autres
Publié: (2025)

Structured Captions Improve Prompt Adherence in Text-to-Image Models (Re-LAION-Caption 19M)
par: Merchant, Nicholas, et autres
Publié: (2025)

Closed-Form Diffusion Models
par: Scarvelis, Christopher, et autres
Publié: (2023)

On the Expressive Power of Graph Neural Networks
par: Nalwade, Ashwin, et autres
Publié: (2024)

Neural Spacetimes for DAG Representation Learning
par: Borde, Haitz Sáez de Ocáriz, et autres
Publié: (2024)

Polynormer: Polynomial-Expressive Graph Transformer in Linear Time
par: Deng, Chenhui, et autres
Publié: (2024)

Weisfeiler-Lehman goes Dynamic: An Analysis of the Expressive Power of Graph Neural Networks for Attributed and Dynamic Graphs
par: Beddar-Wiesing, Silvia, et autres
Publié: (2022)

Expanding Expressivity in Transformer Models with MöbiusAttention
par: Halacheva, Anna-Maria, et autres
Publié: (2024)

Approximation Rates and VC-Dimension Bounds for (P)ReLU MLP Mixture of Experts
par: Kratsios, Anastasis, et autres
Publié: (2024)

Towards Mechanistic Interpretability of Graph Transformers via Attention Graphs
par: El, Batu, et autres
Publié: (2025)

EquiformerV3: Scaling Efficient, Expressive, and General SE(3)-Equivariant Graph Attention Transformers
par: Liao, Yi-Lun, et autres
Publié: (2026)

On the Stability of Expressive Positional Encodings for Graphs
par: Huang, Yinan, et autres
Publié: (2023)

Bures-Wasserstein Flow Matching for Graph Generation
par: Jiang, Keyue, et autres
Publié: (2025)

MEGAN: Multi-Explanation Graph Attention Network
par: Teufel, Jonas, et autres
Publié: (2022)

How Expressive are Knowledge Graph Foundation Models?
par: Huang, Xingyue, et autres
Publié: (2025)

Are Expressive Encoders Necessary for Discrete Graph Generation?
par: Revolinsky, Jay, et autres
Publié: (2026)

Graph Convolutions Enrich the Self-Attention in Transformers!
par: Choi, Jeongwhan, et autres
Publié: (2023)

VecFormer: Towards Efficient and Generalizable Graph Transformer with Graph Token Attention
par: Zhou, Jingbo, et autres
Publié: (2026)

Heterogeneous Graph Structure Learning through the Lens of Data-generating Processes
par: Jiang, Keyue, et autres
Publié: (2025)

On The Expressive Power of Knowledge Graph Embedding Methods
par: Gao, Jiexing, et autres
Publié: (2024)

Classification Fields: Arbitrarily Fine Recursive Hierarchical Clustering From Few Examples
par: Li, Yicen, et autres
Publié: (2026)

Soro: A Lightweight Foundation Model and Chatbot for Tajik
par: Liashkov, Stanislav, et autres
Publié: (2026)

On the Expressive Power of Transformers for Maxout Networks and Continuous Piecewise Linear Functions
par: Gu, Linyan, et autres
Publié: (2026)

CombAlign: Enhancing Model Expressiveness in Unsupervised Graph Alignment
par: Chen, Songyang, et autres
Publié: (2024)

Boosting Graph Neural Network Expressivity with Learnable Lanczos Constraints
par: Azizi, Niloofar, et autres
Publié: (2024)

Hybrid Focal and Full-Range Attention Based Graph Transformers
par: Zhu, Minhong, et autres
Publié: (2023)

Neighbourhood Transformer: Switchable Attention for Monophily-Aware Graph Learning
par: Luo, Yi, et autres
Publié: (2026)

Graph and Simplicial Complex Prediction Gaussian Process via the Hodgelet Representations
par: Alain, Mathieu, et autres
Publié: (2025)

On Measuring Long-Range Interactions in Graph Neural Networks
par: Bamberger, Jacob, et autres
Publié: (2025)

Can Graph Foundation Models Generalize Over Architecture?
par: Gutteridge, Benjamin, et autres
Publié: (2026)