Cover Image

Rotary Position Encodings for Graphs

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Reid, Isaac, Sehanobish, Arijit, Höfs, Cederik, Mlodozeniec, Bruno, Vulpius, Leonhard, Barbero, Federico, Weller, Adrian, Choromanski, Krzysztof, Turner, Richard E., Veličković, Petar
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Computationally-efficient Graph Modeling with Refined Graph Random Features
by: Choromanski, Krzysztof, et al.
Published: (2025)

Optimal Time Complexity Algorithms for Computing General Random Walk Graph Kernels on Sparse Graphs
by: Choromanski, Krzysztof, et al.
Published: (2024)

Round and Round We Go! What makes Rotary Positional Encodings useful?
by: Barbero, Federico, et al.
Published: (2024)

RelFlexformer: Efficient Attention 3D-Transformers for Integrable Relative Positional Encodings
by: Kim, Byeongchan, et al.
Published: (2026)

General Graph Random Features
by: Reid, Isaac, et al.
Published: (2023)

Variance-Reducing Couplings for Random Features
by: Reid, Isaac, et al.
Published: (2024)

Graph Random Features for Scalable Gaussian Processes
by: Zhang, Matthew, et al.
Published: (2025)

SWING: Unlocking Implicit Graph Representations for Graph Random Features
by: Manenti, Alessandro, et al.
Published: (2026)

Repelling Random Walks
by: Reid, Isaac, et al.
Published: (2023)

Statistical Reconstruction For Anisotropic X-ray Dark-Field Tomography
by: Frank, David, et al.
Published: (2025)

Scalable Neural Network Kernels
by: Sehanobish, Arijit, et al.
Published: (2023)

Towards Scalable Exact Machine Unlearning Using Parameter-Efficient Fine-Tuning
by: Chowdhury, Somnath Basu Roy, et al.
Published: (2024)

Softmax is not Enough (for Sharp Size Generalisation)
by: Veličković, Petar, et al.
Published: (2024)

Probabilistic Modelling is Sufficient for Causal Inference
by: Mlodozeniec, Bruno, et al.
Published: (2025)

Distributional Training Data Attribution: What do Influence Functions Sample?
by: Mlodozeniec, Bruno, et al.
Published: (2025)

Fast Tree-Field Integrators: From Low Displacement Rank to Topological Transformers
by: Choromanski, Krzysztof, et al.
Published: (2024)

Structured Unrestricted-Rank Matrices for Parameter Efficient Fine-tuning
by: Sehanobish, Arijit, et al.
Published: (2024)

Not How Many, But Which: Parameter Placement in Low-Rank Adaptation
by: Sehanobish, Arijit, et al.
Published: (2026)

Leveraging Classical Algorithms for Graph Neural Networks
by: Wu, Jason, et al.
Published: (2025)

Perplexity Cannot Always Tell Right from Wrong
by: Veličković, Petar, et al.
Published: (2026)

Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers
by: Choromanski, Krzysztof Marcin, et al.
Published: (2023)

Better Hessians Matter: Studying the Impact of Curvature Approximations in Influence Functions
by: Hong, Steve, et al.
Published: (2025)

Cross-device Zero-shot Label Transfer via Alignment of Time Series Foundation Model Embeddings
by: Ravindra, Neal G., et al.
Published: (2025)

Linear Transformer Topological Masking with Graph Random Features
by: Reid, Isaac, et al.
Published: (2024)

Commute-Time-Optimised Graphs for GNNs
by: Sterner, Igor, et al.
Published: (2024)

How do LLMs Compute Verbal Confidence
by: Kumaran, Dharshan, et al.
Published: (2026)

Cayley Graph Propagation
by: Wilson, JJ, et al.
Published: (2024)

Incremental Transformer Neural Processes
by: Mortimer, Philip, et al.
Published: (2026)

Recurrent Aggregators in Neural Algorithmic Reasoning
by: Xu, Kaijia, et al.
Published: (2024)

Temporal Graph Rewiring with Expander Graphs
by: Petrović, Katarina, et al.
Published: (2024)

Why do LLMs attend to the first token?
by: Barbero, Federico, et al.
Published: (2025)

O BARCO VAI SE LEVANDORETRATO DE UMA IMIGRANTE BRASILEIRA EM PARAMA-RIBO, SURINAME
by: Carolina Carret Höfs
Published: (2007)

Influence Functions for Scalable Data Attribution in Diffusion Models
by: Mlodozeniec, Bruno, et al.
Published: (2024)

EUGens: Efficient, Unified, and General Dense Layers
by: Kim, Sang Min, et al.
Published: (2024)

EUGens: Efficient, Unified, and General Dense Layers
by: Kim, Sang Min, et al.
Published: (2026)

Near-Linear Time Generalized Sinkhorn Algorithms for Bounded Genus Graphs
by: Choromanski, Krzysztof, et al.
Published: (2026)

Head-wise Adaptive Rotary Positional Encoding for Fine-Grained Image Generation
by: Li, Jiaye, et al.
Published: (2025)

Position: Categorical Deep Learning is an Algebraic Theory of All Architectures
by: Gavranović, Bruno, et al.
Published: (2024)

Parallel Algorithms Align with Neural Execution
by: Engelmayer, Valerie, et al.
Published: (2023)

Positional Attention: Expressivity and Learnability of Algorithmic Computation
by: de Luca, Artur Back, et al.
Published: (2024)