Copertina

Do traveling waves make good positional encodings?

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	van de Geijn, Chase, Paliwal, Ayush, Lüddecke, Timo, Ecker, Alexander S.
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Clifford Algebraic Rotor Embeddings : Maybe embeddings should start to CARE
di: Sriram, Sameeksha, et al.
Pubblicazione: (2025)

A Circular Argument : Does RoPE need to be Equivariant for Vision?
di: van de Geijn, Chase, et al.
Pubblicazione: (2025)

The role of positional encodings in the ARC benchmark
di: Costa, Guilherme H. Bandeira, et al.
Pubblicazione: (2025)

FLASHμ: Fast Localizing And Sizing of Holographic Microparticles
di: Paliwal, Ayush, et al.
Pubblicazione: (2025)

What makes a good feedforward computational graph?
di: Vitvitskyi, Alex, et al.
Pubblicazione: (2025)

Alternative positional encoding functions for neural transformers
di: Lopez-Rubio, Ezequiel, et al.
Pubblicazione: (2025)

Graph Transformers without Positional Encodings
di: Garg, Ayush
Pubblicazione: (2024)

DualBind: A Dual-Loss Framework for Protein-Ligand Binding Affinity Prediction
di: Liu, Meng, et al.
Pubblicazione: (2024)

What makes Models Compositional? A Theoretical View: With Supplement
di: Ram, Parikshit, et al.
Pubblicazione: (2024)

Reinforcement Learning for Graph Coloring: Understanding the Power and Limits of Non-Label Invariant Representations
di: Cummins, Chase, et al.
Pubblicazione: (2024)

Offline Reinforcement Learning: Role of State Aggregation and Trajectory Data
di: Jia, Zeyu, et al.
Pubblicazione: (2024)

Explanations that reveal all through the definition of encoding
di: Puli, Aahlad, et al.
Pubblicazione: (2024)

An Explainable Gaussian Process Auto-encoder for Tabular Data
di: Zhang, Wei, et al.
Pubblicazione: (2025)

Auto-encoding Molecules: Graph-Matching Capabilities Matter
di: Cunow, Magnus, et al.
Pubblicazione: (2025)

Development of a graph neural network surrogate for travel demand modelling
di: Makarov, Nikita, et al.
Pubblicazione: (2024)

Artificial Neural Nets and the Representation of Human Concepts
di: Freiesleben, Timo
Pubblicazione: (2023)

Context Matters: Leveraging Contextual Features for Time Series Forecasting
di: Chattopadhyay, Sameep, et al.
Pubblicazione: (2024)

FoGE: Fock Space inspired encoding for graph prompting
di: Chytas, Sotirios Panagiotis, et al.
Pubblicazione: (2025)

CIMAGE: Exploiting the Conditional Independence in Masked Graph Auto-encoders
di: Park, Jongwon, et al.
Pubblicazione: (2025)

Nonlocal operator learning for fMRI encoding and decoding tasks
di: Kramer, Andreas, et al.
Pubblicazione: (2026)

The Role of Environment Access in Agnostic Reinforcement Learning
di: Krishnamurthy, Akshay, et al.
Pubblicazione: (2025)

Train on Validation (ToV): Fast data selection with applications to fine-tuning
di: Jain, Ayush, et al.
Pubblicazione: (2025)

Robust Simulation-Based Inference under Missing Data via Neural Processes
di: Verma, Yogesh, et al.
Pubblicazione: (2025)

In-Context Learning in Linear vs. Quadratic Attention Models: An Empirical Study on Regression Tasks
di: Goel, Ayush, et al.
Pubblicazione: (2026)

Scaling laws for learning with real and surrogate data
di: Jain, Ayush, et al.
Pubblicazione: (2024)

Discrete Semantic States and Hamiltonian Dynamics in LLM Embedding Spaces
di: Laine, Timo Aukusti
Pubblicazione: (2025)

Quantum feature encoding optimization
di: Fioravanti, Tommaso, et al.
Pubblicazione: (2025)

Do graph neural network states contain graph properties?
di: Pelletreau-Duris, Tom, et al.
Pubblicazione: (2024)

Analogy making as amortised model construction
di: Nagy, David G., et al.
Pubblicazione: (2025)

Diffusion on language model encodings for protein sequence generation
di: Meshchaninov, Viacheslav, et al.
Pubblicazione: (2024)

Unlearning Clients, Features and Samples in Vertical Federated Learning
di: Varshney, Ayush K., et al.
Pubblicazione: (2025)

A representational framework for learning and encoding structurally enriched trajectories in complex agent environments
di: Catarau-Cotutiu, Corina, et al.
Pubblicazione: (2025)

Automated decision-making for dynamic task assignment at scale
di: Bianco, Riccardo Lo, et al.
Pubblicazione: (2025)

Applications of Modular Co-Design for De Novo 3D Molecule Generation
di: Reidenbach, Danny, et al.
Pubblicazione: (2025)

Scalable Permutation-Aware Modeling for Temporal Set Prediction
di: Ranjan, Ashish, et al.
Pubblicazione: (2025)

PeSANet: Physics-encoded Spectral Attention Network for Simulating PDE-Governed Complex Systems
di: Wan, Han, et al.
Pubblicazione: (2025)

Do Deep Neural Network Solutions Form a Star Domain?
di: Sonthalia, Ankit, et al.
Pubblicazione: (2024)

Can GPT Redefine Medical Understanding? Evaluating GPT on Biomedical Machine Reading Comprehension
di: Vatsal, Shubham, et al.
Pubblicazione: (2024)

GaussMark: A Practical Approach for Structural Watermarking of Language Models
di: Block, Adam, et al.
Pubblicazione: (2025)

In value-based deep reinforcement learning, a pruned network is a good network
di: Obando-Ceron, Johan, et al.
Pubblicazione: (2024)