Copertina

Power law attention biases for molecular transformers

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Shen, Jay, Tang, Yifeng, Ferguson, Andrew
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computational Physics
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

A standard transformer and attention with linear biases for molecular conformer generation
di: Gurev, Viatcheslav, et al.
Pubblicazione: (2025)

Uncertainty-biased molecular dynamics for learning uniformly accurate interatomic potentials
di: Zaverkin, Viktor, et al.
Pubblicazione: (2023)

Orbital distortion and parabolic channel effects transform minima in molecular ionization probabilities into maxima
di: Wahyutama, Imam S., et al.
Pubblicazione: (2025)

Relational inductive biases on attention mechanisms
di: Mijangos, Víctor, et al.
Pubblicazione: (2025)

Methods for non-variational heuristic quantum optimisation
di: Ferguson, Stuart, et al.
Pubblicazione: (2026)

Exploiting biased noise in variational quantum models
di: van Rossum, Connor, et al.
Pubblicazione: (2025)

New intelligent empowerment for digital transformation
di: Yifeng, Peng, et al.
Pubblicazione: (2024)

Learning spatially structured open quantum dynamics with regional-attention transformers
di: Du, Dounan, et al.
Pubblicazione: (2025)

A new kind of automorphic form and a proof of the essential transformation laws
di: Henry, Michael Andrew
Pubblicazione: (2025)

Multi-scale cross-attention transformer encoder for event classification
di: Hammad, A., et al.
Pubblicazione: (2023)

Semi-Analytic Solutions to the Noh Problem with a Black Box Equation of State
di: Gerberding, Seth, et al.
Pubblicazione: (2025)

Overcoming the chemical complexity bottleneck in on-the-fly machine learned molecular dynamics simulations
di: Timmerman, Lucas R., et al.
Pubblicazione: (2024)

Dynamics of discrete spacetimes with Quantum-enhanced Markov Chain Monte Carlo
di: Ferguson, Stuart, et al.
Pubblicazione: (2025)

Enhancing compact convolutional transformers with super attention
di: Leandre, Simpenzwe Honore, et al.
Pubblicazione: (2025)

Fast Laplace transforms on quantum computers
di: Zylberman, Julien
Pubblicazione: (2024)

Coarse-Grained Dynamics with Spatial Disorder and Non-Markovian Memory
di: Liu, Chuyi, et al.
Pubblicazione: (2026)

Scaling law for Kasha's rule in photoexcited molecular aggregates
di: Holzinger, Raphael, et al.
Pubblicazione: (2023)

Neural canonical transformations for vibrational spectra of molecules
di: Zhang, Qi, et al.
Pubblicazione: (2024)

Data-driven construction of a generalized kinetic collision operator from molecular dynamics
di: Zhao, Yue, et al.
Pubblicazione: (2025)

A distributional simplicity bias in the learning dynamics of transformers
di: Rende, Riccardo, et al.
Pubblicazione: (2024)

A novel quantum circuit for the quantum Fourier transform
di: Romero, Juan M., et al.
Pubblicazione: (2025)

Self-attention enabled quantum path analysis of high-harmonic generation in solids
di: Zhao, Cong, et al.
Pubblicazione: (2025)

An attention economy model of co-evolution between content quality and audience selectivity
di: Chujyo, Masaki, et al.
Pubblicazione: (2026)

Are neural scaling laws leading quantum chemistry astray?
di: Lee, Siwoo, et al.
Pubblicazione: (2025)

Insect-inspired modular architectures as inductive biases for reinforcement learning
di: Staples, Anne E.
Pubblicazione: (2026)

Polynomial propagators for classical molecular dynamics
di: Kondov, Ivan
Pubblicazione: (2023)

Study of scaling laws in language families
di: Santos, Maelyson R. F., et al.
Pubblicazione: (2025)

MDDM: A Molecular Dynamics Diffusion Model to Predict Particle Self-Assembly
di: Ferguson, Kevin, et al.
Pubblicazione: (2025)

Modeling biases in binary decision-making within the generalized nonlinear q-voter model
di: Doniec, Maciej, et al.
Pubblicazione: (2025)

Gauge transformation for pulse propagation and time ordered integrals
di: Abbout, Adel
Pubblicazione: (2026)

Universal statistical laws governing culinary design
di: Bagler, Ganesh, et al.
Pubblicazione: (2026)

Multi-task learning for molecular electronic structure approaching coupled-cluster accuracy
di: Tang, Hao, et al.
Pubblicazione: (2024)

The benefits and biases of seeing the world's cities through marathons
di: Renninger, Andrew
Pubblicazione: (2026)

Generalized mixed variable-pullback scheme with non-ideal Ohm's law for electromagnetic gyrokinetic simulations
di: Lu, Zhixin, et al.
Pubblicazione: (2025)

Combining transition path sampling with data-driven collective variables through a reactivity-biased shooting algorithm
di: Zhang, Jintu, et al.
Pubblicazione: (2024)

Revealing the molecular structures of a-Al2O3(0001)-water interface by machine learning based computational vibrational spectroscopy
di: Du, Xianglong, et al.
Pubblicazione: (2024)

Recognizing and generating knotted molecular structures by machine learning
di: Zhang, Zhiyu, et al.
Pubblicazione: (2025)

Fourier's law breakdown for the planar-rotor chain with long-range coupling
di: Lima, Henrique Santos, et al.
Pubblicazione: (2024)

Parallel athermal quasistatic deformation stepping of molecular systems
di: Reihn, Maximilian, et al.
Pubblicazione: (2025)

The transformative capability of quantum-accurate machine learning interatomic potentials
di: Correa, Alfredo A., et al.
Pubblicazione: (2025)