Cover Image

Inexact calculus of variations on the hyperspherical tangent bundle and its connections to the attention mechanism

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Gracyk, Andrew
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Complex variational autoencoders admit Kähler structure
by: Gracyk, Andrew
Published: (2025)

Ricci flow regularization in latent spaces for the forward learning of partial differential equations
by: Gracyk, Andrew
Published: (2024)

Complex normalizing flows can almost be information Kähler-Ricci flows
by: Gracyk, Andrew
Published: (2026)

Pseudo-differential-enhanced physics-informed neural networks
by: Gracyk, Andrew
Published: (2026)

Variational autoencoders with latent high-dimensional steady geometric flows for dynamics
by: Gracyk, Andrew
Published: (2024)

Observability conditions for neural state-space models with eigenvalues and their roots of unity
by: Gracyk, Andrew
Published: (2025)

GeONet: a neural operator for learning the Wasserstein geodesic
by: Gracyk, Andrew, et al.
Published: (2022)

Synchronization-based clustering on the unit hypersphere
by: Kapić, Zinaid, et al.
Published: (2026)

Geometric flow regularization in latent spaces for smooth dynamics with the efficient variations of curvature
by: Gracyk, Andrew
Published: (2025)

Easy attention: A simple attention mechanism for temporal predictions with transformers
by: Sanchis-Agudo, Marcial, et al.
Published: (2023)

Approximation of relation functions and attention mechanisms
by: Altabaa, Awni, et al.
Published: (2024)

Fast attention mechanisms: a tale of parallelism
by: Liu, Jingwen, et al.
Published: (2025)

Relational inductive biases on attention mechanisms
by: Mijangos, Víctor, et al.
Published: (2025)

Preconditioned Inexact Stochastic ADMM for Deep Model
by: Zhou, Shenglong, et al.
Published: (2025)

Reservoir observer enhanced with residual calibration and attention mechanism
by: Liu, Yichen, et al.
Published: (2026)

Tucker Attention: A generalization of approximate attention mechanisms
by: Klein, Timon, et al.
Published: (2026)

Inexact subgradient methods for semialgebraic functions
by: Bolte, Jérôme, et al.
Published: (2024)

Bilevel Learning with Inexact Stochastic Gradients
by: Salehi, Mohammad Sadegh, et al.
Published: (2024)

Rethinking Consistent Multi-Label Classification Under Inexact Supervision
by: Wang, Wei, et al.
Published: (2025)

Beyond the Ideal: Analyzing the Inexact Muon Update
by: Shulgin, Egor, et al.
Published: (2025)

An Inexact Weighted Proximal Trust-Region Method
by: Maia, Leandro Farias, et al.
Published: (2026)

Redundant feature screening method for human activity recognition based on attention purification mechanism
by: Li, Xiaoyang, et al.
Published: (2025)

A foundation model with multi-variate parallel attention to generate neuronal activity
by: Carzaniga, Francesco, et al.
Published: (2025)

Applications of fractional calculus in learned optimization
by: Szente, Teodor Alexandru, et al.
Published: (2024)

Contextual Strongly Convex Simulation Optimization: Optimize then Predict with Inexact Solutions
by: Lin, Nifei, et al.
Published: (2025)

Sink vs. diagonal patterns as mechanisms for attention switch and oversmoothing prevention
by: Súkeník, Peter, et al.
Published: (2026)

Continual learning with the neural tangent ensemble
by: Benjamin, Ari S., et al.
Published: (2024)

Bayesian Optimization with Inexact Acquisition: Is Random Grid Search Sufficient?
by: Kim, Hwanwoo, et al.
Published: (2025)

Understanding the role of depth in the neural tangent kernel for overparameterized neural networks
by: St-Arnaud, William, et al.
Published: (2025)

Complexity of Inexact Proximal Point Algorithm for minimizing convex functions with Holderian Growth
by: Pătraşcu, Andrei, et al.
Published: (2021)

In-context denoising with one-layer transformers: connections between attention and associative memory retrieval
by: Smart, Matthew, et al.
Published: (2025)

Physics-integrated generative modeling using attentive planar normalizing flow based variational autoencoder
by: Akhtar, Sheikh Waqas
Published: (2024)

On the Error-Propagation of Inexact Hotelling's Deflation for Principal Component Analysis
by: Liao, Fangshuo, et al.
Published: (2023)

Hermitian Yang--Mills connections on general vector bundles: geometry and physical Yukawa couplings
by: Mishra, Challenger, et al.
Published: (2025)

Geometric design of the tangent term in landing algorithms for orthogonality constraints
by: Goyens, Florentin, et al.
Published: (2025)

Hybrid Deep Learning Model for epileptic seizure classification by using 1D-CNN with multi-head attention mechanism
by: Guhdar, Mohammed, et al.
Published: (2025)

A multi-source data power load forecasting method using attention mechanism-based parallel cnn-gru
by: Min, Chao, et al.
Published: (2024)

Expressive Power of Floating-Point Neural Networks with Arbitrary Reduction Orders and Inexact Activation Implementations
by: Park, Yeachan, et al.
Published: (2026)

Convergence and Complexity Guarantee for Inexact First-order Riemannian Optimization Algorithms
by: Li, Yuchen, et al.
Published: (2024)

From Inexact Gradients to Byzantine Robustness: Acceleration and Optimization under Similarity
by: Gaucher, Renaud, et al.
Published: (2026)