Cover Image

Intrinsic and Extrinsic Organized Attention: Softmax Invariance and Network Sparsity

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Fasina, Oluwadamilola, Pohle, Ruben V. C., Su, Pei-Chun, Coifman, Ronald R.
Format:	Preprint
Published:	2025
Subjects:	Numerical Analysis Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

D-tensor paraproducts and its caricatures
by: Fasina, Oluwadamilola
Published: (2025)

Extracting Dual Analytic Geometries of Linear Transformations to Achieve Efficient Computation
by: Su, Pei-Chun, et al.
Published: (2025)

Hierarchical paraproducts
by: Fasina, Oluwadamilola
Published: (2026)

Quasilinearization with regularizing tensor paraproducts
by: Fasina, Oluwadamilola
Published: (2025)

Softmax gradient policy for variance minimization and risk-averse multi armed bandits
by: Turinici, Gabriel
Published: (2026)

CATO: Charted Attention for Neural PDE Operators
by: Cheng, Chun-Wun, et al.
Published: (2026)

Intrinsic Dimension Estimating Autoencoder (IDEA) Using CancelOut Layer and a Projected Loss
by: Oriou, Antoine, et al.
Published: (2025)

Stable Weight Updating: A Key to Reliable PDE Solutions Using Deep Learning
by: Noorizadegan, A., et al.
Published: (2024)

UGM2N: An Unsupervised and Generalizable Mesh Movement Network via M-Uniform Loss
by: Wang, Zhichao, et al.
Published: (2025)

Bayesian Interpolating Neural Network (B-INN): a scalable and reliable Bayesian model for large-scale physical systems
by: Park, Chanwook, et al.
Published: (2026)

FAST: Factorizable Attention for Speeding up Transformers
by: Gerami, Armin, et al.
Published: (2024)

Robust Training of Neural Networks at Arbitrary Precision and Sparsity
by: Ye, Chengxi, et al.
Published: (2024)

Enhancing Forex Forecasting Accuracy: The Impact of Hybrid Variable Sets in Cognitive Algorithmic Trading Systems
by: King, Juan C., et al.
Published: (2025)

AttNS: Attention-Inspired Numerical Solving For Limited Data Scenarios
by: Huang, Zhongzhan, et al.
Published: (2023)

Beyond Loss Guidance: Using PDE Residuals as Spectral Attention in Diffusion Neural Operators
by: Sawhney, Medha, et al.
Published: (2025)

SPIKE: Stable Physics-Informed Kernel Evolution Method for Solving Hyperbolic Conservation Laws
by: Su, Hua, et al.
Published: (2025)

KAN-GCN: Combining Kolmogorov-Arnold Network with Graph Convolution Network for an Accurate Ice Sheet Emulator
by: Liu, Zesheng, et al.
Published: (2025)

On the Well-Posedness of Green's Function Reconstruction via the Kirchhoff-Helmholtz Equation for One-Speed Neutron Diffusion
by: Ponciroli, Roberto
Published: (2025)

Can ChatGPT implement finite element models for geotechnical engineering applications?
by: Kim, Taegu, et al.
Published: (2025)

MultiPDENet: PDE-embedded Learning with Multi-time-stepping for Accelerated Flow Simulation
by: Wang, Qi, et al.
Published: (2025)

SymMaP: Improving Computational Efficiency in Linear Solvers through Symbolic Preconditioning
by: Wang, Hong, et al.
Published: (2025)

Uncertain but Useful: Leveraging CNN Variability into Data Augmentation
by: Gonzalez-Pepe, Inés, et al.
Published: (2025)

AI Assistants to Enhance and Exploit the PETSc Knowledge Base
by: Smith, Barry, et al.
Published: (2025)

Dominance Based Crossover Operator for Evolutionary Multi-objective Algorithms
by: Roudenko, Olga, et al.
Published: (2005)

ODE-DPS: ODE-based Diffusion Posterior Sampling for Inverse Problems in Partial Differential Equation
by: Jiang, Enze, et al.
Published: (2024)

Fast convolution algorithm for state space models
by: Beylkin, Gregory
Published: (2024)

Using Crank-Nikolson Scheme to Solve the Korteweg-de Vries (KdV) Equation
by: Wu, Qiming
Published: (2024)

A hybrid FEM-PINN method for time-dependent partial differential equations
by: Feng, Xiaodong, et al.
Published: (2024)

A data-driven learned discretization approach in finite volume schemes for hyperbolic conservation laws and varying boundary conditions
by: de Romémont, Guillaume, et al.
Published: (2024)

Improved Monte Carlo tree search formulation with multiple root nodes for discrete sizing optimization of truss structures
by: Ko, Fu-Yao, et al.
Published: (2023)

Neural Multigrid Architectures
by: Fanaskov, Vladimir
Published: (2024)

Robust Physics-Guided Diffusion for Full-Waveform Inversion
by: Peng, Jishen, et al.
Published: (2026)

Quasi-Random Physics-informed Neural Networks
by: Yu, Tianchi, et al.
Published: (2025)

Quantum Neural Network Restatement of Markov Jump Process
by: Zarezadeh, Z., et al.
Published: (2025)

A Dimensionality Reduction Approach for Convolutional Neural Networks
by: Meneghetti, Laura, et al.
Published: (2021)

FI-KAN: Fractal Interpolation Kolmogorov-Arnold Networks
by: N'guessan, Gnankan Landry Regis
Published: (2026)

STNet: Spectral Transformation Network for Solving Operator Eigenvalue Problem
by: Wang, Hong, et al.
Published: (2025)

Learning from Integral Losses in Physics Informed Neural Networks
by: Saleh, Ehsan, et al.
Published: (2023)

Deep Regularized Compound Gaussian Network for Solving Linear Inverse Problems
by: Lyons, Carter, et al.
Published: (2023)

Graph-Instructed Neural Networks for parametric problems with varying boundary conditions
by: Della Santa, Francesco, et al.
Published: (2026)