Image de couverture de livre

FlowAdam: Implicit Regularization via Geometry-Aware Soft Momentum Injection

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Singh, Devender, Sheel, Tarun
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning 65K10, 90C26 I.2.6; G.1.6
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

CAO: Curvature-Adaptive Optimization via Periodic Low-Rank Hessian Sketching
par: Du, Wenzhang
Publié: (2025)

Refining Graphical Neural Network Predictions Using Flow Matching for Optimal Power Flow with Constraint-Satisfaction Guarantee
par: Khanal, Kshitiz
Publié: (2025)

Adam Improves Muon: Adaptive Moment Estimation with Orthogonalized Momentum
par: Zhang, Minxin, et autres
Publié: (2026)

Kourkoutas-Beta: A Sunspike-Driven Adam Optimizer with Desert Flair
par: Kassinos, Stavros C.
Publié: (2025)

Multi-Objective Optimization with Desirability and Morris-Mitchell Criterion
par: Bartz-Beielstein, Thomas, et autres
Publié: (2025)

Sparse Training of Neural Networks based on Multilevel Mirror Descent
par: Lunk, Yannick, et autres
Publié: (2026)

Escaping Saddle Points via Curvature-Calibrated Perturbations: A Complete Analysis with Explicit Constants and Empirical Validation
par: Alpay, Faruk, et autres
Publié: (2025)

Adaptive Stochastic Gradient Descent Ascent Algorithm for Nonconvex Minimax Problems with Decision-Dependent Distributions
par: Gao, Yan, et autres
Publié: (2025)

Local properties of neural networks through the lens of layer-wise Hessians
par: Bolshim, Maxim, et autres
Publié: (2025)

Inter-Layer Hessian Analysis of Neural Networks with DAG Architectures
par: Bolshim, Maxim, et autres
Publié: (2026)

Stochastic Estimation of the Layer-wise Hessian Trace for Monitoring Neural-network Training
par: Bolshim, Maxim, et autres
Publié: (2026)

Where's Ben Nevis? A 2D optimisation benchmark with 957,174 local optima based on Great Britain terrain data
par: Wei, Yuhang, et autres
Publié: (2024)

On the Convergence Behavior of Preconditioned Gradient Descent Toward the Rich Learning Regime
par: Jiang, Shuai, et autres
Publié: (2026)

i-DEQ: A stable inertial deep equilibrium model for image restoration
par: Clerc, Antonin, et autres
Publié: (2026)

Bed-Attached Vibration Sensor System: A Machine Learning Approach for Fall Detection in Nursing Homes
par: Bartz-Beielstein, Thomas, et autres
Publié: (2024)

Simplifying Hyperparameter Tuning in Online Machine Learning -- The spotRiverGUI
par: Bartz-Beielstein, Thomas
Publié: (2024)

prunAdag: an adaptive pruning-aware gradient method
par: Porcelli, Margherita, et autres
Publié: (2025)

Multi-Objective Optimization and Hyperparameter Tuning With Desirability Functions
par: Bartz-Beielstein, Thomas
Publié: (2025)

NeurOptimisation: The Spiking Way to Evolve
par: Cruz-Duarte, Jorge Mario, et autres
Publié: (2025)

The Non-Linearity Perturbation Threshold: Width Scaling and Landscape Bifurcations in Deep Learning
par: Alexander, Michael
Publié: (2026)

Using Variable Interaction Graphs to Improve Particle Swarm Optimization
par: Czworkowski, Caz L., et autres
Publié: (2025)

Sufficiently Regularized Nonnegative Quartic Polynomials are Sum-of-Squares
par: Zhu, Wenqi, et autres
Publié: (2026)

ZetA: A Riemann Zeta-Scaled Extension of Adam for Deep Learning
par: BC, Samiksha
Publié: (2025)

Benchmarking Generative AI Against Bayesian Optimization for Constrained Multi-Objective Inverse Design
par: Awan, Muhammad Bilal, et autres
Publié: (2025)

Explainable and Class-Revealing Signal Feature Extraction via Scattering Transform and Constrained Zeroth-Order Optimization
par: Saito, Naoki, et autres
Publié: (2025)

IGT-OMD: Implicit Gradient Transport for Decision-Focused Learning under Delayed Feedback
par: Amoh, Benjamin, et autres
Publié: (2026)

Deep Legendre Transform
par: Minabutdinov, Aleksey, et autres
Publié: (2025)

A unified convergence theory for adaptive first-order methods in the nonconvex case, including AdaNorm, full and diagonal AdaGrad, Shampoo and Muo
par: Gratton, S., et autres
Publié: (2026)

Convex Optimization for Alignment and Preference Learning on a Single GPU
par: Feng, Miria, et autres
Publié: (2026)

Quadratic Surrogate Attractor for Particle Swarm Optimization
par: Clemente, Maurizio, et autres
Publié: (2026)

Pseudoconvex Problems in Operational Decision Systems: Algorithms for Joint Learning and Optimization
par: Li, Zijun, et autres
Publié: (2026)

Multi-Agent Honeypot-Based Request-Response Context Dataset for Improved SQL Injection Detection Performance
par: Yu, Hao, et autres
Publié: (2026)

Stochastic convergence of parallel asynchronous adaptive first-order methods
par: Gratton, Serge, et autres
Publié: (2026)

Optimizing Donor Outreach for Blood Collection Sessions: A Scalable Decision Support Framework
par: Carneiro, André, et autres
Publié: (2026)

Ghosts of Softmax: Complex Singularities That Limit Safe Step Sizes in Cross-Entropy
par: Sao, Piyush
Publié: (2026)

NOVAK: Unified adaptive optimizer for deep neural networks
par: Kavun, Sergii
Publié: (2026)

SNAPO: Smooth Neural Adjoint Policy Optimization for Optimal Control via Differentiable Simulation
par: Goloubentsev, Dmitri, et autres
Publié: (2026)

Illuminating the Black Box: Real-Time Monitoring of Backdoor Unlearning in CNNs via Explainable AI
par: Hoang, Tien Dat
Publié: (2025)

ReconXF: Graph Reconstruction Attack via Public Feature Explanations on Privatized Node Features and Labels
par: Sahoo, Rishi Raj, et autres
Publié: (2025)

DiMEx: Breaking the Cold Start Barrier in Data-Free Model Extraction via Latent Diffusion Priors
par: Thesia, Yash, et autres
Publié: (2026)