Cover Image

Lean and Mean Adaptive Optimization via Subset-Norm and Subspace-Momentum with Convergence Guarantees

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Nguyen, Thien Hang, Nguyen, Huy Le
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Neural and Evolutionary Computing Optimization and Control
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Tight Convergence Rate Bounds for Optimization Under Power Law Spectral Conditions
by: Velikanov, Maksim, et al.
Published: (2022)

A Globally Convergent Algorithm for Neural Network Parameter Optimization Based on Difference-of-Convex Functions
by: Tschernutter, Daniel, et al.
Published: (2024)

Optimization of Discrete Parameters Using the Adaptive Gradient Method and Directed Evolution
by: Beinarovich, Andrei, et al.
Published: (2024)

QUIVER: Cost-Aware Adaptive Preference Querying in Surrogate-Assisted Evolutionary Multi-Objective Optimization
by: Burnat, Florian A. D.
Published: (2026)

Training Non-Differentiable Networks via Optimal Transport
by: Le, An T.
Published: (2026)

An Adaptive KKT-Based Indicator for Convergence Assessment in Multi-Objective Optimization
by: Santos, Thiago, et al.
Published: (2026)

Gradient Descent, Stochastic Optimization, and Other Tales
by: Lu, Jun
Published: (2022)

Limiting Network Size within Finite Bounds for Optimization
by: Pinto, Linu, et al.
Published: (2019)

Decoupled Weight Decay for Any $p$ Norm
by: Outmezguine, Nadav Joseph, et al.
Published: (2024)

Machine Learning-Enhanced Ant Colony Optimization for Column Generation
by: Xu, Hongjie, et al.
Published: (2024)

A Composite Decomposition Method for Large-Scale Global Optimization
by: Tian, Maojiang, et al.
Published: (2024)

Empirical Evaluation of No Free Lunch Violations in Permutation-Based Optimization
by: Sroka, Grzegorz
Published: (2026)

Neural Combinatorial Optimization with Heavy Decoder: Toward Large Scale Generalization
by: Luo, Fu, et al.
Published: (2023)

Tight Stability, Convergence, and Robustness Bounds for Predictive Coding Networks
by: Mali, Ankur, et al.
Published: (2024)

Enhanced Innovized Repair Operator for Evolutionary Multi- and Many-objective Optimization
by: Mittal, Sukrit, et al.
Published: (2020)

Evolutionary Retrofitting
by: Videau, Mathurin, et al.
Published: (2024)

Understand the Effectiveness of Shortcuts through the Lens of DCA
by: Sun, Youran, et al.
Published: (2024)

Computationally Efficient Optimisation of Elbow-Type Draft Tube Using Neural Network Surrogates
by: Sikirica, Ante, et al.
Published: (2024)

The late-stage training dynamics of (stochastic) subgradient descent on homogeneous neural networks
by: Schechtman, Sholom, et al.
Published: (2025)

Availability of Perfect Decomposition in Statistical Linkage Learning for Unitation-based Function Concatenations
by: Prusik, Michal, et al.
Published: (2025)

Towards Resilient and Sustainable Global Industrial Systems: An Evolutionary-Based Approach
by: Jirkovský, Václav, et al.
Published: (2025)

EXPObench: Benchmarking Surrogate-based Optimisation Algorithms on Expensive Black-box Functions
by: Bliek, Laurens, et al.
Published: (2021)

Scaling of hardware-compatible perturbative training algorithms
by: Oripov, Bakhrom G., et al.
Published: (2025)

Annealed Mean Field Descent Is Highly Effective for Quadratic Unconstrained Binary Optimization
by: Kuroki, Kyo, et al.
Published: (2025)

Designing Robust Software Sensors for Nonlinear Systems via Neural Networks and Adaptive Sliding Mode Control
by: Farkane, Ayoub, et al.
Published: (2025)

GBO:AMulti-Granularity Optimization Algorithm via Granular-ball for Continuous Problems
by: Xia, Shuyin, et al.
Published: (2023)

Quality-Diversity Optimization as Multi-Objective Optimization
by: Lin, Xi, et al.
Published: (2026)

Optimization-Embedded Active Multi-Fidelity Surrogate Learning for Multi-Condition Airfoil Shape Optimization
by: Robledo, Isaac, et al.
Published: (2026)

A Superlinearly Convergent Evolution Strategy
by: Glasmachers, Tobias
Published: (2025)

Smooth Tchebycheff Scalarization for Multi-Objective Optimization
by: Lin, Xi, et al.
Published: (2024)

Few for Many: Tchebycheff Set Scalarization for Many-Objective Optimization
by: Lin, Xi, et al.
Published: (2024)

Improving Pareto Set Learning for Expensive Multi-objective Optimization via Stein Variational Hypernetworks
by: Nguyen, Minh-Duc, et al.
Published: (2024)

Robust Differential Evolution via Nonlinear Population Size Reduction and Adaptive Restart: The ARRDE Algorithm
by: Muzakka, Khoirul Faiq, et al.
Published: (2025)

From Complexity to Clarity: Analytical Expressions of Deep Neural Network Weights via Clifford's Geometric Algebra and Convexity
by: Pilanci, Mert
Published: (2023)

Global Optimization of Atomic Clusters via Physically-Constrained Tensor Train Decomposition
by: Sozykin, Konstantin, et al.
Published: (2026)

An Improved Dung Beetle Optimizer for Random Forest Optimization
by: Tan, Lianghao, et al.
Published: (2024)

Orthogonally Initiated Particle Swarm Optimization with Advanced Mutation for Real-Parameter Optimization
by: Bala, Indu, et al.
Published: (2024)

Feature-based Evolutionary Diversity Optimization of Discriminating Instances for Chance-constrained Optimization Problems
by: Ahouei, Saba Sadeghi, et al.
Published: (2025)

Underdamped Particle Swarm Optimization
by: Rodríguez, Matías Ezequiel Hernández
Published: (2025)

Modified FOX Optimizer for Solving optimization problems
by: Hasan, Dler O., et al.
Published: (2025)