Tight Convergence Rate Bounds for Optimization Under Power Law Spectral Conditions
Fuente:
arXiv
Saved in:
| Main Authors: | Velikanov, Maksim, Yarotsky, Dmitry |
|---|---|
| Format: | Preprint |
| Published: |
2022
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Tight Stability, Convergence, and Robustness Bounds for Predictive Coding Networks
by: Mali, Ankur, et al.
Published: (2024)
by: Mali, Ankur, et al.
Published: (2024)
SGD with memory: fundamental properties and stochastic acceleration
by: Yarotsky, Dmitry, et al.
Published: (2024)
by: Yarotsky, Dmitry, et al.
Published: (2024)
Limiting Network Size within Finite Bounds for Optimization
by: Pinto, Linu, et al.
Published: (2019)
by: Pinto, Linu, et al.
Published: (2019)
Lean and Mean Adaptive Optimization via Subset-Norm and Subspace-Momentum with Convergence Guarantees
by: Nguyen, Thien Hang, et al.
Published: (2024)
by: Nguyen, Thien Hang, et al.
Published: (2024)
A Globally Convergent Algorithm for Neural Network Parameter Optimization Based on Difference-of-Convex Functions
by: Tschernutter, Daniel, et al.
Published: (2024)
by: Tschernutter, Daniel, et al.
Published: (2024)
Gradient Descent, Stochastic Optimization, and Other Tales
by: Lu, Jun
Published: (2022)
by: Lu, Jun
Published: (2022)
Machine Learning-Enhanced Ant Colony Optimization for Column Generation
by: Xu, Hongjie, et al.
Published: (2024)
by: Xu, Hongjie, et al.
Published: (2024)
A Composite Decomposition Method for Large-Scale Global Optimization
by: Tian, Maojiang, et al.
Published: (2024)
by: Tian, Maojiang, et al.
Published: (2024)
Empirical Evaluation of No Free Lunch Violations in Permutation-Based Optimization
by: Sroka, Grzegorz
Published: (2026)
by: Sroka, Grzegorz
Published: (2026)
Optimization of Discrete Parameters Using the Adaptive Gradient Method and Directed Evolution
by: Beinarovich, Andrei, et al.
Published: (2024)
by: Beinarovich, Andrei, et al.
Published: (2024)
Neural Combinatorial Optimization with Heavy Decoder: Toward Large Scale Generalization
by: Luo, Fu, et al.
Published: (2023)
by: Luo, Fu, et al.
Published: (2023)
QUIVER: Cost-Aware Adaptive Preference Querying in Surrogate-Assisted Evolutionary Multi-Objective Optimization
by: Burnat, Florian A. D.
Published: (2026)
by: Burnat, Florian A. D.
Published: (2026)
Optimization-Embedded Active Multi-Fidelity Surrogate Learning for Multi-Condition Airfoil Shape Optimization
by: Robledo, Isaac, et al.
Published: (2026)
by: Robledo, Isaac, et al.
Published: (2026)
An Adaptive KKT-Based Indicator for Convergence Assessment in Multi-Objective Optimization
by: Santos, Thiago, et al.
Published: (2026)
by: Santos, Thiago, et al.
Published: (2026)
Enhanced Innovized Repair Operator for Evolutionary Multi- and Many-objective Optimization
by: Mittal, Sukrit, et al.
Published: (2020)
by: Mittal, Sukrit, et al.
Published: (2020)
Evolutionary Retrofitting
by: Videau, Mathurin, et al.
Published: (2024)
by: Videau, Mathurin, et al.
Published: (2024)
Understand the Effectiveness of Shortcuts through the Lens of DCA
by: Sun, Youran, et al.
Published: (2024)
by: Sun, Youran, et al.
Published: (2024)
The late-stage training dynamics of (stochastic) subgradient descent on homogeneous neural networks
by: Schechtman, Sholom, et al.
Published: (2025)
by: Schechtman, Sholom, et al.
Published: (2025)
Availability of Perfect Decomposition in Statistical Linkage Learning for Unitation-based Function Concatenations
by: Prusik, Michal, et al.
Published: (2025)
by: Prusik, Michal, et al.
Published: (2025)
Computationally Efficient Optimisation of Elbow-Type Draft Tube Using Neural Network Surrogates
by: Sikirica, Ante, et al.
Published: (2024)
by: Sikirica, Ante, et al.
Published: (2024)
Towards Resilient and Sustainable Global Industrial Systems: An Evolutionary-Based Approach
by: Jirkovský, Václav, et al.
Published: (2025)
by: Jirkovský, Václav, et al.
Published: (2025)
EXPObench: Benchmarking Surrogate-based Optimisation Algorithms on Expensive Black-box Functions
by: Bliek, Laurens, et al.
Published: (2021)
by: Bliek, Laurens, et al.
Published: (2021)
Scaling of hardware-compatible perturbative training algorithms
by: Oripov, Bakhrom G., et al.
Published: (2025)
by: Oripov, Bakhrom G., et al.
Published: (2025)
Quality-Diversity Optimization as Multi-Objective Optimization
by: Lin, Xi, et al.
Published: (2026)
by: Lin, Xi, et al.
Published: (2026)
Karush-Kuhn-Tucker Condition-Trained Neural Networks (KKT Nets)
by: Arvind, Shreya, et al.
Published: (2024)
by: Arvind, Shreya, et al.
Published: (2024)
A Superlinearly Convergent Evolution Strategy
by: Glasmachers, Tobias
Published: (2025)
by: Glasmachers, Tobias
Published: (2025)
Smooth Tchebycheff Scalarization for Multi-Objective Optimization
by: Lin, Xi, et al.
Published: (2024)
by: Lin, Xi, et al.
Published: (2024)
Few for Many: Tchebycheff Set Scalarization for Many-Objective Optimization
by: Lin, Xi, et al.
Published: (2024)
by: Lin, Xi, et al.
Published: (2024)
GBO:AMulti-Granularity Optimization Algorithm via Granular-ball for Continuous Problems
by: Xia, Shuyin, et al.
Published: (2023)
by: Xia, Shuyin, et al.
Published: (2023)
CMA-ES with Learning Rate Adaptation
by: Nomura, Masahiro, et al.
Published: (2024)
by: Nomura, Masahiro, et al.
Published: (2024)
Training Non-Differentiable Networks via Optimal Transport
by: Le, An T.
Published: (2026)
by: Le, An T.
Published: (2026)
Gridless Evolutionary Approach for Line Spectral Estimation with Unknown Model Order
by: Yan, Bai, et al.
Published: (2021)
by: Yan, Bai, et al.
Published: (2021)
An Improved Dung Beetle Optimizer for Random Forest Optimization
by: Tan, Lianghao, et al.
Published: (2024)
by: Tan, Lianghao, et al.
Published: (2024)
Orthogonally Initiated Particle Swarm Optimization with Advanced Mutation for Real-Parameter Optimization
by: Bala, Indu, et al.
Published: (2024)
by: Bala, Indu, et al.
Published: (2024)
Feature-based Evolutionary Diversity Optimization of Discriminating Instances for Chance-constrained Optimization Problems
by: Ahouei, Saba Sadeghi, et al.
Published: (2025)
by: Ahouei, Saba Sadeghi, et al.
Published: (2025)
Underdamped Particle Swarm Optimization
by: Rodríguez, Matías Ezequiel Hernández
Published: (2025)
by: Rodríguez, Matías Ezequiel Hernández
Published: (2025)
Modified FOX Optimizer for Solving optimization problems
by: Hasan, Dler O., et al.
Published: (2025)
by: Hasan, Dler O., et al.
Published: (2025)
MicroHD: An Accuracy-Driven Optimization of Hyperdimensional Computing Algorithms for TinyML systems
by: Ponzina, Flavio, et al.
Published: (2024)
by: Ponzina, Flavio, et al.
Published: (2024)
PSO and the Traveling Salesman Problem: An Intelligent Optimization Approach
by: Araújo, Kael Silva, et al.
Published: (2025)
by: Araújo, Kael Silva, et al.
Published: (2025)
Explicitly Multi-Modal Benchmarks for Multi-Objective Optimization
by: Ota, Ryosuke, et al.
Published: (2021)
by: Ota, Ryosuke, et al.
Published: (2021)
Similar Items
-
Tight Stability, Convergence, and Robustness Bounds for Predictive Coding Networks
by: Mali, Ankur, et al.
Published: (2024) -
SGD with memory: fundamental properties and stochastic acceleration
by: Yarotsky, Dmitry, et al.
Published: (2024) -
Limiting Network Size within Finite Bounds for Optimization
by: Pinto, Linu, et al.
Published: (2019) -
Lean and Mean Adaptive Optimization via Subset-Norm and Subspace-Momentum with Convergence Guarantees
by: Nguyen, Thien Hang, et al.
Published: (2024) -
A Globally Convergent Algorithm for Neural Network Parameter Optimization Based on Difference-of-Convex Functions
by: Tschernutter, Daniel, et al.
Published: (2024)