Image de couverture de livre

Stochastic Subspace Descent Accelerated via Bi-fidelity Line Search

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Cheng, Nuojin, Doostan, Alireza, Becker, Stephen
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning Optimization and Control
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Variational Entropy Search for Adjusting Expected Improvement
par: Cheng, Nuojin, et autres
Publié: (2024)

A Unified Framework for Entropy Search and Expected Improvement in Bayesian Optimization
par: Cheng, Nuojin, et autres
Publié: (2025)

Bi-fidelity Variational Auto-encoder for Uncertainty Quantification
par: Cheng, Nuojin, et autres
Publié: (2023)

Faster Convergence of Stochastic Accelerated Gradient Descent under Interpolation
par: Mishkin, Aaron, et autres
Publié: (2024)

Relationship between Batch Size and Number of Steps Needed for Nonconvex Optimization of Stochastic Gradient Descent using Armijo Line Search
par: Tsukada, Yuki, et autres
Publié: (2023)

Armijo Line-search Can Make (Stochastic) Gradient Descent Provably Faster
par: Vaswani, Sharan, et autres
Publié: (2025)

Towards Noise-adaptive, Problem-adaptive (Accelerated) Stochastic Gradient Descent
par: Vaswani, Sharan, et autres
Publié: (2021)

Stochastic Gradient Langevin Dynamics with Variance Reduction
par: Huang, Zhishen, et autres
Publié: (2021)

Increasing Both Batch Size and Learning Rate Accelerates Stochastic Gradient Descent
par: Umeda, Hikaru, et autres
Publié: (2024)

Stochastic Adaptive Gradient Descent Without Descent
par: Aujol, Jean-François, et autres
Publié: (2025)

Langevin Bi-fidelity Importance Sampling for Failure Probability Estimation
par: Cheng, Nuojin, et autres
Publié: (2025)

Faster Acceleration for Steepest Descent
par: Bai, Cedar Site, et autres
Publié: (2024)

Anytime Acceleration of Gradient Descent
par: Zhang, Zihan, et autres
Publié: (2024)

Stochastic Gradient Descent with Strategic Querying
par: Jiang, Nanfei, et autres
Publié: (2025)

Stochastic Gradient Descent with Adaptive Data
par: Che, Ethan, et autres
Publié: (2024)

Momentum Does Not Reduce Stochastic Noise in Stochastic Gradient Descent
par: Sato, Naoki, et autres
Publié: (2024)

Adaptive SGD with Line-Search and Polyak Stepsizes: Nonconvex Convergence and Accelerated Rates
par: Wu, Haotian
Publié: (2025)

Stochastic Zeroth order Descent with Structured Directions
par: Rando, Marco, et autres
Publié: (2022)

Derivatives of Stochastic Gradient Descent in parametric optimization
par: Iutzeler, Franck, et autres
Publié: (2024)

Hamiltonian Descent Algorithms for Optimization: Accelerated Rates via Randomized Integration Time
par: Fu, Qiang, et autres
Publié: (2025)

Rapid Overfitting of Multi-Pass Stochastic Gradient Descent in Stochastic Convex Optimization
par: Vansover-Hager, Shira, et autres
Publié: (2025)

Convergence Analysis of Stochastic Gradient Descent with MCMC Estimators
par: Li, Tianyou, et autres
Publié: (2023)

The Sample Complexity of Gradient Descent in Stochastic Convex Optimization
par: Livni, Roi
Publié: (2024)

Adaptive Step Sizes for Preconditioned Stochastic Gradient Descent
par: Köhne, Frederik, et autres
Publié: (2023)

Implicit Bias and Convergence of Matrix Stochastic Mirror Descent
par: Akhtiamov, Danil, et autres
Publié: (2026)

Functional Central Limit Theorem for Stochastic Gradient Descent
par: Flamand, Kessang, et autres
Publié: (2026)

Parameter Symmetry and Noise Equilibrium of Stochastic Gradient Descent
par: Ziyin, Liu, et autres
Publié: (2024)

Information Preserving Line Search via Bayesian Optimization
par: Labryga, Robin, et autres
Publié: (2025)

Exponential Convergence of (Stochastic) Gradient Descent for Separable Logistic Regression
par: Kale, Sacchit, et autres
Publié: (2026)

On the Convergence of Stochastic Gradient Descent with Perturbed Forward-Backward Passes
par: Kong, Boao, et autres
Publié: (2026)

Quantitative Convergence Analysis of Projected Stochastic Gradient Descent for Non-Convex Losses via the Goldstein Subdifferential
par: Zheng, Yuping, et autres
Publié: (2025)

Adaptive Backtracking Line Search
par: Cavalcanti, Joao V., et autres
Publié: (2024)

Faster Convergence of Riemannian Stochastic Gradient Descent with Increasing Batch Size
par: Oowada, Kanata, et autres
Publié: (2025)

Coupling-based Convergence Diagnostic and Stepsize Scheme for Stochastic Gradient Descent
par: Li, Xiang, et autres
Publié: (2024)

Decentralized Stochastic Gradient Descent Ascent for Finite-Sum Minimax Problems
par: Gao, Hongchang
Publié: (2022)

Enhancing Stochastic Gradient Descent: A Unified Framework and Novel Acceleration Methods for Faster Convergence
par: Deng, Yichuan, et autres
Publié: (2024)

First and Second Order Approximations to Stochastic Gradient Descent Methods with Momentum Terms
par: Lu, Eric
Publié: (2025)

Zeroth-Order Stochastic Mirror Descent Algorithms for Minimax Excess Risk Optimization
par: Gu, Zhihao, et autres
Publié: (2024)

GeoAdaLer: Geometric Insights into Adaptive Stochastic Gradient Descent Algorithms
par: Eleh, Chinedu, et autres
Publié: (2024)

FastPart: Over-Parameterized Stochastic Gradient Descent for Sparse optimisation on Measures
par: De Castro, Yohann, et autres
Publié: (2023)