Imagen de Portada

Stochastic Subspace Descent Accelerated via Bi-fidelity Line Search

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Cheng, Nuojin, Doostan, Alireza, Becker, Stephen
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning Optimization and Control
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Variational Entropy Search for Adjusting Expected Improvement
por: Cheng, Nuojin, et al.
Publicado: (2024)

A Unified Framework for Entropy Search and Expected Improvement in Bayesian Optimization
por: Cheng, Nuojin, et al.
Publicado: (2025)

Bi-fidelity Variational Auto-encoder for Uncertainty Quantification
por: Cheng, Nuojin, et al.
Publicado: (2023)

Faster Convergence of Stochastic Accelerated Gradient Descent under Interpolation
por: Mishkin, Aaron, et al.
Publicado: (2024)

Relationship between Batch Size and Number of Steps Needed for Nonconvex Optimization of Stochastic Gradient Descent using Armijo Line Search
por: Tsukada, Yuki, et al.
Publicado: (2023)

Armijo Line-search Can Make (Stochastic) Gradient Descent Provably Faster
por: Vaswani, Sharan, et al.
Publicado: (2025)

Towards Noise-adaptive, Problem-adaptive (Accelerated) Stochastic Gradient Descent
por: Vaswani, Sharan, et al.
Publicado: (2021)

Stochastic Gradient Langevin Dynamics with Variance Reduction
por: Huang, Zhishen, et al.
Publicado: (2021)

Increasing Both Batch Size and Learning Rate Accelerates Stochastic Gradient Descent
por: Umeda, Hikaru, et al.
Publicado: (2024)

Stochastic Adaptive Gradient Descent Without Descent
por: Aujol, Jean-François, et al.
Publicado: (2025)

Langevin Bi-fidelity Importance Sampling for Failure Probability Estimation
por: Cheng, Nuojin, et al.
Publicado: (2025)

Faster Acceleration for Steepest Descent
por: Bai, Cedar Site, et al.
Publicado: (2024)

Anytime Acceleration of Gradient Descent
por: Zhang, Zihan, et al.
Publicado: (2024)

Stochastic Gradient Descent with Strategic Querying
por: Jiang, Nanfei, et al.
Publicado: (2025)

Stochastic Gradient Descent with Adaptive Data
por: Che, Ethan, et al.
Publicado: (2024)

Momentum Does Not Reduce Stochastic Noise in Stochastic Gradient Descent
por: Sato, Naoki, et al.
Publicado: (2024)

Adaptive SGD with Line-Search and Polyak Stepsizes: Nonconvex Convergence and Accelerated Rates
por: Wu, Haotian
Publicado: (2025)

Stochastic Zeroth order Descent with Structured Directions
por: Rando, Marco, et al.
Publicado: (2022)

Derivatives of Stochastic Gradient Descent in parametric optimization
por: Iutzeler, Franck, et al.
Publicado: (2024)

Hamiltonian Descent Algorithms for Optimization: Accelerated Rates via Randomized Integration Time
por: Fu, Qiang, et al.
Publicado: (2025)

Rapid Overfitting of Multi-Pass Stochastic Gradient Descent in Stochastic Convex Optimization
por: Vansover-Hager, Shira, et al.
Publicado: (2025)

Convergence Analysis of Stochastic Gradient Descent with MCMC Estimators
por: Li, Tianyou, et al.
Publicado: (2023)

The Sample Complexity of Gradient Descent in Stochastic Convex Optimization
por: Livni, Roi
Publicado: (2024)

Adaptive Step Sizes for Preconditioned Stochastic Gradient Descent
por: Köhne, Frederik, et al.
Publicado: (2023)

Implicit Bias and Convergence of Matrix Stochastic Mirror Descent
por: Akhtiamov, Danil, et al.
Publicado: (2026)

Functional Central Limit Theorem for Stochastic Gradient Descent
por: Flamand, Kessang, et al.
Publicado: (2026)

Parameter Symmetry and Noise Equilibrium of Stochastic Gradient Descent
por: Ziyin, Liu, et al.
Publicado: (2024)

Information Preserving Line Search via Bayesian Optimization
por: Labryga, Robin, et al.
Publicado: (2025)

Exponential Convergence of (Stochastic) Gradient Descent for Separable Logistic Regression
por: Kale, Sacchit, et al.
Publicado: (2026)

On the Convergence of Stochastic Gradient Descent with Perturbed Forward-Backward Passes
por: Kong, Boao, et al.
Publicado: (2026)

Quantitative Convergence Analysis of Projected Stochastic Gradient Descent for Non-Convex Losses via the Goldstein Subdifferential
por: Zheng, Yuping, et al.
Publicado: (2025)

Adaptive Backtracking Line Search
por: Cavalcanti, Joao V., et al.
Publicado: (2024)

Faster Convergence of Riemannian Stochastic Gradient Descent with Increasing Batch Size
por: Oowada, Kanata, et al.
Publicado: (2025)

Coupling-based Convergence Diagnostic and Stepsize Scheme for Stochastic Gradient Descent
por: Li, Xiang, et al.
Publicado: (2024)

Decentralized Stochastic Gradient Descent Ascent for Finite-Sum Minimax Problems
por: Gao, Hongchang
Publicado: (2022)

Enhancing Stochastic Gradient Descent: A Unified Framework and Novel Acceleration Methods for Faster Convergence
por: Deng, Yichuan, et al.
Publicado: (2024)

First and Second Order Approximations to Stochastic Gradient Descent Methods with Momentum Terms
por: Lu, Eric
Publicado: (2025)

Zeroth-Order Stochastic Mirror Descent Algorithms for Minimax Excess Risk Optimization
por: Gu, Zhihao, et al.
Publicado: (2024)

GeoAdaLer: Geometric Insights into Adaptive Stochastic Gradient Descent Algorithms
por: Eleh, Chinedu, et al.
Publicado: (2024)

FastPart: Over-Parameterized Stochastic Gradient Descent for Sparse optimisation on Measures
por: De Castro, Yohann, et al.
Publicado: (2023)