Image de couverture de livre

Adaptive Backtracking Line Search

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Cavalcanti, Joao V., Lessard, Laurent, Wilson, Ashia C.
Format:	Preprint
Publié:	2024
Sujets:	Optimization and Control Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Adaptive Acceleration Without Strong Convexity Priors Or Restarts
par: Cavalcanti, Joao V., et autres
Publié: (2025)

Mean-field underdamped Langevin dynamics and its spacetime discretization
par: Fu, Qiang, et autres
Publié: (2023)

Adaptive SGD with Line-Search and Polyak Stepsizes: Nonconvex Convergence and Accelerated Rates
par: Wu, Haotian
Publié: (2025)

Sequential QCQP for Bilevel Optimization with Line Search
par: Sharifi, Sina, et autres
Publié: (2025)

Information Preserving Line Search via Bayesian Optimization
par: Labryga, Robin, et autres
Publié: (2025)

Efficient Line Search Method Based on Regression and Uncertainty Quantification
par: Laue, Sören, et autres
Publié: (2024)

Stochastic Subspace Descent Accelerated via Bi-fidelity Line Search
par: Cheng, Nuojin, et autres
Publié: (2025)

Why Line Search when you can Plane Search? SO-Friendly Neural Networks allow Per-Iteration Optimization of Learning and Momentum Rates for Every Layer
par: Shea, Betty, et autres
Publié: (2024)

Painless Federated Learning: An Interplay of Line-Search and Extrapolation
par: Geetika, et autres
Publié: (2024)

Relationship between Batch Size and Number of Steps Needed for Nonconvex Optimization of Stochastic Gradient Descent using Armijo Line Search
par: Tsukada, Yuki, et autres
Publié: (2023)

Explicit Agent-Level Optimal Cooperative Controllers for Dynamically Decoupled Systems with Output Feedback
par: Kashyap, Mruganka, et autres
Publié: (2019)

Optimal Control of Multi-Agent Systems with Processing Delays
par: Kashyap, Mruganka, et autres
Publié: (2022)

Algebraic characterization of equivalence between oracle-based iterative algorithms
par: Lessard, Laurent, et autres
Publié: (2025)

Stochastic Optimization with Random Search
par: Chayti, El Mahdi, et autres
Publié: (2025)

The High Line: Exact Risk and Learning Rate Curves of Stochastic Adaptive Learning Rate Algorithms
par: Collins-Woodfin, Elizabeth, et autres
Publié: (2024)

Armijo Line-search Can Make (Stochastic) Gradient Descent Provably Faster
par: Vaswani, Sharan, et autres
Publié: (2025)

Convergence Analysis of the PAGE Stochastic Algorithm for Weakly Convex Finite-Sum Optimization
par: Condat, Laurent, et autres
Publié: (2025)

An Adaptive and Stability-Promoting Layerwise Training Approach for Sparse Deep Neural Network Architecture
par: Krishnanunni, C G, et autres
Publié: (2022)

Glocal Smoothness: Line search and adaptive step sizes can help in theory too!
par: Fox, Curtis, et autres
Publié: (2025)

Variational Entropy Search for Adjusting Expected Improvement
par: Cheng, Nuojin, et autres
Publié: (2024)

AdAdaGrad: Adaptive Batch Size Schemes for Adaptive Gradient Methods
par: Lau, Tim Tsz-Kit, et autres
Publié: (2024)

AdaBatchGrad: Combining Adaptive Batch Size and Adaptive Step Size
par: Ostroukhov, Petr, et autres
Publié: (2024)

The Fastest Known First-Order Method for Minimizing Twice Continuously Differentiable Smooth Strongly Convex Functions
par: Van Scoy, Bryan, et autres
Publié: (2025)

Locally Adaptive Federated Learning
par: Mukherjee, Sohom, et autres
Publié: (2023)

Adaptive Conditional Gradient Descent
par: Khademi, Abbas, et autres
Publié: (2025)

On Adaptivity in Zeroth-Order Optimization
par: Dbouk, Hassan, et autres
Publié: (2026)

Overfitting in Adaptive Robust Optimization
par: Zhu, Karl, et autres
Publié: (2025)

In-depth Analysis of Low-rank Matrix Factorisation in a Federated Setting
par: Philippenko, Constantin, et autres
Publié: (2024)

BiCoLoR: Communication-Efficient Optimization with Bidirectional Compression and Local Training
par: Condat, Laurent, et autres
Publié: (2026)

Near-Linear Time Projection onto the $\ell_{1,\infty}$ Ball; Application to Sparse Autoencoders
par: Perez, Guillaume, et autres
Publié: (2023)

The Price of Adaptivity in Stochastic Convex Optimization
par: Carmon, Yair, et autres
Publié: (2024)

Stochastic Gradient Descent with Adaptive Data
par: Che, Ethan, et autres
Publié: (2024)

Faster Adaptive Decentralized Learning Algorithms
par: Huang, Feihu, et autres
Publié: (2024)

Decentralized Contextual Bandits with Network Adaptivity
par: Deng, Chuyun, et autres
Publié: (2025)

ASGO: Adaptive Structured Gradient Optimization
par: An, Kang, et autres
Publié: (2025)

Convergence for Discrete Parameter Update Schemes
par: Wilson, Paul, et autres
Publié: (2025)

A Multi-objective Newton Optimization Algorithm for Hyper-Parameter Search
par: Xu, Qinwu
Publié: (2024)

A Unified Framework for Entropy Search and Expected Improvement in Bayesian Optimization
par: Cheng, Nuojin, et autres
Publié: (2025)

Convergence of Distributed Adaptive Optimization with Local Updates
par: Cheng, Ziheng, et autres
Publié: (2024)

Catastrophe Insurance: An Adaptive Robust Optimization Approach
par: Bertsimas, Dimitris, et autres
Publié: (2024)