Copertina

Complexities of Armijo-like algorithms in Deep Learning context

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autore principale:	Bilel, Bensaid
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Optimization and Control
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Convergence of the Iterates for Momentum and RMSProp for Local Smooth Functions: Adaptation is the Key
di: Bensaid, Bilel, et al.
Pubblicazione: (2024)

An Abstract Lyapunov Control Optimizer: Local Stabilization and Global Convergence
di: Bensaid, Bilel, et al.
Pubblicazione: (2024)

Approximate Bregman proximal gradient algorithm with variable metric Armijo--Wolfe line search
di: Fujiki, Kiwamu, et al.
Pubblicazione: (2025)

Block-coordinate Plug-And-Play Methods with Armijo-like line-search for Image Restoration
di: Porta, Federica, et al.
Pubblicazione: (2026)

Deep learning algorithms for FBSDEs with jumps: Applications to option pricing and a MFG model for smart grids
di: Alasseur, Clémence, et al.
Pubblicazione: (2024)

Non-asymptotic Global Convergence Analysis of BFGS with the Armijo-Wolfe Line Search
di: Jin, Qiujiang, et al.
Pubblicazione: (2024)

Modified Armijo line search in optimization on Riemannian submanifolds with reduced computational cost
di: Sato, Hiroyuki, et al.
Pubblicazione: (2023)

Armijo Line-search Can Make (Stochastic) Gradient Descent Provably Faster
di: Vaswani, Sharan, et al.
Pubblicazione: (2025)

Law-invariant BSDEs and dynamic risk measures: new characterizations
di: Bensaid, Zakaria, et al.
Pubblicazione: (2026)

Relationship between Batch Size and Number of Steps Needed for Nonconvex Optimization of Stochastic Gradient Descent using Armijo Line Search
di: Tsukada, Yuki, et al.
Pubblicazione: (2023)

Constrained TLBO algorithm for lightweight cable-stiffened scissor-like deployable structures
di: Manna, Soumyajit, et al.
Pubblicazione: (2024)

Convergence result for the gradient-push algorithm and its application to boost up the Push-DIging algorithm
di: Choi, Hyogi, et al.
Pubblicazione: (2024)

Latent-Space Mean-Field Theory for Deep BitNet-like Training: Constrained Gradient Flows with Smooth Quantization and STE Limits
di: Kim, Dongwon, et al.
Pubblicazione: (2025)

On analysis of open optimization algorithms
di: Eising, Jaap, et al.
Pubblicazione: (2024)

On the sequential convergence of Lloyd's algorithms
di: Portales, Léo, et al.
Pubblicazione: (2024)

Contractive difference-of-convex algorithms
di: He, Songnian, et al.
Pubblicazione: (2025)

Real time filtering algorithms
di: Qin, Chang, et al.
Pubblicazione: (2026)

Deep Learning for Data-Driven Districting-and-Routing
di: Ferraz, Arthur, et al.
Pubblicazione: (2024)

A power consensus algorithm for DC microgrids
di: De Persis, Claudio, et al.
Pubblicazione: (2016)

Adaptive control mechanisms in gradient descent algorithms
di: Iannelli, Andrea
Pubblicazione: (2025)

An iterative algorithm for the square-root Lasso
di: Boccacci, Patrizia, et al.
Pubblicazione: (2025)

Primal-Dual Damping algorithms for optimization
di: Zuo, X., et al.
Pubblicazione: (2023)

Convergence of projected stochastic approximation algorithm
di: Borowski, Michał, et al.
Pubblicazione: (2025)

Gradient sampling algorithm for subsmooth functions
di: Boskos, Dimitris, et al.
Pubblicazione: (2025)

Learning Polynomial Activation Functions for Deep Neural Networks
di: Zhang, Linghao, et al.
Pubblicazione: (2025)

Automated algorithm design via Nevanlinna-Pick interpolation
di: Ozaslan, Ibrahim K., et al.
Pubblicazione: (2025)

An optimistic planning algorithm for switched discrete-time LQR
di: Granzotto, Mathieu, et al.
Pubblicazione: (2025)

Delay-tolerant distributed Bregman proximal algorithms
di: Chraibi, S., et al.
Pubblicazione: (2024)

Improved convergence rates for the Difference-of-Convex algorithm
di: Rotaru, Teodor, et al.
Pubblicazione: (2024)

Approximation algorithms for integer programming with resource augmentation
di: Brinkop, Hauke, et al.
Pubblicazione: (2025)

Lazifying point insertion algorithms in spaces of measures
di: Hnatiuk, Arsen, et al.
Pubblicazione: (2025)

On the convergence rate of the Douglas-Rachford splitting algorithm
di: Abbaszadehpeivasti, Hadi, et al.
Pubblicazione: (2025)

Frank-Wolfe algorithm for star-convex functions
di: Millan, R. Diaz, et al.
Pubblicazione: (2025)

Data-Driven Distributed Optimization via Aggregative Tracking and Deep-Learning
di: Brumali, Riccardo, et al.
Pubblicazione: (2025)

Learning to optimize with guarantees: a complete characterization of linearly convergent algorithms
di: Martin, Andrea, et al.
Pubblicazione: (2025)

A Deep Reinforcement Learning Approach to Efficient Distributed Optimization
di: Zhu, Daokuan, et al.
Pubblicazione: (2023)

Universe-inspired algorithms for Control Engineering: A review
di: Bernardo, Rodrigo M. C., et al.
Pubblicazione: (2024)

Proximity-based approximation algorithms for integer bilevel programs
di: Sankaranarayanan, Sriram, et al.
Pubblicazione: (2024)

Wasserstein crossover for evolutionary algorithm-based topology optimization
di: Kii, Taisei, et al.
Pubblicazione: (2025)

An inexact inertial projective splitting algorithm with strong convergence
di: Alves, M. Marques, et al.
Pubblicazione: (2025)