Image de couverture de livre

Flattened one-bit stochastic gradient descent: compressed distributed optimization with controlled variance

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Stollenwerk, Alexander, Jacques, Laurent
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning Numerical Analysis Optimization and Control
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Learning rate adaptive stochastic gradient descent optimization methods: numerical simulations for deep learning methods for partial differential equations and convergence analyses
par: Dereich, Steffen, et autres
Publié: (2024)

Convergence of two-timescale gradient descent ascent dynamics: finite-dimensional and mean-field perspectives
par: An, Jing, et autres
Publié: (2025)

Langevin dynamics based algorithm e-TH$\varepsilon$O POULA for stochastic optimization problems with discontinuous stochastic gradient
par: Lim, Dong-Young, et autres
Publié: (2022)

Averaged Adam accelerates stochastic optimization in the training of deep neural network approximations for partial differential equation and optimal control problems
par: Dereich, Steffen, et autres
Publié: (2025)

On the convergence of stochastic variance reduced gradient for linear inverse problems
par: Jin, Bangti, et autres
Publié: (2025)

Non-asymptotic convergence analysis of the stochastic gradient Hamiltonian Monte Carlo algorithm with discontinuous stochastic gradient with applications to training of ReLU neural networks
par: Liang, Luxu, et autres
Publié: (2024)

First-order methods for stochastic and finite-sum convex optimization with deterministic constraints
par: Lu, Zhaosong, et autres
Publié: (2025)

PADAM: Parallel averaged Adam reduces the error for stochastic optimization in scientific machine learning
par: Jentzen, Arnulf, et autres
Publié: (2025)

A distributed semismooth Newton based augmented Lagrangian method for distributed optimization
par: Ma, Qihao, et autres
Publié: (2026)

Real-time optimal control of high-dimensional parametrized systems by deep learning-based reduced order models
par: Tomasetto, Matteo, et autres
Publié: (2024)

Natural Riemannian gradient for learning functional tensor networks
par: Klug, Nikolas, et autres
Publié: (2026)

Neural incomplete factorization: learning preconditioners for the conjugate gradient method
par: Häusner, Paul, et autres
Publié: (2023)

Latent feedback control of distributed systems in multiple scenarios through deep learning-based reduced order models
par: Tomasetto, Matteo, et autres
Publié: (2024)

Cubic regularized subspace Newton for non-convex optimization
par: Zhao, Jim, et autres
Publié: (2024)

A perturbed preconditioned gradient descent method for the unconstrained minimization of composite objectives
par: Park, Jea-Hyun, et autres
Publié: (2025)

A single-loop SPIDER-type stochastic subgradient method for expectation-constrained nonconvex nonsmooth optimization
par: Liu, Wei, et autres
Publié: (2025)

Continuum-marginal optimal transport: a mesh-free kernel method
par: Nakano, Yumiharu
Publié: (2026)

Stochastic variance reduced gradient method for linear ill-posed inverse problems
par: Jin, Qinian, et autres
Publié: (2024)

Error analysis for stochastic gradient optimization schemes using modified equations
par: Bréhier, Charles-Edouard, et autres
Publié: (2024)

Gradient Descent as a Perceptron Algorithm: Understanding Dynamics and Implicit Acceleration
par: Tyurin, Alexander
Publié: (2025)

Gauss-Southwell type descent methods for low-rank matrix optimization
par: Olikier, Guillaume, et autres
Publié: (2023)

Modelling sand ripples in mine countermeasure simulations by means of stochastic optimal control
par: Blondeel, Philippe, et autres
Publié: (2024)

Learning epidemic trajectories through Kernel Operator Learning: from modelling to optimal control
par: Ziarelli, Giovanni, et autres
Publié: (2024)

Stochastic dual coordinate descent with adaptive heavy ball momentum for linearly constrained convex optimization
par: Zeng, Yun, et autres
Publié: (2023)

Using Linearized Optimal Transport to Predict the Evolution of Stochastic Particle Systems
par: Karris, Nicholas, et autres
Publié: (2024)

Limited memory gradient methods for unconstrained optimization
par: Ferrandi, Giulia, et autres
Publié: (2023)

A Primal-dual hybrid gradient method for solving optimal control problems and the corresponding Hamilton-Jacobi PDEs
par: Meng, Tingwei, et autres
Publié: (2024)

Martingale deep learning for very high dimensional quasi-linear partial differential equations and stochastic optimal controls
par: Cai, Wei, et autres
Publié: (2024)

Numerical solution of elliptic distributed optimal control problems with boundary value tracking
par: Langer, Ulrich, et autres
Publié: (2025)

Learning Regularization Functionals for Inverse Problems: A Comparative Study
par: Hertrich, Johannes, et autres
Publié: (2025)

Stochastic gradient with least-squares control variates
par: Nobile, Fabio, et autres
Publié: (2025)

An accelerated gradient method with adaptive restart for convex multiobjective optimization problems
par: Luo, Hao, et autres
Publié: (2025)

Creating walls to avoid unwanted points in root finding and optimization
par: Truong, Tuyen Trung
Publié: (2023)

Convergence analysis for an implementable scheme to solve the linear-quadratic stochastic optimal control problem with stochastic wave equation
par: Chaudhary, Abhishek
Publié: (2025)

On the numerical reliability of nonsmooth autodiff: a MaxPool case study
par: Boustany, Ryan
Publié: (2024)

A Gauss-Newton Approach for Min-Max Optimization in Generative Adversarial Networks
par: Mishra, Neel, et autres
Publié: (2024)

Subhomogeneous Deep Equilibrium Models
par: Sittoni, Pietro, et autres
Publié: (2024)

Efficient Trajectory Inference in Wasserstein Space Using Consecutive Averaging
par: Banerjee, Amartya, et autres
Publié: (2024)

Anderson Acceleration in Nonsmooth Problems: Local Convergence via Active Manifold Identification
par: Li, Kexin, et autres
Publié: (2024)

KANtrol: A Physics-Informed Kolmogorov-Arnold Network Framework for Solving Multi-Dimensional and Fractional Optimal Control Problems
par: Aghaei, Alireza Afzal
Publié: (2024)