Cover Image

Layer-wise Quantization for Quantized Optimistic Dual Averaging

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Nguyen, Anh Duc, Markov, Ilia, Wu, Frank Zhengqing, Ramezani-Kebrya, Ali, Antonakopoulos, Kimon, Alistarh, Dan, Cevher, Volkan
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Optimization and Control
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Universal Gradient Methods for Stochastic Convex Optimization
by: Rodomanov, Anton, et al.
Published: (2024)

Advancing the lower bounds: An accelerated, stochastic, second-order method with optimal adaptation to inexactness
by: Agafonov, Artem, et al.
Published: (2023)

Constrained Stochastic Spectral Preconditioning Converges for Nonconvex Objectives
by: Oikonomidis, Konstantinos, et al.
Published: (2026)

Training Deep Learning Models with Norm-Constrained LMOs
by: Pethick, Thomas, et al.
Published: (2025)

On the Generalization of Stochastic Gradient Descent with Momentum
by: Ramezani-Kebrya, Ali, et al.
Published: (2018)

Approximate Solution Methods for the Average Reward Criterion in Optimal Tracking Control of Linear Systems
by: Nguyen, Duc Cuong
Published: (2025)

Stable Nonconvex-Nonconcave Training via Linear Interpolation
by: Pethick, Thomas, et al.
Published: (2023)

A Steepest Gradient Method with Nonmonotone Adaptive Step-sizes for the Nonconvex Minimax and Multi-Objective Optimization Problems
by: Anh, Nguyen Duc, et al.
Published: (2025)

Efficient Continual Finite-Sum Minimization
by: Mavrothalassitis, Ioannis, et al.
Published: (2024)

Quantizer Design for Finite Model Approximations, Model Learning, and Quantized Q-Learning for MDPs with Unbounded Spaces
by: Bicer, Osman, et al.
Published: (2025)

Nesterov Accelerated Distributed Optimization with Efficient Quantized Communication
by: Wu, Ruochen, et al.
Published: (2026)

Adversarial Training Should Be Cast as a Non-Zero-Sum Game
by: Robey, Alexander, et al.
Published: (2023)

Randomized algorithms and PAC bounds for inverse reinforcement learning in continuous spaces
by: Kamoutsi, Angeliki, et al.
Published: (2024)

Multi-Step Alignment as Markov Games: An Optimistic Online Gradient Descent Approach with Convergence Guarantees
by: Wu, Yongtao, et al.
Published: (2025)

Krylov Cubic Regularized Newton: A Subspace Second-Order Method with Dimension-Free Convergence Rate
by: Jiang, Ruichen, et al.
Published: (2024)

Improved Rates for Stochastic Variance-Reduced Difference-of-Convex Algorithms
by: Nguyen, Anh Duc, et al.
Published: (2025)

Optimistic Dual Averaging Unifies Modern Optimizers
by: Pethick, Thomas, et al.
Published: (2026)

Local Differential Privacy via Dynamic Quantization in Distributed Online Stochastic Optimization
by: Zhang, Zhiguo, et al.
Published: (2026)

Dual Optimistic Ascent (PI Control) is the Augmented Lagrangian Method in Disguise
by: Ramirez, Juan, et al.
Published: (2025)

Asynchronous Distributed Learning with Quantized Finite-Time Coordination
by: Bastianello, Nicola, et al.
Published: (2024)

Self-triggered Stabilization of Contracting Systems under Quantization
by: Wakaiki, Masashi
Published: (2023)

Quantization Of Probability Measures In Maximum~Mean~Discrepancy Distance
by: Mehraban, Zahra, et al.
Published: (2025)

On the Role of Batch Size in Stochastic Conditional Gradient Methods
by: Islamov, Rustem, et al.
Published: (2026)

A Novel Approach in Solving Stochastic Generalized Linear Regression via Nonconvex Programming
by: Anh, Vu Duc, et al.
Published: (2024)

Almost Sure Convergence of Stochastic Approximation: An Interplay of Noise and Step Size
by: Nguyen, Quang Dinh Thien, et al.
Published: (2026)

Discrete Homogeneity and Quantizer Design for Nonlinear Homogeneous Control Systems
by: Zhou, Yu, et al.
Published: (2026)

Decentralized Optimization via RC-ALADIN with Efficient Quantized Communication
by: Du, Xu, et al.
Published: (2025)

On Stability in Optimistic Bilevel Optimization
by: Royset, Johannes O.
Published: (2024)

Learning to Remove Cuts in Integer Linear Programming
by: Puigdemont, Pol, et al.
Published: (2024)

An Optimistic-Robust Approach for Dynamic Positioning of Omnichannel Inventories
by: Harsha, Pavithra, et al.
Published: (2023)

Adaptive and Optimal Second-order Optimistic Methods for Minimax Optimization
by: Jiang, Ruichen, et al.
Published: (2024)

MADA: Meta-Adaptive Optimizers through hyper-gradient Descent
by: Ozkara, Kaan, et al.
Published: (2024)

Robust Finite-time Stabilization of Linear Systems with Limited State Quantization
by: Zhou, Yu, et al.
Published: (2024)

LDAdam: Adaptive Optimization from Low-Dimensional Gradient Statistics
by: Robert, Thomas, et al.
Published: (2024)

Dual Averaging Converges for Nonconvex Smooth Stochastic Optimization
by: Liu, Tuo, et al.
Published: (2025)

A Novel Privacy Enhancement Scheme with Dynamic Quantization for Federated Learning
by: Wang, Yifan, et al.
Published: (2024)

Forward-Backward Quantization of Scenario Processes in Multi-Stage Stochastic Optimization
by: Timonina-Farkas, Anna
Published: (2025)

Omega: Optimistic EMA Gradients
by: Ramirez, Juan, et al.
Published: (2023)

PARQ: Piecewise-Affine Regularized Quantization
by: Jin, Lisa, et al.
Published: (2025)

VFOG: Variance-Reduced Fast Optimistic Gradient Methods for a Class of Nonmonotone Generalized Equations
by: Tran-Dinh, Quoc, et al.
Published: (2025)