Copertina

Iterative Pre-Conditioning for Expediting the Gradient-Descent Method: The Distributed Linear Least-Squares Problem

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Chakrabarti, Kushal, Gupta, Nirupam, Chopra, Nikhil
Natura:	Preprint
Pubblicazione:	2020
Soggetti:	Optimization and Control Machine Learning Systems and Control
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Robustness of Iteratively Pre-Conditioned Gradient-Descent Method: The Case of Distributed Linear Regression Problem
di: Chakrabarti, Kushal, et al.
Pubblicazione: (2021)

On Convergence of the Iteratively Preconditioned Gradient-Descent (IPG) Observer
di: Chakrabarti, Kushal, et al.
Pubblicazione: (2024)

A Control Theoretic Framework for Adaptive Gradient Optimizers in Machine Learning
di: Chakrabarti, Kushal, et al.
Pubblicazione: (2022)

On Linear Convergence of PI Consensus Algorithm under the Restricted Secant Inequality
di: Chakrabarti, Kushal, et al.
Pubblicazione: (2023)

Distributed Optimization via Energy Conservation Laws in Dilated Coordinates
di: Baranwal, Mayank, et al.
Pubblicazione: (2024)

A Methodology Establishing Linear Convergence of Adaptive Gradient Methods under PL Inequality
di: Chakrabarti, Kushal, et al.
Pubblicazione: (2024)

Convergence Rates for Gradient Descent on the Edge of Stability in Overparametrised Least Squares
di: MacDonald, Lachlan Ewen, et al.
Pubblicazione: (2025)

Anytime Acceleration of Gradient Descent
di: Zhang, Zihan, et al.
Pubblicazione: (2024)

Online Nonstochastic Prediction: Logarithmic Regret via Predictive Online Least Squares
di: Pai, Chih-Fan, et al.
Pubblicazione: (2026)

On Model Protection in Federated Learning against Eavesdropping Attacks
di: Maity, Dipankar, et al.
Pubblicazione: (2025)

Last-Iterate Convergent Policy Gradient Primal-Dual Methods for Constrained MDPs
di: Ding, Dongsheng, et al.
Pubblicazione: (2023)

On the Gradient Domination of the LQG Problem
di: Fallah, Kasra, et al.
Pubblicazione: (2025)

Outlier-robust Autocovariance Least Square Estimation via Iteratively Reweighted Least Square
di: Li, Jiahong, et al.
Pubblicazione: (2026)

Pessimistic Nonlinear Least-Squares Value Iteration for Offline Reinforcement Learning
di: Di, Qiwei, et al.
Pubblicazione: (2023)

Global Convergence of Iteratively Reweighted Least Squares for Robust Subspace Recovery
di: Lerman, Gilad, et al.
Pubblicazione: (2025)

Distributed Least-Squares Optimization Solvers with Differential Privacy
di: Liu, Weijia, et al.
Pubblicazione: (2024)

Adaptive Conditional Gradient Descent
di: Khademi, Abbas, et al.
Pubblicazione: (2025)

Interpolation Conditions for Data Consistency and Prediction in Noisy Linear Systems
di: Vanelli, Martina, et al.
Pubblicazione: (2025)

Decentralized Riemannian Conjugate Gradient Method on the Stiefel Manifold
di: Chen, Jun, et al.
Pubblicazione: (2023)

Learning Decentralized Linear Quadratic Regulators with $\sqrt{T}$ Regret
di: Ye, Lintao, et al.
Pubblicazione: (2022)

Model-Free Learning for the Linear Quadratic Regulator over Rate-Limited Channels
di: Ye, Lintao, et al.
Pubblicazione: (2024)

A Concise Lyapunov Analysis of Nesterov's Accelerated Gradient Method
di: Liu, Jun
Pubblicazione: (2025)

Gradient Descent's Last Iterate is Often (slightly) Suboptimal
di: Kornowski, Guy, et al.
Pubblicazione: (2026)

Model-Free Output Feedback Stabilization via Policy Gradient Methods
di: Zhang, Ankang, et al.
Pubblicazione: (2026)

Learning of Linear Dynamical Systems as a Non-Commutative Polynomial Optimization Problem
di: Zhou, Quan, et al.
Pubblicazione: (2020)

Incremental Gradient Descent with Small Epoch Counts is Surprisingly Slow on Ill-Conditioned Problems
di: Kim, Yujun, et al.
Pubblicazione: (2025)

ORFit: One-Pass Learning via Bridging Orthogonal Gradient Descent and Recursive Least-Squares
di: Min, Youngjae, et al.
Pubblicazione: (2022)

Fitted Q-Iteration via Max-Plus-Linear Approximation
di: Liu, Y., et al.
Pubblicazione: (2024)

Near-Optimal Distributed Linear-Quadratic Regulator for Networked Systems
di: Shin, Sungho, et al.
Pubblicazione: (2022)

Gradient Descent Converges Linearly to Flatter Minima than Gradient Flow in Shallow Linear Networks
di: Beneventano, Pierfrancesco, et al.
Pubblicazione: (2025)

From Optimization to Control: Quasi Policy Iteration
di: Kolarijani, Mohammad Amin Sharifi, et al.
Pubblicazione: (2023)

A Local Polyak-Lojasiewicz and Descent Lemma of Gradient Descent For Overparametrized Linear Models
di: Xu, Ziqing, et al.
Pubblicazione: (2025)

On the Inherent Privacy of Zeroth Order Projected Gradient Descent
di: Gupta, Devansh, et al.
Pubblicazione: (2025)

On Penalty-based Bilevel Gradient Descent Method
di: Shen, Han, et al.
Pubblicazione: (2023)

On Gradient Descent Ascent for Nonconvex-Concave Minimax Problems
di: Lin, Tianyi, et al.
Pubblicazione: (2019)

Open Problem: Anytime Convergence Rate of Gradient Descent
di: Kornowski, Guy, et al.
Pubblicazione: (2024)

The Global Empirical NTK: Self-Referential Bias and Dimensionality of Gradient Descent Learning
di: Hazelden, James, et al.
Pubblicazione: (2026)

Scaling Laws for Gradient Descent and Sign Descent for Linear Bigram Models under Zipf's Law
di: Kunstner, Frederik, et al.
Pubblicazione: (2025)

Asynchronous Distributed Reinforcement Learning for LQR Control via Zeroth-Order Block Coordinate Descent
di: Jing, Gangshan, et al.
Pubblicazione: (2021)

Convergence and Implicit Bias of Gradient Descent on Continual Linear Classification
di: Jung, Hyunji, et al.
Pubblicazione: (2025)