Cover Image

Automatic Differentiation of Optimization Algorithms with Time-Varying Updates

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Mehmood, Sheheryar, Ochs, Peter
Format:	Preprint
Published:	2024
Subjects:	Optimization and Control Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Fixed-Point Automatic Differentiation of Forward--Backward Splitting Algorithms for Partly Smooth Functions
by: Mehmood, Sheheryar, et al.
Published: (2022)

Understanding the Curse of Unrolling
by: Mehmood, Sheheryar, et al.
Published: (2026)

From Learning to Optimize to Learning Optimization Algorithms
by: Castera, Camille, et al.
Published: (2024)

A Generalization Result for Convergence in Learning-to-Optimize
by: Sucker, Michael, et al.
Published: (2024)

Learning-to-Optimize with PAC-Bayesian Guarantees: Theoretical Considerations and Practical Implementation
by: Sucker, Michael, et al.
Published: (2024)

Lower Bounds and Optimal Algorithms for Non-Smooth Convex Decentralized Optimization over Time-Varying Networks
by: Kovalev, Dmitry, et al.
Published: (2024)

Near-optimal Closed-loop Method via Lyapunov Damping for Convex Optimization
by: Maier, Severin, et al.
Published: (2023)

No-Regret Gaussian Process Optimization of Time-Varying Functions
by: Mauduit, Eliabelle, et al.
Published: (2025)

Projection-Free Online Convex Optimization with Time-Varying Constraints
by: Garber, Dan, et al.
Published: (2024)

Time-Varying Convex Optimization with $O(n)$ Computational Complexity
by: Rostami, M., et al.
Published: (2024)

Safe Time-Varying Optimization based on Gaussian Processes with Spatio-Temporal Kernel
by: Li, Jialin, et al.
Published: (2024)

Accelerating Optimization via Differentiable Stopping Time
by: Xie, Zhonglin, et al.
Published: (2025)

tvopt: A Python Framework for Time-Varying Optimization
by: Bastianello, Nicola
Published: (2020)

Adaptive Delayed-Update Cyclic Algorithm for Variational Inequalities
by: Wei, Yi, et al.
Published: (2026)

Convergence of Distributed Adaptive Optimization with Local Updates
by: Cheng, Ziheng, et al.
Published: (2024)

Fundamental Benefit of Alternating Updates in Minimax Optimization
by: Lee, Jaewook, et al.
Published: (2024)

On PI Controllers for Updating Lagrange Multipliers in Constrained Optimization
by: Sohrabi, Motahareh, et al.
Published: (2024)

A Minimal-Assumption Analysis of Q-Learning with Time-Varying Policies
by: Nanda, Phalguni, et al.
Published: (2025)

TiAda: A Time-scale Adaptive Algorithm for Nonconvex Minimax Optimization
by: Li, Xiang, et al.
Published: (2022)

Hamiltonian Descent Algorithms for Optimization: Accelerated Rates via Randomized Integration Time
by: Fu, Qiang, et al.
Published: (2025)

Convergence Analysis of the PAGE Stochastic Algorithm for Weakly Convex Finite-Sum Optimization
by: Condat, Laurent, et al.
Published: (2025)

Enhancing GNNs Performance on Combinatorial Optimization by Recurrent Feature Update
by: Pugacheva, Daria, et al.
Published: (2024)

Decentralized Federated Learning with Gradient Tracking over Time-Varying Directed Networks
by: Nguyen, Duong Thuy Anh, et al.
Published: (2024)

DIGing--SGLD: Decentralized and Scalable Langevin Sampling over Time--Varying Networks
by: Bajwa, Waheed U., et al.
Published: (2025)

Drop-Muon: Update Less, Converge Faster
by: Gruntkowska, Kaja, et al.
Published: (2025)

First-Order Sparse Convex Optimization: Better Rates with Sparse Updates
by: Garber, Dan
Published: (2025)

Beyond the Ideal: Analyzing the Inexact Muon Update
by: Shulgin, Egor, et al.
Published: (2025)

Differentially Private Optimization with Sparse Gradients
by: Ghazi, Badih, et al.
Published: (2024)

Understanding Adam Optimizer via Online Learning of Updates: Adam is FTRL in Disguise
by: Ahn, Kwangjun, et al.
Published: (2024)

Time-Varying Optimization for Streaming Data Via Temporal Weighting
by: Abrar, Muhammad Faraz Ul, et al.
Published: (2025)

Differentially Private Bilevel Optimization: Efficient Algorithms with Near-Optimal Rates
by: Lowy, Andrew, et al.
Published: (2025)

A General and Streamlined Differentiable Optimization Framework
by: Rosemberg, Andrew W., et al.
Published: (2025)

Shuffling Momentum Gradient Algorithm for Convex Optimization
by: Tran, Trang H., et al.
Published: (2024)

Smoothing Methods for Automatic Differentiation Across Conditional Branches
by: Kreikemeyer, Justin N., et al.
Published: (2023)

Differentiable Convex Optimization Layers in Neural Architectures: Foundations and Perspectives
by: Katyal, Calder
Published: (2024)

Learning to Solve Optimization Problems Constrained with Partial Differential Equations
by: Guven, Yusuf, et al.
Published: (2025)

Risk-Averse Learning with Varying Risk Levels
by: Wang, Siyi, et al.
Published: (2025)

humancompatible.train: Implementing Optimization Algorithms for Stochastically-Constrained Stochastic Optimization Problems
by: Kliachkin, Andrii, et al.
Published: (2025)

Learning Algorithm Hyperparameters for Fast Parametric Convex Optimization
by: Sambharya, Rajiv, et al.
Published: (2024)

Absolute Ranking: An Essential Normalization for Benchmarking Optimization Algorithms
by: Jinng, Yunpeng, et al.
Published: (2024)