Hamiltonian Descent Algorithms for Optimization: Accelerated Rates via Randomized Integration Time
Fuente:
arXiv
Guardado en:
| Autores principales: | Fu, Qiang, Wibisono, Andre |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
Mixing Time of the Proximal Sampler in Relative Fisher Information via Strong Data Processing Inequality
por: Wibisono, Andre
Publicado: (2025)
por: Wibisono, Andre
Publicado: (2025)
Quantum Optimization via Gradient-Based Hamiltonian Descent
por: Leng, Jiaqi, et al.
Publicado: (2025)
por: Leng, Jiaqi, et al.
Publicado: (2025)
When Descent Is Too Stable: Event-Triggered Hamiltonian Learning to Optimize
por: Wang, Yi, et al.
Publicado: (2026)
por: Wang, Yi, et al.
Publicado: (2026)
Increasing Both Batch Size and Learning Rate Accelerates Stochastic Gradient Descent
por: Umeda, Hikaru, et al.
Publicado: (2024)
por: Umeda, Hikaru, et al.
Publicado: (2024)
Random Function Descent
por: Benning, Felix, et al.
Publicado: (2023)
por: Benning, Felix, et al.
Publicado: (2023)
Faster Acceleration for Steepest Descent
por: Bai, Cedar Site, et al.
Publicado: (2024)
por: Bai, Cedar Site, et al.
Publicado: (2024)
On the Convergence of Min-Max Langevin Dynamics and Algorithm
por: Cai, Yang, et al.
Publicado: (2024)
por: Cai, Yang, et al.
Publicado: (2024)
Anytime Acceleration of Gradient Descent
por: Zhang, Zihan, et al.
Publicado: (2024)
por: Zhang, Zihan, et al.
Publicado: (2024)
Accelerating Optimization via Differentiable Stopping Time
por: Xie, Zhonglin, et al.
Publicado: (2025)
por: Xie, Zhonglin, et al.
Publicado: (2025)
Towards Guided Descent: Optimization Algorithms for Training Neural Networks At Scale
por: Nagwekar, Ansh
Publicado: (2025)
por: Nagwekar, Ansh
Publicado: (2025)
Two-Timescale Gradient Descent Ascent Algorithms for Nonconvex Minimax Optimization
por: Lin, Tianyi, et al.
Publicado: (2024)
por: Lin, Tianyi, et al.
Publicado: (2024)
Stochastic Subspace Descent Accelerated via Bi-fidelity Line Search
por: Cheng, Nuojin, et al.
Publicado: (2025)
por: Cheng, Nuojin, et al.
Publicado: (2025)
Zeroth-Order Stochastic Mirror Descent Algorithms for Minimax Excess Risk Optimization
por: Gu, Zhihao, et al.
Publicado: (2024)
por: Gu, Zhihao, et al.
Publicado: (2024)
Open Problem: Anytime Convergence Rate of Gradient Descent
por: Kornowski, Guy, et al.
Publicado: (2024)
por: Kornowski, Guy, et al.
Publicado: (2024)
Gradient Descent as a Perceptron Algorithm: Understanding Dynamics and Implicit Acceleration
por: Tyurin, Alexander
Publicado: (2025)
por: Tyurin, Alexander
Publicado: (2025)
Accelerated Rates between Stochastic and Adversarial Online Convex Optimization
por: Sachs, Sarah, et al.
Publicado: (2023)
por: Sachs, Sarah, et al.
Publicado: (2023)
Extragradient Type Methods for Riemannian Variational Inequality Problems
por: Hu, Zihao, et al.
Publicado: (2023)
por: Hu, Zihao, et al.
Publicado: (2023)
Accelerating Distributed Stochastic Optimization via Self-Repellent Random Walks
por: Hu, Jie, et al.
Publicado: (2024)
por: Hu, Jie, et al.
Publicado: (2024)
An Energy-Based Self-Adaptive Learning Rate for Stochastic Gradient Descent: Enhancing Unconstrained Optimization with VAV method
por: Zhang, Jiahao, et al.
Publicado: (2024)
por: Zhang, Jiahao, et al.
Publicado: (2024)
Random Coordinate Descent on the Wasserstein Space of Probability Measures
por: Xu, Yewei, et al.
Publicado: (2026)
por: Xu, Yewei, et al.
Publicado: (2026)
Provable and Practical Online Learning Rate Adaptation with Hypergradient Descent
por: Chu, Ya-Chi, et al.
Publicado: (2025)
por: Chu, Ya-Chi, et al.
Publicado: (2025)
Understanding Outer Optimizers in Local SGD: Learning Rates, Momentum, and Acceleration
por: Khaled, Ahmed, et al.
Publicado: (2025)
por: Khaled, Ahmed, et al.
Publicado: (2025)
Faster Convergence of Stochastic Accelerated Gradient Descent under Interpolation
por: Mishkin, Aaron, et al.
Publicado: (2024)
por: Mishkin, Aaron, et al.
Publicado: (2024)
Dissipative Gradient Descent Ascent Method: A Control Theory Inspired Algorithm for Min-max Optimization
por: Zheng, Tianqi, et al.
Publicado: (2024)
por: Zheng, Tianqi, et al.
Publicado: (2024)
Adaptive Algorithms with Sharp Convergence Rates for Stochastic Hierarchical Optimization
por: Gong, Xiaochuan, et al.
Publicado: (2025)
por: Gong, Xiaochuan, et al.
Publicado: (2025)
An Accelerated Algorithm for Stochastic Bilevel Optimization under Unbounded Smoothness
por: Gong, Xiaochuan, et al.
Publicado: (2024)
por: Gong, Xiaochuan, et al.
Publicado: (2024)
Convergence Rates for Gradient Descent on the Edge of Stability in Overparametrised Least Squares
por: MacDonald, Lachlan Ewen, et al.
Publicado: (2025)
por: MacDonald, Lachlan Ewen, et al.
Publicado: (2025)
Towards Noise-adaptive, Problem-adaptive (Accelerated) Stochastic Gradient Descent
por: Vaswani, Sharan, et al.
Publicado: (2021)
por: Vaswani, Sharan, et al.
Publicado: (2021)
Enhancing Fractional Gradient Descent with Learned Optimizers
por: Sobotka, Jan, et al.
Publicado: (2025)
por: Sobotka, Jan, et al.
Publicado: (2025)
Convergence of Spectral Descent for Non-smooth Optimization
por: Yang, Yixuan, et al.
Publicado: (2026)
por: Yang, Yixuan, et al.
Publicado: (2026)
Natural Hypergradient Descent: Algorithm Design, Convergence Analysis, and Parallel Implementation
por: Kong, Deyi, et al.
Publicado: (2026)
por: Kong, Deyi, et al.
Publicado: (2026)
Mirror Descent-Type Algorithms for the Variational Inequality Problem with Functional Constraints
por: Alkousa, Mohammad S., et al.
Publicado: (2026)
por: Alkousa, Mohammad S., et al.
Publicado: (2026)
The Sample Complexity of Gradient Descent in Stochastic Convex Optimization
por: Livni, Roi
Publicado: (2024)
por: Livni, Roi
Publicado: (2024)
AutoGD: Automatic Learning Rate Selection for Gradient Descent
por: Surjanovic, Nikola, et al.
Publicado: (2025)
por: Surjanovic, Nikola, et al.
Publicado: (2025)
Mirror Descent Algorithms with Nearly Dimension-Independent Rates for Differentially-Private Stochastic Saddle-Point Problems
por: González, Tomás, et al.
Publicado: (2024)
por: González, Tomás, et al.
Publicado: (2024)
Automatic Differentiation of Optimization Algorithms with Time-Varying Updates
por: Mehmood, Sheheryar, et al.
Publicado: (2024)
por: Mehmood, Sheheryar, et al.
Publicado: (2024)
GeoAdaLer: Geometric Insights into Adaptive Stochastic Gradient Descent Algorithms
por: Eleh, Chinedu, et al.
Publicado: (2024)
por: Eleh, Chinedu, et al.
Publicado: (2024)
The Limit Points of (Optimistic) Gradient Descent in Min-Max Optimization
por: Daskalakis, Constantinos, et al.
Publicado: (2018)
por: Daskalakis, Constantinos, et al.
Publicado: (2018)
MADA: Meta-Adaptive Optimizers through hyper-gradient Descent
por: Ozkara, Kaan, et al.
Publicado: (2024)
por: Ozkara, Kaan, et al.
Publicado: (2024)
Accelerating Decentralized Optimization via Overlapping Local Steps
por: Zhou, Yijie, et al.
Publicado: (2026)
por: Zhou, Yijie, et al.
Publicado: (2026)
Ejemplares similares
-
Mixing Time of the Proximal Sampler in Relative Fisher Information via Strong Data Processing Inequality
por: Wibisono, Andre
Publicado: (2025) -
Quantum Optimization via Gradient-Based Hamiltonian Descent
por: Leng, Jiaqi, et al.
Publicado: (2025) -
When Descent Is Too Stable: Event-Triggered Hamiltonian Learning to Optimize
por: Wang, Yi, et al.
Publicado: (2026) -
Increasing Both Batch Size and Learning Rate Accelerates Stochastic Gradient Descent
por: Umeda, Hikaru, et al.
Publicado: (2024) -
Random Function Descent
por: Benning, Felix, et al.
Publicado: (2023)