Cover Image

Curvature-Informed SGD via General Purpose Lie-Group Preconditioners

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Pooladzandi, Omead, Li, Xi-Lin
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

PureEBM: Universal Poison Purification via Mid-Run Dynamics of Energy-Based Models
by: Pooladzandi, Omead, et al.
Published: (2024)

Implicit Bias and Convergence of Matrix Stochastic Mirror Descent
by: Akhtiamov, Danil, et al.
Published: (2026)

PureGen: Universal Data Purification for Train-Time Poison Defense via Generative Model Dynamics
by: Bhat, Sunay, et al.
Published: (2024)

Scaling Behavior of Discrete Diffusion Language Models
by: von Rütte, Dimitri, et al.
Published: (2025)

Stochastic Hessian Fittings with Lie Groups
by: Li, Xi-Lin
Published: (2024)

Designing Preconditioners for SGD: Local Conditioning, Noise Floors, and Basin Stability
by: Scott, Mitchell, et al.
Published: (2025)

SketchySGD: Reliable Stochastic Optimization via Randomized Curvature Estimates
by: Frangella, Zachary, et al.
Published: (2022)

On the Superlinear Relationship between SGD Noise Covariance and Loss Landscape Curvature
by: Zhang, Yikuan, et al.
Published: (2026)

Correlating Cross-Iteration Noise for DP-SGD using Model Curvature
by: Gu, Xin, et al.
Published: (2025)

Generalization and Optimization of SGD with Lookahead
by: Li, Kangcheng, et al.
Published: (2025)

Generative modeling of Sparse Approximate Inverse Preconditioners
by: Li, Mou, et al.
Published: (2024)

Stability and Generalization for Decentralized Markov SGD
by: Wang, Jiahuan, et al.
Published: (2026)

Improving Adaptive Moment Optimization via Preconditioner Diagonalization
by: Nguyen, Son, et al.
Published: (2025)

Diffusion Generative Modeling on Lie Group Representations
by: Bertolini, Marco, et al.
Published: (2025)

Learning Lie Group Generators from Trajectories
by: Hu, Lifan
Published: (2025)

Unveiling High-Probability Generalization in Decentralized SGD
by: Wang, Jiahuan, et al.
Published: (2026)

Adaptive Preconditioners Trigger Loss Spikes in Adam
by: Bai, Zhiwei, et al.
Published: (2025)

Topology-aware Generalization of Decentralized SGD
by: Zhu, Tongtian, et al.
Published: (2022)

Generalized Tensor-based Parameter-Efficient Fine-Tuning via Lie Group Transformations
by: Si, Chongjie, et al.
Published: (2025)

Structured Preconditioners in Adaptive Optimization: A Unified Analysis
by: Xie, Shuo, et al.
Published: (2025)

NeuraLSP: An Efficient and Rigorous Neural Left Singular Subspace Preconditioner for Conjugate Gradient Methods
by: Benanti, Alexander, et al.
Published: (2026)

PCDP-SGD: Improving the Convergence of Differentially Private SGD via Projection in Advance
by: Sha, Haichao, et al.
Published: (2023)

Tight Group-Level DP Guarantees for DP-SGD with Sampling via Mixture of Gaussians Mechanisms
by: Ganesh, Arun
Published: (2024)

Benchmarking General-Purpose In-Context Learning
by: Wang, Fan, et al.
Published: (2024)

On the Limitations of General Purpose Domain Generalisation Methods
by: Gouk, Henry, et al.
Published: (2022)

Improved Stability and Generalization Guarantees of the Decentralized SGD Algorithm
by: Bars, Batiste Le, et al.
Published: (2023)

Generalized Lie Symmetries in Physics-Informed Neural Operators
by: Wang, Amy Xiang, et al.
Published: (2025)

A New Perspective on Shampoo's Preconditioner
by: Morwani, Depen, et al.
Published: (2024)

Leveraging Flatness to Improve Information-Theoretic Generalization Bounds for SGD
by: Peng, Ze, et al.
Published: (2026)

Convex SGD: Generalization Without Early Stopping
by: Hendrickx, Julien, et al.
Published: (2024)

Trivialized Momentum Facilitates Diffusion Generative Modeling on Lie Groups
by: Zhu, Yuchen, et al.
Published: (2024)

Sign-SGD via Parameter-Free Optimization
by: Medyakov, Daniil, et al.
Published: (2025)

Flow Matching on Lie Groups
by: Sherry, Finn M., et al.
Published: (2025)

Lie Group Decompositions for Equivariant Neural Networks
by: Mironenco, Mircea, et al.
Published: (2023)

Diagonalisation SGD: Fast & Convergent SGD for Non-Differentiable Models via Reparameterisation and Smoothing
by: Wagner, Dominik, et al.
Published: (2024)

Learning Sparse Approximate Inverse Preconditioners for Conjugate Gradient Solvers on GPUs
by: Yang, Zherui, et al.
Published: (2025)

Adaptive debiased SGD in high-dimensional GLMs with streaming data
by: Han, Ruijian, et al.
Published: (2024)

Matrix-free Neural Preconditioner for the Dirac Operator in Lattice Gauge Theory
by: Sun, Yixuan, et al.
Published: (2025)

R-ODE: Ricci Curvature Tells When You Will be Informed
by: Sun, Li, et al.
Published: (2024)

From Privacy to Generalization: Linear Max-Information Bounds for DP-SGD
by: Lampert, Christoph H., et al.
Published: (2026)