Cover Image

Streaming Krylov-Accelerated Stochastic Gradient Descent

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Thomas, Stephen
Format:	Preprint
Published:	2025
Subjects:	Numerical Analysis Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Preconditioning for Accelerated Gradient Descent Optimization and Regularization
by: Ye, Qiang
Published: (2024)

Accelerating Natural Gradient Descent for PINNs with Randomized Numerical Linear Algebra
by: Bioli, Ivan, et al.
Published: (2025)

Gradient Descent as a Perceptron Algorithm: Understanding Dynamics and Implicit Acceleration
by: Tyurin, Alexander
Published: (2025)

NSPOD: Accelerating Krylov solvers via DeepONet-learned POD subspaces
by: Levrero-Florencio, Francesc, et al.
Published: (2026)

Gradient is All You Need? How Consensus-Based Optimization can be Interpreted as a Stochastic Relaxation of Gradient Descent
by: Riedl, Konstantin, et al.
Published: (2023)

On the Convergence of the Gradient Descent Method with Stochastic Fixed-point Rounding Errors under the Polyak-Lojasiewicz Inequality
by: Xia, Lu, et al.
Published: (2023)

Super Gradient Descent: Global Optimization requires Global Gradient
by: Achour, Seifeddine
Published: (2024)

Accelerating Data Generation for Neural Operators via Krylov Subspace Recycling
by: Wang, Hong, et al.
Published: (2024)

Why Does Stochastic Gradient Descent Slow Down in Low-Precision Training?
by: Yun, Vincent-Daniel
Published: (2025)

Provably Faster Gradient Descent via Long Steps
by: Grimmer, Benjamin
Published: (2023)

Dual Cone Gradient Descent for Training Physics-Informed Neural Networks
by: Hwang, Youngsik, et al.
Published: (2024)

Accelerating Legacy Numerical Solvers by Non-intrusive Gradient-based Meta-solving
by: Arisaka, Sohei, et al.
Published: (2024)

Convergence of Stochastic Gradient Methods for Wide Two-Layer Physics-Informed Neural Networks
by: Jin, Bangti, et al.
Published: (2025)

Modified Loss of Momentum Gradient Descent: Fine-Grained Analysis
by: Cattaneo, Matias D., et al.
Published: (2025)

Sparse Random-Feature Neural Networks with Krylov-Based SVD for Singularly Perturbed ODE
by: Vaidyan, Kevin Kurian Thomas, et al.
Published: (2026)

Accelerating Conjugate Gradient Solvers for Homogenization Problems with Unitary Neural Operators
by: Herb, Julius, et al.
Published: (2025)

Fast and Provable Tensor-Train Format Tensor Completion via Precondtioned Riemannian Gradient Descent
by: Bian, Fengmiao, et al.
Published: (2025)

Convergence Analysis of Fractional Gradient Descent
by: Aggarwal, Ashwani
Published: (2023)

Randomised Splitting Methods and Stochastic Gradient Descent
by: Shaw, Luke, et al.
Published: (2025)

Leveraging Gauge Freedom for Learning Non-Gradient Population Dynamics of Stochastic Systems
by: Berman, Jules, et al.
Published: (2026)

Adaptive Lipschitz-Free Conditional Gradient Methods for Stochastic Composite Nonconvex Optimization
by: Yuan, Ganzhao
Published: (2026)

Gradients of Functions of Large Matrices
by: Krämer, Nicholas, et al.
Published: (2024)

Gradient-free training of recurrent neural networks
by: Bolager, Erik Lien, et al.
Published: (2024)

Learning Stochastic Dynamical Systems with Structured Noise
by: Guo, Ziheng, et al.
Published: (2025)

Stochastic diagonal estimation with adaptive parameter selection
by: Han, Zongyuan, et al.
Published: (2024)

Stochastic Rounding Increases Small Singular Values
by: Ma, Linkai, et al.
Published: (2026)

A Single-Loop Gradient Descent and Perturbed Ascent Algorithm for Nonconvex Functional Constrained Optimization
by: Lu, Songtao
Published: (2022)

Preconditioned Additive Gaussian Processes with Fourier Acceleration
by: Wagner, Theresa, et al.
Published: (2025)

Stochastic Gradient Descent for Nonlinear Inverse Problems in Banach Spaces
by: Jin, Bangti, et al.
Published: (2026)

An Accelerated Newton-GMRES Method for Multilinear PageRank
by: Boubekraoui, Maryam, et al.
Published: (2025)

Accelerating Fractional PINNs using Operational Matrices of Derivative
by: Taheri, Tayebeh, et al.
Published: (2024)

Learning Sparse Approximate Inverse Preconditioners for Conjugate Gradient Solvers on GPUs
by: Yang, Zherui, et al.
Published: (2025)

Neural Network Approach to Stochastic Dynamics for Smooth Multimodal Density Estimation
by: Zarezadeh, Z., et al.
Published: (2025)

Training with Fewer Bits: Unlocking Edge LLMs Training with Stochastic Rounding
by: Liu, Taowen, et al.
Published: (2025)

Number Theoretic Accelerated Learning of Physics-Informed Neural Networks
by: Matsubara, Takashi, et al.
Published: (2023)

Matrix-Free Least Squares Solvers: Values, Gradients, and What to Do With Them
by: Roy, Hrittik, et al.
Published: (2025)

Learn to Evolve: Self-supervised Neural JKO Operator for Wasserstein Gradient Flow
by: Feng, Xue, et al.
Published: (2026)

Ensemble learning for Physics Informed Neural Networks: a Gradient Boosting approach
by: Fang, Zhiwei, et al.
Published: (2023)

Gradient Flows for Sampling: Mean-Field Models, Gaussian Approximations and Affine Invariance
by: Chen, Yifan, et al.
Published: (2023)

Gradient-free neural topology optimization: Towards effective fracture-resistant designs
by: Kus, Gawel, et al.
Published: (2024)