Cover Image

Adaptive Stepsizing for Stochastic Gradient Langevin Dynamics in Bayesian Neural Networks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Rajpal, Rajit, Leimkuhler, Benedict, Jiang, Yuanhao
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Adaptive Momentum and Nonlinear Damping for Neural Network Training
by: Karoni, Aikaterini, et al.
Published: (2026)

Sampling from Bayesian Neural Network Posteriors with Symmetric Minibatch Splitting Langevin Dynamics
by: Paulin, Daniel, et al.
Published: (2024)

Posterior Approximation using Stochastic Gradient Ascent with Adaptive Stepsize
by: Lim, Kart-Leong, et al.
Published: (2024)

Unbiased Kinetic Langevin Monte Carlo with Inexact Gradients
by: Chada, Neil K., et al.
Published: (2023)

An Adaptive Stochastic Gradient Method with Non-negative Gauss-Newton Stepsizes
by: Orvieto, Antonio, et al.
Published: (2024)

A Langevin sampling algorithm inspired by the Adam optimizer
by: Leimkuhler, Benedict, et al.
Published: (2025)

Decentralized Proximal Stochastic Gradient Langevin Dynamics
by: Islam, Mohammad Rafiqul, et al.
Published: (2026)

Stochastic Gradient Langevin Dynamics with Variance Reduction
by: Huang, Zhishen, et al.
Published: (2021)

Flatness-Aware Stochastic Gradient Langevin Dynamics
by: Bruno, Stefano, et al.
Published: (2025)

Functional Stochastic Gradient MCMC for Bayesian Neural Networks
by: Wu, Mengjing, et al.
Published: (2024)

Stochastic Approximation with Block Coordinate Optimal Stepsizes
by: Jiang, Tao, et al.
Published: (2025)

Coupling-based Convergence Diagnostic and Stepsize Scheme for Stochastic Gradient Descent
by: Li, Xiang, et al.
Published: (2024)

How deep is your network? Deep vs. shallow learning of transfer operators
by: Tabish, Mohammad, et al.
Published: (2025)

Convergence of Stochastic Gradient Langevin Dynamics in the Lazy Training Regime
by: Oberweis, Noah, et al.
Published: (2025)

Scalable Stochastic Gradient Riemannian Langevin Dynamics in Non-Diagonal Metrics
by: Yu, Hanlin, et al.
Published: (2023)

Minimax Optimal Convergence of Gradient Descent in Logistic Regression via Large and Adaptive Stepsizes
by: Zhang, Ruiqi, et al.
Published: (2025)

Microcanonical Langevin Ensembles: Advancing the Sampling of Bayesian Neural Networks
by: Sommer, Emanuel, et al.
Published: (2025)

Constrained Exploration via Reflected Replica Exchange Stochastic Gradient Langevin Dynamics
by: Zheng, Haoyang, et al.
Published: (2024)

Random Reshuffling for Stochastic Gradient Langevin Dynamics
by: Shaw, Luke, et al.
Published: (2025)

An Information-Theoretic Framework for Out-of-Distribution Generalization with Applications to Stochastic Gradient Langevin Dynamics
by: Liu, Wenliang, et al.
Published: (2024)

Large Stepsizes Accelerate Gradient Descent for Regularized Logistic Regression
by: Wu, Jingfeng, et al.
Published: (2025)

$γ$-FedHT: Stepsize-Aware Hard-Threshold Gradient Compression in Federated Learning
by: Lu, Rongwei, et al.
Published: (2025)

Adaptive stepsize algorithms for Langevin dynamics
by: Leroy, Alix, et al.
Published: (2024)

Structured Partial Stochasticity in Bayesian Neural Networks
by: Rochussen, Tommy
Published: (2024)

Contraction and Convergence Rates for Discretized Kinetic Langevin Dynamics
by: Leimkuhler, Benedict, et al.
Published: (2023)

Subsampling Error in Stochastic Gradient Langevin Diffusions
by: Jin, Kexin, et al.
Published: (2023)

On Suppressing Range of Adaptive Stepsizes of Adam to Improve Generalisation Performance
by: Zhang, Guoqiang
Published: (2023)

Bias and Extrapolation in Markovian Linear Stochastic Approximation with Constant Stepsizes
by: Huo, Dongyan, et al.
Published: (2022)

Stochastic Gradient Descent for Two-layer Neural Networks
by: Cao, Dinghao, et al.
Published: (2024)

Variational Stochastic Gradient Descent for Deep Neural Networks
by: Chen, Haotian, et al.
Published: (2024)

Tight Bounds for Logistic Regression with Large Stepsize Gradient Descent in Low Dimension
by: Crawshaw, Michael, et al.
Published: (2026)

The Collusion of Memory and Nonlinearity in Stochastic Approximation With Constant Stepsize
by: Huo, Dongyan, et al.
Published: (2024)

Almost Bayesian: The Fractal Dynamics of Stochastic Gradient Descent
by: Hennick, Max, et al.
Published: (2025)

Negative Stepsizes Make Gradient-Descent-Ascent Converge
by: Shugart, Henry, et al.
Published: (2025)

Adaptive Meta-Learning Stochastic Gradient Hamiltonian Monte Carlo Simulation for Bayesian Updating of Structural Dynamic Models
by: Meng, Xianghao, et al.
Published: (2026)

Towards Scalable Bayesian Optimization via Gradient-Informed Bayesian Neural Networks
by: Makrygiorgos, Georgios, et al.
Published: (2025)

Inferring the Langevin Equation with Uncertainty via Bayesian Neural Networks
by: Bae, Youngkyoung, et al.
Published: (2024)

Can Microcanonical Langevin Dynamics Leverage Mini-Batch Gradient Noise?
by: Sommer, Emanuel, et al.
Published: (2026)

Generalization Bounds of Stochastic Gradient Descent in Homogeneous Neural Networks
by: Ma, Wenquan, et al.
Published: (2026)

Large Stepsize Gradient Descent for Non-Homogeneous Two-Layer Networks: Margin Improvement and Fast Optimization
by: Cai, Yuhang, et al.
Published: (2024)