Cover Image

Improved high-dimensional estimation with Langevin dynamics and stochastic weight averaging

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wei, Stanley, Damian, Alex, Lee, Jason D.
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Generalized EXTRA stochastic gradient Langevin dynamics
by: Gurbuzbalaban, Mert, et al.
Published: (2024)

The Generative Leap: Sharp Sample Complexity for Efficiently Learning Gaussian Multi-Index Models
by: Damian, Alex, et al.
Published: (2025)

Provable Guarantees for Nonlinear Feature Learning in Three-Layer Neural Networks
by: Nichani, Eshaan, et al.
Published: (2023)

How Transformers Learn Causal Structure with Gradient Descent
by: Nichani, Eshaan, et al.
Published: (2024)

Computational-Statistical Gaps in Gaussian Single-Index Models
by: Damian, Alex, et al.
Published: (2024)

Rate doubly robust estimation for weighted average treatment effects
by: Wang, Yiming, et al.
Published: (2025)

Flow-based Bayesian filtering for high-dimensional nonlinear stochastic dynamical systems
by: Wang, Xintong, et al.
Published: (2025)

Propagation of Chaos for Mean-Field Langevin Dynamics and its Application to Model Ensemble
by: Nitanda, Atsushi, et al.
Published: (2025)

A hierarchical entropy method for the delocalization of bias in high-dimensional Langevin Monte Carlo
by: Lacker, Daniel, et al.
Published: (2025)

Transformers Provably Learn Sparse Token Selection While Fully-Connected Nets Cannot
by: Wang, Zixuan, et al.
Published: (2024)

Langevin dynamics based algorithm e-TH$\varepsilon$O POULA for stochastic optimization problems with discontinuous stochastic gradient
by: Lim, Dong-Young, et al.
Published: (2022)

Non-asymptotic estimates for accelerated high order Langevin Monte Carlo algorithms
by: Neufeld, Ariel, et al.
Published: (2024)

Improving sample efficiency of high dimensional Bayesian optimization with MCMC
by: Yi, Zeji, et al.
Published: (2024)

Langevin dynamics for high-dimensional optimization: the case of multi-spiked tensor PCA
by: Arous, Gérard Ben, et al.
Published: (2024)

Concentration of the Langevin Algorithm's Stationary Distribution
by: Altschuler, Jason M., et al.
Published: (2022)

A weighted-likelihood framework for class imbalance in Bayesian prediction models
by: Lazic, Stanley E.
Published: (2025)

Spectral alignment of stochastic gradient descent for high-dimensional classification tasks
by: Arous, Gerard Ben, et al.
Published: (2023)

Error estimates between SGD with momentum and underdamped Langevin diffusion
by: Guillin, Arnaud, et al.
Published: (2024)

Improving the stability of the covariance-controlled adaptive Langevin thermostat for large-scale Bayesian sampling
by: Wei, Jiani, et al.
Published: (2025)

Diffusion annealed Langevin dynamics: a theoretical study
by: Cattiaux, Patrick, et al.
Published: (2025)

Learning Compositional Functions with Transformers from Easy-to-Hard Data
by: Wang, Zixuan, et al.
Published: (2025)

Variable feature weighted fuzzy k-means algorithm for high dimensional data
by: Singh, Vikas, et al.
Published: (2019)

Multi-models with averaging in feature domain for non-invasive blood glucose estimation
by: Wei, Yiting, et al.
Published: (2025)

Delayformer: spatiotemporal transformation for predicting high-dimensional dynamics
by: Wang, Zijian, et al.
Published: (2025)

Universality of high-dimensional scaling limits of stochastic gradient descent
by: Gheissari, Reza, et al.
Published: (2025)

Theoretical guidelines for annealed Langevin dynamics in compositional simulation-based inference
by: Touron, Camille, et al.
Published: (2026)

Improved Guarantees for Langevin Monte Carlo with Average Smoothness
by: Dalalyan, Arnak S., et al.
Published: (2026)

Online estimation of the inverse of the Hessian for stochastic optimization with application to universal stochastic Newton algorithms
by: Godichon-Baggioni, Antoine, et al.
Published: (2024)

The future of cosmological likelihood-based inference: accelerated high-dimensional parameter estimation and model comparison
by: Piras, Davide, et al.
Published: (2024)

Low-dimensional embeddings of high-dimensional data
by: de Bodt, Cyril, et al.
Published: (2025)

Support estimation in high-dimensional heteroscedastic mean regression
by: Hermann, Philipp, et al.
Published: (2020)

Sparse deep neural networks for nonparametric estimation in high-dimensional sparse regression
by: Wu, Dongya, et al.
Published: (2024)

Acceleration of stochastic gradient descent with momentum by averaging: finite-sample rates and asymptotic normality
by: Tang, Kejie, et al.
Published: (2023)

Understanding Optimization in Deep Learning with Central Flows
by: Cohen, Jeremy M., et al.
Published: (2024)

High-dimensional Asymptotics of Langevin Dynamics in Spiked Matrix Models
by: Liang, Tengyuan, et al.
Published: (2022)

Sampling and estimation on manifolds using the Langevin diffusion
by: Bharath, Karthik, et al.
Published: (2023)

Fine-Tuning Language Models with Just Forward Passes
by: Malladi, Sadhika, et al.
Published: (2023)

Bayesian model-averaging stochastic item selection for adaptive testing
by: Su, Tina, et al.
Published: (2025)

Neural network learns low-dimensional polynomials with SGD near the information-theoretic limit
by: Lee, Jason D., et al.
Published: (2024)

Instance-optimal stochastic convex optimization: Can we improve upon sample-average and robust stochastic approximation?
by: Jiang, Liwei, et al.
Published: (2026)