Saved in:
Bibliographic Details
Main Authors: Bajwa, Waheed U., Gurbuzbalaban, Mert, Kutbay, Mustafa Ali, Zhu, Lingjiong, Zulqarnain, Muhammad
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2511.12836
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914160410886144
author Bajwa, Waheed U.
Gurbuzbalaban, Mert
Kutbay, Mustafa Ali
Zhu, Lingjiong
Zulqarnain, Muhammad
author_facet Bajwa, Waheed U.
Gurbuzbalaban, Mert
Kutbay, Mustafa Ali
Zhu, Lingjiong
Zulqarnain, Muhammad
contents Sampling from a target distribution induced by training data is central to Bayesian learning, with Stochastic Gradient Langevin Dynamics (SGLD) serving as a key tool for scalable posterior sampling and decentralized variants enabling learning when data are distributed across a network of agents. This paper introduces DIGing-SGLD, a decentralized SGLD algorithm designed for scalable Bayesian learning in multi-agent systems operating over time-varying networks. Existing decentralized SGLD methods are restricted to static network topologies, and many exhibit steady-state sampling bias caused by network effects, even when full batches are used. DIGing-SGLD overcomes these limitations by integrating Langevin-based sampling with the gradient-tracking mechanism of the DIGing algorithm, originally developed for decentralized optimization over time-varying networks, thereby enabling efficient and bias-free sampling without a central coordinator. To our knowledge, we provide the first finite-time non-asymptotic Wasserstein convergence guarantees for decentralized SGLD-based sampling over time-varying networks, with explicit constants. Under standard strong convexity and smoothness assumptions, DIGing-SGLD achieves geometric convergence to an $O(\sqrtη)$ neighborhood of the target distribution, where $η$ is the stepsize, with dependence on the target accuracy matching the best-known rates for centralized and static-network SGLD algorithms using constant stepsize. Numerical experiments on Bayesian linear and logistic regression validate the theoretical results and demonstrate the strong empirical performance of DIGing-SGLD under dynamically evolving network conditions.
format Preprint
id arxiv_https___arxiv_org_abs_2511_12836
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle DIGing--SGLD: Decentralized and Scalable Langevin Sampling over Time--Varying Networks
Bajwa, Waheed U.
Gurbuzbalaban, Mert
Kutbay, Mustafa Ali
Zhu, Lingjiong
Zulqarnain, Muhammad
Optimization and Control
Machine Learning
Sampling from a target distribution induced by training data is central to Bayesian learning, with Stochastic Gradient Langevin Dynamics (SGLD) serving as a key tool for scalable posterior sampling and decentralized variants enabling learning when data are distributed across a network of agents. This paper introduces DIGing-SGLD, a decentralized SGLD algorithm designed for scalable Bayesian learning in multi-agent systems operating over time-varying networks. Existing decentralized SGLD methods are restricted to static network topologies, and many exhibit steady-state sampling bias caused by network effects, even when full batches are used. DIGing-SGLD overcomes these limitations by integrating Langevin-based sampling with the gradient-tracking mechanism of the DIGing algorithm, originally developed for decentralized optimization over time-varying networks, thereby enabling efficient and bias-free sampling without a central coordinator. To our knowledge, we provide the first finite-time non-asymptotic Wasserstein convergence guarantees for decentralized SGLD-based sampling over time-varying networks, with explicit constants. Under standard strong convexity and smoothness assumptions, DIGing-SGLD achieves geometric convergence to an $O(\sqrtη)$ neighborhood of the target distribution, where $η$ is the stepsize, with dependence on the target accuracy matching the best-known rates for centralized and static-network SGLD algorithms using constant stepsize. Numerical experiments on Bayesian linear and logistic regression validate the theoretical results and demonstrate the strong empirical performance of DIGing-SGLD under dynamically evolving network conditions.
title DIGing--SGLD: Decentralized and Scalable Langevin Sampling over Time--Varying Networks
topic Optimization and Control
Machine Learning
url https://arxiv.org/abs/2511.12836