Cover Image

Deep Learning for Markov Chains: Lyapunov Functions, Poisson's Equation, and Stationary Distributions

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Qu, Yanlin, Blanchet, Jose, Glynn, Peter
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Probability
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Deep Learning for Computing Convergence Rates of Markov Chains
by: Qu, Yanlin, et al.
Published: (2024)

Computable Bounds on Convergence of Markov Chains in Wasserstein Distance via Contractive Drift
by: Qu, Yanlin, et al.
Published: (2023)

Approximation of Markov Chain Expectations and the Key Role of Stationary Distribution Convergence
by: Glynn, Peter W., et al.
Published: (2025)

A Regeneration-based a Posteriori Error Bound for a Markov Chain Stationary Distribution Truncation Algorithm
by: Glynn, Peter W., et al.
Published: (2025)

Computable Bounds on the Solution to Poisson's Equation for General Harris Chains
by: Glynn, Peter W., et al.
Published: (2025)

Optimal Sample Complexity for Average Reward Markov Decision Processes
by: Wang, Shengbo, et al.
Published: (2023)

Limit Theorems for Stochastic Gradient Descent with Infinite Variance
by: Blanchet, Jose, et al.
Published: (2024)

Concentration of the Langevin Algorithm's Stationary Distribution
by: Altschuler, Jason M., et al.
Published: (2022)

Some aspects of robustness in modern Markov Chain Monte Carlo
by: Power, Sam, et al.
Published: (2025)

Wasserstein-p Central Limit Theorem Rates: From Local Dependence to Markov Chains
by: Zhang, Yixuan, et al.
Published: (2026)

Accelerating Multilevel Markov Chain Monte Carlo Using Machine Learning Models
by: Reddy, Sohail, et al.
Published: (2024)

Near-Optimal Clustering in Mixture of Markov Chains
by: Lee, Junghyun, et al.
Published: (2025)

Neural Continuous-Time Markov Chain: Discrete Diffusion via Decoupled Jump Timing and Direction
by: Li, Jingyuan, et al.
Published: (2026)

An Analysis of Elo Rating Systems via Markov Chains
by: Olesker-Taylor, Sam, et al.
Published: (2024)

Self-Repellent Random Walks on General Graphs -- Achieving Minimal Sampling Variance via Nonlinear Markov Chains
by: Doshi, Vishwaraj, et al.
Published: (2023)

Markov Chain Variance Estimation: A Stochastic Approximation Approach
by: Agrawal, Shubhada, et al.
Published: (2024)

Duality and Policy Evaluation in Distributionally Robust Bayesian Diffusion Control
by: Blanchet, Jose, et al.
Published: (2025)

Linear Algebraic Truncation Algorithm with A Posteriori Error Bounds for Computing Markov Chain Equilibrium Gradients
by: Mahdian, Saied, et al.
Published: (2025)

Approximation to Deep Q-Network by Stochastic Delay Differential Equations
by: Lu, Jianya, et al.
Published: (2025)

Fooling Algorithms in Non-Stationary Bandits using Belief Inertia
by: Mendelson, Gal, et al.
Published: (2025)

A Numerical Truncation Approximation with A Posteriori Error Bounds for the Solution of Poisson's Equation
by: Mahdian, Saied, et al.
Published: (2024)

Non-Asymptotic Convergence of Stochastic Iterative Algorithms: A Lyapunov Framework
by: Chen, Zaiwei, et al.
Published: (2026)

Rates of Convergence in the Central Limit Theorem for Markov Chains, with an Application to TD Learning
by: Srikant, R.
Published: (2024)

Optimal Initialization in Depth: Lyapunov Initialization and Limit Theorems for Deep Leaky ReLU Networks
by: Kogler, Constantin, et al.
Published: (2026)

Complexity of Markov Chain Monte Carlo for Generalized Linear Models
by: Chak, Martin, et al.
Published: (2025)

Homogenization of Multi-agent Learning Dynamics in Finite-state Markov Games
by: Kerzreho, Yann
Published: (2025)

A Unifying Perspective on Non-Stationary Kernels for Deeper Gaussian Processes
by: Noack, Marcus M., et al.
Published: (2023)

Differentiable Filtering for Learning Hidden Markov Models
by: Chen, Reginald Zhiyan, et al.
Published: (2025)

Deep Neural Networks as Iterated Function Systems and a Generalization Bound
by: Vacher, Jonathan
Published: (2026)

Optimization, Isoperimetric Inequalities, and Sampling via Lyapunov Potentials
by: Chen, August Y., et al.
Published: (2024)

Accurately Computing Expected Visiting Times and Stationary Distributions in Markov Chains
by: Mertens, Hannah, et al.
Published: (2024)

Flow Matching: Markov Kernels, Stochastic Processes and Transport Plans
by: Wald, Christian, et al.
Published: (2025)

The Law of Large Numbers and CLT for Non-stationary Markov Jump Processes Exhibiting Time-of-Day Effects
by: Fischer, Monte, et al.
Published: (2025)

Locally Stationary Distributions: A Framework for Analyzing Slow-Mixing Markov Chains
by: Liu, Kuikui, et al.
Published: (2024)

How Out-of-Distribution Detection Learning Theory Enhances Transformer: Learnability and Reliability
by: Zhou, Yijin, et al.
Published: (2024)

A Markovian Model for Learning-to-Optimize
by: Sucker, Michael, et al.
Published: (2024)

gp2Scale: A Class of Compactly-Supported Non-Stationary Kernels and Distributed Computing for Exact Gaussian Processes on 10 Million Data Points
by: Noack, Marcus M., et al.
Published: (2025)

Algebraic Reduction of Hidden Markov Models
by: Grigoletto, Tommaso, et al.
Published: (2022)

Tree-structured Markov random fields with Poisson marginal distributions
by: Côté, Benjamin, et al.
Published: (2024)

Stochastic Differential Equations models for Least-Squares Stochastic Gradient Descent
by: Schertzer, Adrien, et al.
Published: (2024)