Cover Image

Langevin dynamics for the probability of finite state Markov processes

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Li, Wuchen
Format:	Preprint
Published:	2023
Subjects:	Probability Optimization and Control
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

On reachability of Markov decision processes: a novel state-classification-based PI approach
by: Li, Yanyun, et al.
Published: (2023)

Nonstationary nonzero-sum Markov games under a probability criterion
by: Guo, Xin, et al.
Published: (2025)

Zero-Sum Games for piecewise deterministic Markov decision processes with risk-sensitive finite-horizon cost criterion
by: Golui, Subrata
Published: (2024)

Further remarks on absorbing Markov decision processes
by: Zhang, Yi, et al.
Published: (2024)

Markov decision processes: on the convergence of the Monte-Carlo first visit algorithm
by: Delattre, Sylvain, et al.
Published: (2025)

Gradient-adjusted underdamped Langevin dynamics for sampling
by: Zuo, Xinzhe, et al.
Published: (2024)

Sharp propagation of chaos for mean field Langevin dynamics, control, and games
by: Arnese, Manuel, et al.
Published: (2026)

Error estimates for deterministic empirical approximations of probability measures
by: Seeger, Benjamin
Published: (2025)

Markov control of continuous time Markov processes with long run functionals by time discretization
by: Stettner, Lukasz
Published: (2025)

Flatness-Aware Stochastic Gradient Langevin Dynamics
by: Bruno, Stefano, et al.
Published: (2025)

Reoptimization Nearly Solves Weakly Coupled Markov Decision Processes
by: Gast, Nicolas, et al.
Published: (2022)

Markov-Nash equilibria in mean-field games under model uncertainty
by: Langner, Johannes, et al.
Published: (2024)

Bounding the Difference between the Values of Robust and Non-Robust Markov Decision Problems
by: Neufeld, Ariel, et al.
Published: (2023)

Optimal Risk-Sensitive Scheduling Policies for Remote Estimation of Autoregressive Markov Processes
by: Dutta, Manali, et al.
Published: (2024)

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments
by: Feinberg, Eugene A.
Published: (2025)

An Itô-type formula for some measure-valued processes and its application on controlled superprocesses
by: Li, Shang
Published: (2024)

Optimal control of McKean-Vlasov systems under partial observation and hidden Markov switching
by: Fuhrman, Marco, et al.
Published: (2026)

Linear Algebraic Truncation Algorithm with A Posteriori Error Bounds for Computing Markov Chain Equilibrium Gradients
by: Mahdian, Saied, et al.
Published: (2025)

Controllability concepts for mean-field dynamics with reduced-rank coefficients
by: Goreac, Dan, et al.
Published: (2025)

Optimal control problems with generalized mean-field dynamics and viscosity solution to Master Bellman equation
by: Buckdahn, Rainer, et al.
Published: (2024)

Markov Decision Process and Approximate Dynamic Programming for a Patient Assignment Scheduling problem
by: O'Reilly, Malgorzata M., et al.
Published: (2024)

An Online Multiobjective Policy Gradient for Long-run Average-reward Markov Decision Process
by: Misra, Rahul, et al.
Published: (2025)

Non-Exchangeable Mean Field Markov Decision Processes with common noise : from Bellman equation to quantitative propagation of chaos
by: Mekkaoui, Samy, et al.
Published: (2026)

A note on weak compactness of occupation measures for an absorbing Markov decision process
by: Dufour, François, et al.
Published: (2024)

Controlled stochastic processes for simulated annealing
by: Molin, Vincent, et al.
Published: (2025)

A variational approach to sampling in diffusion processes
by: Raginsky, Maxim
Published: (2024)

Polygonal Unadjusted Langevin Algorithms: Creating stable and efficient adaptive algorithms for neural networks
by: Lim, Dong-Young, et al.
Published: (2021)

The Performance Of The Unadjusted Langevin Algorithm Without Smoothness Assumptions
by: Johnston, Tim, et al.
Published: (2025)

Stochastic optimal control of Lévy tax processes with bailouts
by: Ghanim, Dalal Al, et al.
Published: (2024)

A mean field Jacobi process for modeling sustainable tourism
by: Yoshioka, Hidekazu
Published: (2024)

A Musielak-Orlicz approach for modeling uncertainties in long-memory processes
by: Yoshioka, Hidekazu
Published: (2026)

Convergence Error Analysis of Reflected Gradient Langevin Dynamics for Globally Optimizing Non-Convex Constrained Problems
by: Sato, Kanji, et al.
Published: (2022)

Irreducibility of nonsmooth state-space models with an application to CMA-ES
by: Gissler, Armand, et al.
Published: (2024)

Mokobodzki's intervals: an approach to Dynkin games when value process is not a semimartingale
by: Klimsiak, Tomasz, et al.
Published: (2024)

Exact sensitivity analysis of Markov reward processes via algebraic geometry
by: Chan, Timothy C. Y., et al.
Published: (2024)

Algebraic Reduction of Hidden Markov Models
by: Grigoletto, Tommaso, et al.
Published: (2022)

Law-invariant BSDEs and dynamic risk measures: new characterizations
by: Bensaid, Zakaria, et al.
Published: (2026)

Langevin dynamics based algorithm e-TH$\varepsilon$O POULA for stochastic optimization problems with discontinuous stochastic gradient
by: Lim, Dong-Young, et al.
Published: (2022)

Beyond Average Return in Markov Decision Processes
by: Marthe, Alexandre, et al.
Published: (2023)

A dynamic optimal reinsurance strategy with capital injections in the Cramer-Lundberg model
by: Aljaberi, Zakaria, et al.
Published: (2024)