Cover Image

On Pioneering Works of Albert Shiryaev on Markov Decision Processes and Some Later Developments

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Feinberg, Eugene A.
Format:	Preprint
Published:	2025
Subjects:	Probability Optimization and Control
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Reoptimization Nearly Solves Weakly Coupled Markov Decision Processes
by: Gast, Nicolas, et al.
Published: (2022)

Markov Decision Processing Networks
by: Bhambay, Sanidhay, et al.
Published: (2025)

Beyond Average Return in Markov Decision Processes
by: Marthe, Alexandre, et al.
Published: (2023)

An Online Multiobjective Policy Gradient for Long-run Average-reward Markov Decision Process
by: Misra, Rahul, et al.
Published: (2025)

Markov Decision Process and Approximate Dynamic Programming for a Patient Assignment Scheduling problem
by: O'Reilly, Malgorzata M., et al.
Published: (2024)

Non-Exchangeable Mean Field Markov Decision Processes with common noise : from Bellman equation to quantitative propagation of chaos
by: Mekkaoui, Samy, et al.
Published: (2026)

Bounding the Difference between the Values of Robust and Non-Robust Markov Decision Problems
by: Neufeld, Ariel, et al.
Published: (2023)

Optimal Risk-Sensitive Scheduling Policies for Remote Estimation of Autoregressive Markov Processes
by: Dutta, Manali, et al.
Published: (2024)

Robust $Q$-learning Algorithm for Markov Decision Processes under Wasserstein Uncertainty
by: Neufeld, Ariel, et al.
Published: (2022)

Further remarks on absorbing Markov decision processes
by: Zhang, Yi, et al.
Published: (2024)

Langevin dynamics for the probability of finite state Markov processes
by: Li, Wuchen
Published: (2023)

Markov decision processes: on the convergence of the Monte-Carlo first visit algorithm
by: Delattre, Sylvain, et al.
Published: (2025)

Nonstationary nonzero-sum Markov games under a probability criterion
by: Guo, Xin, et al.
Published: (2025)

Markov-Nash equilibria in mean-field games under model uncertainty
by: Langner, Johannes, et al.
Published: (2024)

On reachability of Markov decision processes: a novel state-classification-based PI approach
by: Li, Yanyun, et al.
Published: (2023)

Asymptotic Optimality in Data-Driven Decision Making
by: Salač, Radek, et al.
Published: (2025)

Optimal control of McKean-Vlasov systems under partial observation and hidden Markov switching
by: Fuhrman, Marco, et al.
Published: (2026)

Convergence of the Heterogeneous Deffuant-Weisbuch Model: A Complete Proof and Some Extensions
by: Chen, Ge, et al.
Published: (2024)

Linear Algebraic Truncation Algorithm with A Posteriori Error Bounds for Computing Markov Chain Equilibrium Gradients
by: Mahdian, Saied, et al.
Published: (2025)

Zero-Sum Games for piecewise deterministic Markov decision processes with risk-sensitive finite-horizon cost criterion
by: Golui, Subrata
Published: (2024)

Chance-Constrained Generic Energy Storage Operations under Decision-Dependent Uncertainty
by: Qi, Ning, et al.
Published: (2022)

On a discrete max-plus transportation problem
by: Mayorga, Sergio, et al.
Published: (2026)

The Wasserstein Space of Stochastic Processes in Continuous Time
by: Bartl, Daniel, et al.
Published: (2025)

About a Ball Removal Process on Bins
by: Correa, Jose, et al.
Published: (2026)

Synchronous Heterogeneous Exclusion Processes on Open Lattice
by: Yashina, Marina V., et al.
Published: (2024)

Adapted Optimal Transport between Filtered Gaussian Processes
by: Gunasingam, Madhu, et al.
Published: (2026)

Algebraic Reduction of Hidden Markov Models
by: Grigoletto, Tommaso, et al.
Published: (2022)

Optimal Control of McKean--Vlasov Branching Diffusion Processes
by: Claisse, Julien, et al.
Published: (2025)

Distributionally Robust Gaussian Process Regression and Bayesian Inverse Problems
by: Zhang, Xuhui, et al.
Published: (2022)

Complexity Guarantees for Zeroth-order Methods via Exponentially-shifted Gaussian Smoothing: Mitigating Dimension-dependence and Incorporating Decision-dependence
by: Wang, Mingrui, et al.
Published: (2026)

Approximation of Singular-Stopping Control Driven by Hawkes Processes via Rescaled MDPs
by: Agostino, Isabel, et al.
Published: (2026)

Product-Form Distribution and Reversibility of Inhomogeneous Symmetric Simple Exclusion Process with Open Boundaries
by: Yashina, Marina V., et al.
Published: (2025)

Optimal Harvesting of a Stochastic Logistic Model Driven by One-Sided Tempered Stable Process
by: Deng, Wenmin, et al.
Published: (2026)

Two-Stage Distributionally Robust Optimization: Intuitive Understanding and Algorithm Development from the Primal Perspective
by: Lu, Zhengsong, et al.
Published: (2024)

Markov control of continuous time Markov processes with long run functionals by time discretization
by: Stettner, Lukasz
Published: (2025)

Rates of Convergence in the Central Limit Theorem for Markov Chains, with an Application to TD Learning
by: Srikant, R.
Published: (2024)

A Note on the Bias and Kemeny's Constant in Markov Reward Processes with an Application to Markov Chain Perturbation
by: Ortner, Ronald
Published: (2024)

Absorbing Markov Decision Processes
by: Dufour, François, et al.
Published: (2023)

Asymptotically Optimal Policies for Weakly Coupled Markov Decision Processes
by: Goldsztajn, Diego, et al.
Published: (2024)

Approximate Computation of Loss Probability for Queueing System with Capacity Sharing Discipline
by: Yashina, M. V., et al.
Published: (2024)