Cover Image

Fast Computation of Conditional Probabilities in MDPs and Markov Chain Families

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Češka, Milan, Junges, Sebastian, van der Maas, Luko, Macák, Filip, Quatmann, Tim
Format:	Preprint
Published:	2026
Subjects:	Logic in Computer Science
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Policies Grow on Trees: Model Checking Families of MDPs
by: Andriushchenko, Roman, et al.
Published: (2024)

Small Decision Trees for MDPs with Deductive Synthesis
by: Andriushchenko, Roman, et al.
Published: (2025)

Shields to Guarantee Probabilistic Safety in MDPs
by: Heck, Linus, et al.
Published: (2026)

Constrained and Robust Policy Synthesis with Satisfiability-Modulo-Probabilistic-Model-Checking
by: Heck, Linus, et al.
Published: (2025)

Learning Verified Monitors for Hidden Markov Models
by: van der Maas, Luko, et al.
Published: (2025)

Learning Robust Markov Models for Safe Runtime Monitoring
by: Skurka, Antonina, et al.
Published: (2026)

Generalized Parameter Lifting: Finer Abstractions for Parametric Markov Chains
by: Heck, Linus, et al.
Published: (2025)

Decentralized Planning Using Probabilistic Hyperproperties
by: Pontiggia, Francesco, et al.
Published: (2025)

Robust Almost-Sure Reachability in Multi-Environment MDPs
by: van der Vegt, Marck, et al.
Published: (2023)

Accurately Computing Expected Visiting Times and Stationary Distributions in Markov Chains
by: Mertens, Hannah, et al.
Published: (2024)

A PSPACE Algorithm for Almost-Sure Rabin Objectives in Multi-Environment MDPs
by: Suilen, Marnix, et al.
Published: (2024)

Compositional Verification of Almost-Sure Büchi Objectives in MDPs
by: van der Vegt, Marck, et al.
Published: (2025)

Pareto Curves for Compositionally Model Checking String Diagrams of MDPs
by: Watanabe, Kazuki, et al.
Published: (2024)

Probabilistic Model Checking Taken by Storm
by: Volk, Matthias, et al.
Published: (2026)

Tractable Hyperproperties for MDPs
by: Gerlach, Lina, et al.
Published: (2026)

Fixed Point Certificates for Reachability and Expected Rewards in MDPs
by: Chatterjee, Krishnendu, et al.
Published: (2025)

Compositional Reasoning for Probabilistic Automata with Uncertainty
by: Mertens, Hannah, et al.
Published: (2026)

Compositional Reasoning for Parametric Probabilistic Automata
by: Mertens, Hannah, et al.
Published: (2025)

Compositional Value Iteration with Pareto Caching
by: Watanabe, Kazuki, et al.
Published: (2024)

Algorithms for Markov Binomial Chains
by: Gonzalez, Alejandro Alarcón, et al.
Published: (2024)

A Spectrum of Approximate Probabilistic Bisimulations
by: Spork, Timm, et al.
Published: (2024)

Tools at the Frontiers of Quantitative Verification
by: Andriushchenko, Roman, et al.
Published: (2024)

Dynamic Probability Logic: Decidability & Computability
by: Chopoghloo, Somayeh, et al.
Published: (2024)

Small Test Suites for Active Automata Learning
by: Kruger, Loes, et al.
Published: (2024)

Relating Apartness and Branching Bisimulation Games
by: Rot, Jurriaan, et al.
Published: (2024)

A Unifying Approach to Product Constructions for Quantitative Temporal Inference
by: Watanabe, Kazuki, et al.
Published: (2024)

Error-awareness Accelerates Active Automata Learning
by: Kruger, Loes, et al.
Published: (2026)

State Matching and Multiple References in Adaptive Active Automata Learning
by: Kruger, Loes, et al.
Published: (2024)

Skolem and Positivity Completeness of Ergodic Markov Chains
by: Vahanwala, Mihir
Published: (2023)

Model Checking Markov Chains as Distribution Transformers
by: Aghamov, Rajab, et al.
Published: (2024)

Efficient Probabilistic Model Checking for Relational Reachability (Extended Version)
by: Gerlach, Lina, et al.
Published: (2025)

CTMCs with Imprecisely Timed Observations
by: Badings, Thom, et al.
Published: (2024)

Subvarieties of pointed Abelian l-groups
by: Jankovec, Filip
Published: (2025)

Approximate Probabilistic Bisimulation for Continuous-Time Markov Chains
by: Spork, Timm, et al.
Published: (2025)

Multi-Environment MDPs with Prior and Universal Semantics
by: Bordais, Benjamin, et al.
Published: (2026)

Decisiveness for countable MDPs and insights for NPLCSs and POMDPs
by: Bertrand, Nathalie, et al.
Published: (2020)

Proof Theory and Decision Procedures for Deontic STIT Logics
by: Lyon, Tim S., et al.
Published: (2024)

Omega-regular Verification and Control for Distributional Specifications in MDPs
by: Akshay, S., et al.
Published: (2025)

The Value Problem for Multiple-Environment MDPs with Parity Objective
by: Chatterjee, Krishnendu, et al.
Published: (2025)

Uniform interpolation with constructive diamond
by: van der Giessen, Iris, et al.
Published: (2026)