Cover Image

Prediction-Based Markov Violation Scores for Detecting Non-Markovian Observations in Reinforcement Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Mysore, Naveen
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence 68T05, 62M10 I.2.6; I.2.8; G.3
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Multiple data-driven missing imputation
by: Kavun, Sergii
Published: (2025)

Long-Term Electricity Demand Prediction Using Non-negative Tensor Factorization and Genetic Algorithm-Driven Temporal Modeling
by: Masaki, Toma, et al.
Published: (2025)

Temporal-Aligned Meta-Learning for Risk Management: A Stacking Approach for Multi-Source Credit Scoring
by: Didkovskyi, O., et al.
Published: (2026)

Adaptive Machine Learning for Resource-Constrained Environments
by: Ordóñez, Sebastián A. Cajas, et al.
Published: (2025)

AI Agents: Evolution, Architecture, and Real-World Applications
by: Krishnan, Naveen
Published: (2025)

Quantifying First-Order Markov Violations in Noisy Reinforcement Learning: A Causal Discovery Approach
by: Mysore, Naveen
Published: (2025)

Classifier Calibration at Scale: An Empirical Study of Model-Agnostic Post-Hoc Methods
by: Manokhin, Valery, et al.
Published: (2026)

Temporal Functional Circuits: From Spline Plots to Faithful Explanations in KAN Forecasting
by: Mysore, Naveen
Published: (2026)

Time Aggregation Features for XGBoost Models
by: Pinchuk, Mykola
Published: (2026)

Modeling and Controlling Deployment Reliability under Temporal Distribution Shift
by: Rahman, Naimur, et al.
Published: (2026)

AMBIT: Augmenting Mobility Baselines with Interpretable Trees
by: Wang, Qizhi
Published: (2025)

Urban Spatio-Temporal Foundation Models for Climate-Resilient Housing: Scaling Diffusion Transformers for Disaster Risk Prediction
by: Imanov, Olaf Yunus Laitinen, et al.
Published: (2026)

Soil Compaction Parameters Prediction Based on Automated Machine Learning Approach
by: Erden, Caner, et al.
Published: (2025)

CSTS: A Benchmark for the Discovery of Correlation Structures in Time Series Clustering
by: Degen, Isabella, et al.
Published: (2025)

Enriched Functional Tree-Based Classifiers: A Novel Approach Leveraging Derivatives and Geometric Features
by: Maturo, Fabrizio, et al.
Published: (2024)

An Improved Adaptive PID Optimizer with Enhanced Convergence and Stability for Deep Learning
by: Saini, Saurabh, et al.
Published: (2026)

Evolving machine learning workflows through interactive AutoML
by: Barbudo, Rafael, et al.
Published: (2024)

Measuring Similarity in Causal Graphs: A Framework for Semantic and Structural Analysis
by: Liu, Ning-Yuan Georgia, et al.
Published: (2025)

Can a Bayesian Oracle Prevent Harm from an Agent?
by: Bengio, Yoshua, et al.
Published: (2024)

AI and Machine Learning Approaches for Predicting Nanoparticles Toxicity The Critical Role of Physiochemical Properties
by: Yousaf, Iqra
Published: (2024)

SafeRL-Lite: A Lightweight, Explainable, and Constrained Reinforcement Learning Library
by: Mishra, Satyam, et al.
Published: (2025)

Active Causal Experimentalist (ACE): Learning Intervention Strategies via Direct Preference Optimization
by: Cooper, Patrick, et al.
Published: (2026)

A Hybrid Framework for Real-Time Data Drift and Anomaly Identification Using Hierarchical Temporal Memory and Statistical Tests
by: Bandyopadhyay, Subhadip, et al.
Published: (2025)

Model-based Bootstrap of Controlled Markov Chains
by: Su, Ziwei, et al.
Published: (2026)

A Comparison Between Decision Transformers and Traditional Offline Reinforcement Learning Algorithms
by: Caunhye, Ali Murtaza, et al.
Published: (2025)

Mitigating Catastrophic Forgetting in Streaming Generative and Predictive Learning via Stateful Replay
by: Du, Wenzhang
Published: (2025)

On the Fundamental Limitations of Decentralized Learnable Reward Shaping in Cooperative Multi-Agent Reinforcement Learning
by: Akella, Aditya
Published: (2025)

XAutoLM: Efficient Fine-Tuning of Language Models via Meta-Learning and AutoML
by: Estevanell-Valladares, Ernesto L., et al.
Published: (2025)

Semantic-Constrained Federated Aggregation: Convergence Theory and Privacy-Utility Bounds for Knowledge-Enhanced Distributed Learning
by: Arafat, Jahidul
Published: (2025)

Dual-Channel Feature Fusion for Joint Prediction in Dynamic Signed Weighted Networks
by: Zhang, Gaoxin, et al.
Published: (2026)

Statistical Guarantees for Lifelong Reinforcement Learning using PAC-Bayes Theory
by: Zhang, Zhi, et al.
Published: (2024)

Connectivity-Aware Representations for Constrained Motion Planning via Multi-Scale Contrastive Learning
by: Jeon, Suhyun, et al.
Published: (2026)

OML-AD: Online Machine Learning for Anomaly Detection in Time Series Data
by: Wette, Sebastian, et al.
Published: (2024)

Adaptive Minds: Empowering Agents with LoRA-as-Tools
by: Shekar, Pavan C, et al.
Published: (2025)

Foundation Models as World Models: A Foundational Study in Text-Based GridWorlds
by: Sasso, Remo, et al.
Published: (2025)

Normalisation and Initialisation Strategies for Graph Neural Networks in Blockchain Anomaly Detection
by: Duy, Dang Sy, et al.
Published: (2026)

Reinforcement Learning for Portfolio Optimization with a Financial Goal and Defined Time Horizons
by: Leukam, Fermat, et al.
Published: (2025)

Gaussian Ensemble Belief Propagation for Efficient Inference in High-Dimensional Systems
by: MacKinlay, Dan, et al.
Published: (2024)

Emotion-Inspired Learning Signals (EILS): A Homeostatic Framework for Adaptive Autonomous Agents
by: Tiwari, Dhruv
Published: (2025)

Differentially Private Non Parametric Copulas: Generating synthetic data with non parametric copulas under privacy guarantees
by: Osorio-Marulanda, Pablo A., et al.
Published: (2024)