Pessimism in the Face of Confounders: Provably Efficient Offline Reinforcement Learning in Partially Observable Markov Decision Processes
Fuente:
arXiv
Saved in:
| Main Authors: | Lu, Miao, Min, Yifei, Wang, Zhaoran, Yang, Zhuoran |
|---|---|
| Format: | Preprint |
| Published: |
2022
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Policy learning "without" overlap: Pessimism and generalized empirical Bernstein's inequality
by: Jin, Ying, et al.
Published: (2022)
by: Jin, Ying, et al.
Published: (2022)
Demystifying Spatial Confounding
by: Dupont, Emiko, et al.
Published: (2023)
by: Dupont, Emiko, et al.
Published: (2023)
Radial Neighbors for Provably Accurate Scalable Approximations of Gaussian Processes
by: Zhu, Yichen, et al.
Published: (2022)
by: Zhu, Yichen, et al.
Published: (2022)
Provably Efficient Posterior Sampling for Sparse Linear Regression via Measure Decomposition
by: Montanari, Andrea, et al.
Published: (2024)
by: Montanari, Andrea, et al.
Published: (2024)
Optimal Decision Rules Under Partial Identification
by: Yata, Kohei
Published: (2021)
by: Yata, Kohei
Published: (2021)
Robust Spatial Confounding Adjustment via Basis Voting
by: Burman, Anik, et al.
Published: (2025)
by: Burman, Anik, et al.
Published: (2025)
Interpretable Causal Graphical Models for Equilibrium Systems with Confounding
by: Teh, Kai Z., et al.
Published: (2026)
by: Teh, Kai Z., et al.
Published: (2026)
MoMA: Model-based Mirror Ascent for Offline Reinforcement Learning
by: Hong, Mao, et al.
Published: (2024)
by: Hong, Mao, et al.
Published: (2024)
Addressing Confounding by Indication Through (Un)Measured Centre Characteristics in Learn-As-you-GO(LAGO) Trials
by: Bui, Minh Thu, et al.
Published: (2026)
by: Bui, Minh Thu, et al.
Published: (2026)
Debiased Inverse Propensity Score Weighting for Estimation of Average Treatment Effects with High-Dimensional Confounders
by: Wang, Yuhao, et al.
Published: (2020)
by: Wang, Yuhao, et al.
Published: (2020)
Highly Multivariate Large-scale Spatial Stochastic Processes -- A Cross-Markov Random Field Approach
by: Chen, Xiaoqing, et al.
Published: (2024)
by: Chen, Xiaoqing, et al.
Published: (2024)
Fast and Provably Accurate Sequential Designs using Hilbert Space Gaussian Processes
by: Zhu, Huanyan, et al.
Published: (2026)
by: Zhu, Huanyan, et al.
Published: (2026)
Le Cam Distortion: A Decision-Theoretic Framework for Robust Transfer Learning
by: Akdemir, Deniz
Published: (2025)
by: Akdemir, Deniz
Published: (2025)
Pessimism Meets Risk: Risk-Sensitive Offline Reinforcement Learning
by: Zhang, Dake, et al.
Published: (2024)
by: Zhang, Dake, et al.
Published: (2024)
Expected Weighted D-optimal Designs for Experiments with Mixed Factors
by: Lin, Siting, et al.
Published: (2025)
by: Lin, Siting, et al.
Published: (2025)
Algebraic and Statistical Properties of the Partially Regularized Ordinary Least Squares Interpolator
by: Yang, Letian, et al.
Published: (2024)
by: Yang, Letian, et al.
Published: (2024)
Partial Conditioning for Inference of Many-Normal-Means with Hölder Constraints
by: Yang, Jiasen, et al.
Published: (2023)
by: Yang, Jiasen, et al.
Published: (2023)
Determine the Number of States in Hidden Markov Models via Marginal Likelihood
by: Chen, Yang, et al.
Published: (2024)
by: Chen, Yang, et al.
Published: (2024)
Semiparametric Efficient Fusion of Individual Data and Summary Statistics
by: Hu, Wenjie, et al.
Published: (2022)
by: Hu, Wenjie, et al.
Published: (2022)
Improving Causal Inference with Measurement Errors in Exposures and Confounders: A New Method and Its Application to Air Pollution Exposure Assessment and Epidemiology
by: Kim, Honghyok
Published: (2024)
by: Kim, Honghyok
Published: (2024)
Reinforcement Learning for Respondent-Driven Sampling
by: Weltz, Justin, et al.
Published: (2025)
by: Weltz, Justin, et al.
Published: (2025)
Markov Chain Monte Carlo Significance Tests
by: Howes, Michael
Published: (2023)
by: Howes, Michael
Published: (2023)
A General Framework on Conditions for Constraint-based Causal Learning
by: Teh, Kai Z., et al.
Published: (2024)
by: Teh, Kai Z., et al.
Published: (2024)
Nonparametric Estimation via Partial Derivatives
by: Dai, Xiaowu
Published: (2022)
by: Dai, Xiaowu
Published: (2022)
Partial correlation networks of Gaussian processes
by: Peruzzi, Michele
Published: (2026)
by: Peruzzi, Michele
Published: (2026)
Markov Random Fields with Proximity Constraints for Spatial Data
by: Saha, Sudipto, et al.
Published: (2024)
by: Saha, Sudipto, et al.
Published: (2024)
Robust Inference for High-dimensional Linear Models with Heavy-tailed Errors via Partial Gini Covariance
by: Zhang, Yilin, et al.
Published: (2024)
by: Zhang, Yilin, et al.
Published: (2024)
Discovering Causal Relationships using Proxy Variables under Unmeasured Confounding
by: Wu, Yong, et al.
Published: (2025)
by: Wu, Yong, et al.
Published: (2025)
Model Selection over Partially Ordered Sets
by: Taeb, Armeen, et al.
Published: (2023)
by: Taeb, Armeen, et al.
Published: (2023)
High-Dimensional Markov-switching Ordinary Differential Processes
by: Tsai, Katherine, et al.
Published: (2024)
by: Tsai, Katherine, et al.
Published: (2024)
Markov Equivalence and Consistency in Differentiable Structure Learning
by: Deng, Chang, et al.
Published: (2024)
by: Deng, Chang, et al.
Published: (2024)
Identifiability of Treatment Effects with Unobserved Spatially Varying Confounders
by: Tang, Tommy, et al.
Published: (2026)
by: Tang, Tommy, et al.
Published: (2026)
Model-oriented Graph Distances via Partially Ordered Sets
by: Taeb, Armeen, et al.
Published: (2025)
by: Taeb, Armeen, et al.
Published: (2025)
Testing Partially-Identifiable Causal Queries Using Ternary Tests
by: Bhadane, Sourbh, et al.
Published: (2026)
by: Bhadane, Sourbh, et al.
Published: (2026)
Decision-Theoretic Robustness for Network Models
by: Papamichalis, Marios, et al.
Published: (2026)
by: Papamichalis, Marios, et al.
Published: (2026)
Estimation and Inference in Ultrahigh Dimensional Partially Linear Single-Index Models
by: Cui, Shijie, et al.
Published: (2024)
by: Cui, Shijie, et al.
Published: (2024)
Sandwich Boosting for Accurate Estimation in Partially Linear Models for Grouped Data
by: Young, Elliot H., et al.
Published: (2023)
by: Young, Elliot H., et al.
Published: (2023)
Partial identification of principal causal effects under violations of principal ignorability
by: Wu, Minxuan, et al.
Published: (2024)
by: Wu, Minxuan, et al.
Published: (2024)
Compositional Covariate Importance Testing via Partial Conjunction of Bivariate Hypotheses
by: Bhaduri, Ritwik, et al.
Published: (2024)
by: Bhaduri, Ritwik, et al.
Published: (2024)
Classification of multivariate functional data on different domains with Partial Least Squares approaches
by: Moindjie, Issam-Ali, et al.
Published: (2022)
by: Moindjie, Issam-Ali, et al.
Published: (2022)
Similar Items
-
Policy learning "without" overlap: Pessimism and generalized empirical Bernstein's inequality
by: Jin, Ying, et al.
Published: (2022) -
Demystifying Spatial Confounding
by: Dupont, Emiko, et al.
Published: (2023) -
Radial Neighbors for Provably Accurate Scalable Approximations of Gaussian Processes
by: Zhu, Yichen, et al.
Published: (2022) -
Provably Efficient Posterior Sampling for Sparse Linear Regression via Measure Decomposition
by: Montanari, Andrea, et al.
Published: (2024) -
Optimal Decision Rules Under Partial Identification
by: Yata, Kohei
Published: (2021)