Causal Deepsets for Off-policy Evaluation under Spatial or Spatio-temporal Interferences

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Dai, Runpeng, Wang, Jianing, Zhou, Fan, Luo, Shikai, Qin, Zhiwei, Shi, Chengchun, Zhu, Hongtu
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913445295685632
author Dai, Runpeng
Wang, Jianing
Zhou, Fan
Luo, Shikai
Qin, Zhiwei
Shi, Chengchun
Zhu, Hongtu
author_facet Dai, Runpeng
Wang, Jianing
Zhou, Fan
Luo, Shikai
Qin, Zhiwei
Shi, Chengchun
Zhu, Hongtu
contents Off-policy evaluation (OPE) is widely applied in sectors such as pharmaceuticals and e-commerce to evaluate the efficacy of novel products or policies from offline datasets. This paper introduces a causal deepset framework that relaxes several key structural assumptions, primarily the mean-field assumption, prevalent in existing OPE methodologies that handle spatio-temporal interference. These traditional assumptions frequently prove inadequate in real-world settings, thereby restricting the capability of current OPE methods to effectively address complex interference effects. In response, we advocate for the implementation of the permutation invariance (PI) assumption. This innovative approach enables the data-driven, adaptive learning of the mean-field function, offering a more flexible estimation method beyond conventional averaging. Furthermore, we present novel algorithms that incorporate the PI assumption into OPE and thoroughly examine their theoretical foundations. Our numerical analyses demonstrate that this novel approach yields significantly more precise estimations than existing baseline algorithms, thereby substantially improving the practical applicability and effectiveness of OPE methodologies. A Python implementation of our proposed method is available at https://github.com/BIG-S2/Causal-Deepsets.
format Preprint
id arxiv_https___arxiv_org_abs_2407_17910
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Causal Deepsets for Off-policy Evaluation under Spatial or Spatio-temporal Interferences
Dai, Runpeng
Wang, Jianing
Zhou, Fan
Luo, Shikai
Qin, Zhiwei
Shi, Chengchun
Zhu, Hongtu
Machine Learning
Artificial Intelligence
Off-policy evaluation (OPE) is widely applied in sectors such as pharmaceuticals and e-commerce to evaluate the efficacy of novel products or policies from offline datasets. This paper introduces a causal deepset framework that relaxes several key structural assumptions, primarily the mean-field assumption, prevalent in existing OPE methodologies that handle spatio-temporal interference. These traditional assumptions frequently prove inadequate in real-world settings, thereby restricting the capability of current OPE methods to effectively address complex interference effects. In response, we advocate for the implementation of the permutation invariance (PI) assumption. This innovative approach enables the data-driven, adaptive learning of the mean-field function, offering a more flexible estimation method beyond conventional averaging. Furthermore, we present novel algorithms that incorporate the PI assumption into OPE and thoroughly examine their theoretical foundations. Our numerical analyses demonstrate that this novel approach yields significantly more precise estimations than existing baseline algorithms, thereby substantially improving the practical applicability and effectiveness of OPE methodologies. A Python implementation of our proposed method is available at https://github.com/BIG-S2/Causal-Deepsets.
title Causal Deepsets for Off-policy Evaluation under Spatial or Spatio-temporal Interferences
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2407.17910