Budgeted Active Experimentation for Treatment Effect Estimation from Observational and Randomized Data

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Gao, Jiacan, Su, Xinyan, Ma, Mingyuan, Huang, Yiyan, Xu, Xiao, Wan, Xinrui, Gu, Tianqi, Yu, Enyun, Guo, Jiecheng, Zhang, Zhiheng
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914350666612736
author Gao, Jiacan
Su, Xinyan
Ma, Mingyuan
Huang, Yiyan
Xu, Xiao
Wan, Xinrui
Gu, Tianqi
Yu, Enyun
Guo, Jiecheng
Zhang, Zhiheng
author_facet Gao, Jiacan
Su, Xinyan
Ma, Mingyuan
Huang, Yiyan
Xu, Xiao
Wan, Xinrui
Gu, Tianqi
Yu, Enyun
Guo, Jiecheng
Zhang, Zhiheng
contents Estimating heterogeneous treatment effects is central to data-driven decision-making, yet industrial applications often face a fundamental tension between limited randomized controlled trial (RCT) budgets and abundant but biased observational data collected under historical targeting policies. Although observational logs offer the advantage of scale, they inherently suffer from severe policyinduced imbalance and overlap violations, rendering standalone estimation unreliable. We propose a budgeted active experimentation framework that iteratively enhances model training for causal effect estimation via active sampling. By leveraging observational priors, we develop an acquisition function targeting uplift estimation uncertainty, overlap deficits, and domain discrepancy to select the most informative units for randomized experiments. We establish finite-sample deviation bounds, asymptotic normality via martingale Central Limit Theorems (CLTs), and minimax lower bounds to prove information-theoretic optimality. Extensive experiments on industrial datasets demonstrate that our approach significantly outperforms standard randomized baselines in cost-constrained settings.
format Preprint
id arxiv_https___arxiv_org_abs_2602_22021
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Budgeted Active Experimentation for Treatment Effect Estimation from Observational and Randomized Data
Gao, Jiacan
Su, Xinyan
Ma, Mingyuan
Huang, Yiyan
Xu, Xiao
Wan, Xinrui
Gu, Tianqi
Yu, Enyun
Guo, Jiecheng
Zhang, Zhiheng
Methodology
Estimating heterogeneous treatment effects is central to data-driven decision-making, yet industrial applications often face a fundamental tension between limited randomized controlled trial (RCT) budgets and abundant but biased observational data collected under historical targeting policies. Although observational logs offer the advantage of scale, they inherently suffer from severe policyinduced imbalance and overlap violations, rendering standalone estimation unreliable. We propose a budgeted active experimentation framework that iteratively enhances model training for causal effect estimation via active sampling. By leveraging observational priors, we develop an acquisition function targeting uplift estimation uncertainty, overlap deficits, and domain discrepancy to select the most informative units for randomized experiments. We establish finite-sample deviation bounds, asymptotic normality via martingale Central Limit Theorems (CLTs), and minimax lower bounds to prove information-theoretic optimality. Extensive experiments on industrial datasets demonstrate that our approach significantly outperforms standard randomized baselines in cost-constrained settings.
title Budgeted Active Experimentation for Treatment Effect Estimation from Observational and Randomized Data
topic Methodology
url https://arxiv.org/abs/2602.22021