Unveiling the Potential of Robustness in Selecting Conditional Average Treatment Effect Estimators

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Huang, Yiyan, Leung, Cheuk Hang, Wang, Siyi, Li, Yijun, Wu, Qi
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917825000505344
author Huang, Yiyan
Leung, Cheuk Hang
Wang, Siyi
Li, Yijun
Wu, Qi
author_facet Huang, Yiyan
Leung, Cheuk Hang
Wang, Siyi
Li, Yijun
Wu, Qi
contents The growing demand for personalized decision-making has led to a surge of interest in estimating the Conditional Average Treatment Effect (CATE). Various types of CATE estimators have been developed with advancements in machine learning and causal inference. However, selecting the desirable CATE estimator through a conventional model validation procedure remains impractical due to the absence of counterfactual outcomes in observational data. Existing approaches for CATE estimator selection, such as plug-in and pseudo-outcome metrics, face two challenges. First, they must determine the metric form and the underlying machine learning models for fitting nuisance parameters (e.g., outcome function, propensity function, and plug-in learner). Second, they lack a specific focus on selecting a robust CATE estimator. To address these challenges, this paper introduces a Distributionally Robust Metric (DRM) for CATE estimator selection. The proposed DRM is nuisance-free, eliminating the need to fit models for nuisance parameters, and it effectively prioritizes the selection of a distributionally robust CATE estimator. The experimental results validate the effectiveness of the DRM method in selecting CATE estimators that are robust to the distribution shift incurred by covariate shift and hidden confounders.
format Preprint
id arxiv_https___arxiv_org_abs_2402_18392
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Unveiling the Potential of Robustness in Selecting Conditional Average Treatment Effect Estimators
Huang, Yiyan
Leung, Cheuk Hang
Wang, Siyi
Li, Yijun
Wu, Qi
Machine Learning
Artificial Intelligence
Econometrics
The growing demand for personalized decision-making has led to a surge of interest in estimating the Conditional Average Treatment Effect (CATE). Various types of CATE estimators have been developed with advancements in machine learning and causal inference. However, selecting the desirable CATE estimator through a conventional model validation procedure remains impractical due to the absence of counterfactual outcomes in observational data. Existing approaches for CATE estimator selection, such as plug-in and pseudo-outcome metrics, face two challenges. First, they must determine the metric form and the underlying machine learning models for fitting nuisance parameters (e.g., outcome function, propensity function, and plug-in learner). Second, they lack a specific focus on selecting a robust CATE estimator. To address these challenges, this paper introduces a Distributionally Robust Metric (DRM) for CATE estimator selection. The proposed DRM is nuisance-free, eliminating the need to fit models for nuisance parameters, and it effectively prioritizes the selection of a distributionally robust CATE estimator. The experimental results validate the effectiveness of the DRM method in selecting CATE estimators that are robust to the distribution shift incurred by covariate shift and hidden confounders.
title Unveiling the Potential of Robustness in Selecting Conditional Average Treatment Effect Estimators
topic Machine Learning
Artificial Intelligence
Econometrics
url https://arxiv.org/abs/2402.18392