Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Guo, Jiayi, Li, Haoxuan, Tian, Ye, Wu, Peng
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2510.16419
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914101041561600
author Guo, Jiayi
Li, Haoxuan
Tian, Ye
Wu, Peng
author_facet Guo, Jiayi
Li, Haoxuan
Tian, Ye
Wu, Peng
contents While significant progress has been made in heterogeneous treatment effect (HTE) estimation, the evaluation of HTE estimators remains underdeveloped. In this article, we propose a robust evaluation framework based on relative error, which quantifies performance differences between two HTE estimators. We first derive the key theoretical conditions on the nuisance parameters that are necessary to achieve a robust estimator of relative error. Building on these conditions, we introduce novel loss functions and design a neural network architecture to estimate nuisance parameters and obtain robust estimation of relative error, thereby achieving reliable evaluation of HTE estimators. We provide the large sample properties of the proposed relative error estimator. Furthermore, beyond evaluation, we propose a new learning algorithm for HTE that leverages both the previously HTE estimators and the nuisance parameters learned through our neural network architecture. Extensive experiments demonstrate that our evaluation framework supports reliable comparisons across HTE estimators, and the proposed learning algorithm for HTE exhibits desirable performance.
format Preprint
id arxiv_https___arxiv_org_abs_2510_16419
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Relative Error-Based Evaluation Framework of Heterogeneous Treatment Effect Estimators
Guo, Jiayi
Li, Haoxuan
Tian, Ye
Wu, Peng
Machine Learning
While significant progress has been made in heterogeneous treatment effect (HTE) estimation, the evaluation of HTE estimators remains underdeveloped. In this article, we propose a robust evaluation framework based on relative error, which quantifies performance differences between two HTE estimators. We first derive the key theoretical conditions on the nuisance parameters that are necessary to achieve a robust estimator of relative error. Building on these conditions, we introduce novel loss functions and design a neural network architecture to estimate nuisance parameters and obtain robust estimation of relative error, thereby achieving reliable evaluation of HTE estimators. We provide the large sample properties of the proposed relative error estimator. Furthermore, beyond evaluation, we propose a new learning algorithm for HTE that leverages both the previously HTE estimators and the nuisance parameters learned through our neural network architecture. Extensive experiments demonstrate that our evaluation framework supports reliable comparisons across HTE estimators, and the proposed learning algorithm for HTE exhibits desirable performance.
title A Relative Error-Based Evaluation Framework of Heterogeneous Treatment Effect Estimators
topic Machine Learning
url https://arxiv.org/abs/2510.16419