The Honest Truth About Causal Trees: Accuracy Limits for Heterogeneous Treatment Effect Estimation

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Cattaneo, Matias D., Klusowski, Jason M., Yu, Ruiqi Rae
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866915870364663808
author Cattaneo, Matias D.
Klusowski, Jason M.
Yu, Ruiqi Rae
author_facet Cattaneo, Matias D.
Klusowski, Jason M.
Yu, Ruiqi Rae
contents Recursive decision trees are widely used to estimate heterogeneous causal treatment effects in experimental and observational studies. These methods are typically implemented using CART-type recursive partitioning and are often viewed as adaptive procedures capable of discovering treatment effect heterogeneity in high-dimensional settings. We study causal tree estimators based on adaptive recursive partitioning and establish lower bounds on their estimation accuracy. Under basic conditions, we show that causal trees constructed via standard CART-type splitting rules cannot achieve polynomial-in-$n$ convergence rates in the uniform norm (where $n$ denotes the sample size). The underlying mechanism is that greedy recursive partitioning selects highly imbalanced splits with non-vanishing probability, producing terminal nodes containing very few observations and leading to large estimation variance. We further show that sample splitting (``honesty'') yields at most negligible improvements in convergence rates. As a consequence, causal tree estimators may converge arbitrarily slowly and can even be inconsistent in some settings. Our results also clarify the role of balanced partition assumptions in existing theoretical guarantees for causal forests and related ensemble methods. The analysis develops new probabilistic tools for studying adaptive recursive partitioning procedures, including non-asymptotic approximations for suprema of partial sums and Gaussian processes. As a technical by-product, we also identify and correct an error in Eicker (1979).
format Preprint
id arxiv_https___arxiv_org_abs_2509_11381
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle The Honest Truth About Causal Trees: Accuracy Limits for Heterogeneous Treatment Effect Estimation
Cattaneo, Matias D.
Klusowski, Jason M.
Yu, Ruiqi Rae
Statistics Theory
Econometrics
Methodology
Machine Learning
Recursive decision trees are widely used to estimate heterogeneous causal treatment effects in experimental and observational studies. These methods are typically implemented using CART-type recursive partitioning and are often viewed as adaptive procedures capable of discovering treatment effect heterogeneity in high-dimensional settings. We study causal tree estimators based on adaptive recursive partitioning and establish lower bounds on their estimation accuracy. Under basic conditions, we show that causal trees constructed via standard CART-type splitting rules cannot achieve polynomial-in-$n$ convergence rates in the uniform norm (where $n$ denotes the sample size). The underlying mechanism is that greedy recursive partitioning selects highly imbalanced splits with non-vanishing probability, producing terminal nodes containing very few observations and leading to large estimation variance. We further show that sample splitting (``honesty'') yields at most negligible improvements in convergence rates. As a consequence, causal tree estimators may converge arbitrarily slowly and can even be inconsistent in some settings. Our results also clarify the role of balanced partition assumptions in existing theoretical guarantees for causal forests and related ensemble methods. The analysis develops new probabilistic tools for studying adaptive recursive partitioning procedures, including non-asymptotic approximations for suprema of partial sums and Gaussian processes. As a technical by-product, we also identify and correct an error in Eicker (1979).
title The Honest Truth About Causal Trees: Accuracy Limits for Heterogeneous Treatment Effect Estimation
topic Statistics Theory
Econometrics
Methodology
Machine Learning
url https://arxiv.org/abs/2509.11381