Sensitivity Analysis for Causal ML: A Use Case at Booking.com

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Bach, Philipp, Chernozhukov, Victor, Cinelli, Carlos, Jia, Lin, Klaassen, Sven, Skotara, Nils, Spindler, Martin
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912640525139968
author Bach, Philipp
Chernozhukov, Victor
Cinelli, Carlos
Jia, Lin
Klaassen, Sven
Skotara, Nils
Spindler, Martin
author_facet Bach, Philipp
Chernozhukov, Victor
Cinelli, Carlos
Jia, Lin
Klaassen, Sven
Skotara, Nils
Spindler, Martin
contents Causal Machine Learning has emerged as a powerful tool for flexibly estimating causal effects from observational data in both industry and academia. However, causal inference from observational data relies on untestable assumptions about the data-generating process, such as the absence of unobserved confounders. When these assumptions are violated, causal effect estimates may become biased, undermining the validity of research findings. In these contexts, sensitivity analysis plays a crucial role, by enabling data scientists to assess the robustness of their findings to plausible violations of unconfoundedness. This paper introduces sensitivity analysis and demonstrates its practical relevance through a (simulated) data example based on a use case at Booking.com. We focus our presentation on a recently proposed method by Chernozhukov et al. (2023), which derives general non-parametric bounds on biases due to omitted variables, and is fully compatible with (though not limited to) modern inferential tools of Causal Machine Learning. By presenting this use case, we aim to raise awareness of sensitivity analysis and highlight its importance in real-world scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2510_09109
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Sensitivity Analysis for Causal ML: A Use Case at Booking.com
Bach, Philipp
Chernozhukov, Victor
Cinelli, Carlos
Jia, Lin
Klaassen, Sven
Skotara, Nils
Spindler, Martin
Econometrics
Causal Machine Learning has emerged as a powerful tool for flexibly estimating causal effects from observational data in both industry and academia. However, causal inference from observational data relies on untestable assumptions about the data-generating process, such as the absence of unobserved confounders. When these assumptions are violated, causal effect estimates may become biased, undermining the validity of research findings. In these contexts, sensitivity analysis plays a crucial role, by enabling data scientists to assess the robustness of their findings to plausible violations of unconfoundedness. This paper introduces sensitivity analysis and demonstrates its practical relevance through a (simulated) data example based on a use case at Booking.com. We focus our presentation on a recently proposed method by Chernozhukov et al. (2023), which derives general non-parametric bounds on biases due to omitted variables, and is fully compatible with (though not limited to) modern inferential tools of Causal Machine Learning. By presenting this use case, we aim to raise awareness of sensitivity analysis and highlight its importance in real-world scenarios.
title Sensitivity Analysis for Causal ML: A Use Case at Booking.com
topic Econometrics
url https://arxiv.org/abs/2510.09109