Double Machine Learning at Scale to Predict Causal Impact of Customer Actions

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: More, Sushant, Kotwal, Priya, Chappidi, Sujith, Mandalapu, Dinesh, Khawand, Chris
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866916381572726784
author More, Sushant
Kotwal, Priya
Chappidi, Sujith
Mandalapu, Dinesh
Khawand, Chris
author_facet More, Sushant
Kotwal, Priya
Chappidi, Sujith
Mandalapu, Dinesh
Khawand, Chris
contents Causal Impact (CI) of customer actions are broadly used across the industry to inform both short- and long-term investment decisions of various types. In this paper, we apply the double machine learning (DML) methodology to estimate the CI values across 100s of customer actions of business interest and 100s of millions of customers. We operationalize DML through a causal ML library based on Spark with a flexible, JSON-driven model configuration approach to estimate CI at scale (i.e., across hundred of actions and millions of customers). We outline the DML methodology and implementation, and associated benefits over the traditional potential outcomes based CI model. We show population-level as well as customer-level CI values along with confidence intervals. The validation metrics show a 2.2% gain over the baseline methods and a 2.5X gain in the computational time. Our contribution is to advance the scalable application of CI, while also providing an interface that allows faster experimentation, cross-platform support, ability to onboard new use cases, and improves accessibility of underlying code for partner teams.
format Preprint
id arxiv_https___arxiv_org_abs_2409_02332
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Double Machine Learning at Scale to Predict Causal Impact of Customer Actions
More, Sushant
Kotwal, Priya
Chappidi, Sujith
Mandalapu, Dinesh
Khawand, Chris
Machine Learning
Econometrics
Applications
Methodology
Causal Impact (CI) of customer actions are broadly used across the industry to inform both short- and long-term investment decisions of various types. In this paper, we apply the double machine learning (DML) methodology to estimate the CI values across 100s of customer actions of business interest and 100s of millions of customers. We operationalize DML through a causal ML library based on Spark with a flexible, JSON-driven model configuration approach to estimate CI at scale (i.e., across hundred of actions and millions of customers). We outline the DML methodology and implementation, and associated benefits over the traditional potential outcomes based CI model. We show population-level as well as customer-level CI values along with confidence intervals. The validation metrics show a 2.2% gain over the baseline methods and a 2.5X gain in the computational time. Our contribution is to advance the scalable application of CI, while also providing an interface that allows faster experimentation, cross-platform support, ability to onboard new use cases, and improves accessibility of underlying code for partner teams.
title Double Machine Learning at Scale to Predict Causal Impact of Customer Actions
topic Machine Learning
Econometrics
Applications
Methodology
url https://arxiv.org/abs/2409.02332