Qini Curve Estimation under Clustered Network Interference

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Karlsson, Rickard, Akker, Bram van den, Moraes, Felipe, Proença, Hugo M., Krijthe, Jesse H.
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914125632765952
author Karlsson, Rickard
Akker, Bram van den
Moraes, Felipe
Proença, Hugo M.
Krijthe, Jesse H.
author_facet Karlsson, Rickard
Akker, Bram van den
Moraes, Felipe
Proença, Hugo M.
Krijthe, Jesse H.
contents Qini curves are a widely used tool for assessing treatment policies under allocation constraints as they visualize the incremental gain of a new treatment policy versus the cost of its implementation. Standard Qini curve estimation assumes no interference between units: that is, that treating one unit does not influence the outcome of any other unit. In many real-life applications such as public policy or marketing, however, the presence of interference is common. Ignoring interference in these scenarios can lead to systematically biased Qini curves that over- or under-estimate a treatment policy's cost-effectiveness. In this paper, we address the problem of Qini curve estimation under clustered network interference, where interfering units form independent clusters. We propose a formal description of the problem setting with an experimental study design under which we can account for clustered network interference. Within this framework, we describe three estimation strategies, each suited to different conditions, and provide guidance for selecting the most appropriate approach by highlighting the inherent bias-variance trade-offs. To complement our theoretical analysis, we introduce a marketplace simulator that replicates clustered network interference in a typical e-commerce environment, allowing us to evaluate and compare the proposed strategies in practice.
format Preprint
id arxiv_https___arxiv_org_abs_2502_20097
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Qini Curve Estimation under Clustered Network Interference
Karlsson, Rickard
Akker, Bram van den
Moraes, Felipe
Proença, Hugo M.
Krijthe, Jesse H.
Methodology
Machine Learning
Qini curves are a widely used tool for assessing treatment policies under allocation constraints as they visualize the incremental gain of a new treatment policy versus the cost of its implementation. Standard Qini curve estimation assumes no interference between units: that is, that treating one unit does not influence the outcome of any other unit. In many real-life applications such as public policy or marketing, however, the presence of interference is common. Ignoring interference in these scenarios can lead to systematically biased Qini curves that over- or under-estimate a treatment policy's cost-effectiveness. In this paper, we address the problem of Qini curve estimation under clustered network interference, where interfering units form independent clusters. We propose a formal description of the problem setting with an experimental study design under which we can account for clustered network interference. Within this framework, we describe three estimation strategies, each suited to different conditions, and provide guidance for selecting the most appropriate approach by highlighting the inherent bias-variance trade-offs. To complement our theoretical analysis, we introduce a marketplace simulator that replicates clustered network interference in a typical e-commerce environment, allowing us to evaluate and compare the proposed strategies in practice.
title Qini Curve Estimation under Clustered Network Interference
topic Methodology
Machine Learning
url https://arxiv.org/abs/2502.20097