Validating Causal Message Passing Against Network-Aware Methods on Real Experiments

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Tan, Albert, Shirani, Sadegh, Nordlund, James, Bayati, Mohsen
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866918322092638208
author Tan, Albert
Shirani, Sadegh
Nordlund, James
Bayati, Mohsen
author_facet Tan, Albert
Shirani, Sadegh
Nordlund, James
Bayati, Mohsen
contents Estimating total treatment effects in the presence of network interference typically requires knowledge of the underlying interaction structure. However, in many practical settings, network data is either unavailable, incomplete, or measured with substantial error. We demonstrate that causal message passing, a methodology that leverages temporal structure in outcome data rather than network topology, can recover total treatment effects comparable to network-aware approaches. We apply causal message passing to two large-scale field experiments where a recently developed bipartite graph methodology, which requires network knowledge, serves as a benchmark. Despite having no access to the interaction network, causal message passing produces effect estimates that match the network-aware approach in direction across all metrics and in statistical significance for the primary decision metric. Our findings validate the premise of causal message passing: that temporal variation in outcomes can serve as an effective substitute for network observation when estimating spillover effects. This has important practical implications: practitioners facing settings where network data is costly to collect, proprietary, or unreliable can instead exploit the temporal dynamics of their experimental data.
format Preprint
id arxiv_https___arxiv_org_abs_2602_04230
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Validating Causal Message Passing Against Network-Aware Methods on Real Experiments
Tan, Albert
Shirani, Sadegh
Nordlund, James
Bayati, Mohsen
Methodology
Econometrics
Estimating total treatment effects in the presence of network interference typically requires knowledge of the underlying interaction structure. However, in many practical settings, network data is either unavailable, incomplete, or measured with substantial error. We demonstrate that causal message passing, a methodology that leverages temporal structure in outcome data rather than network topology, can recover total treatment effects comparable to network-aware approaches. We apply causal message passing to two large-scale field experiments where a recently developed bipartite graph methodology, which requires network knowledge, serves as a benchmark. Despite having no access to the interaction network, causal message passing produces effect estimates that match the network-aware approach in direction across all metrics and in statistical significance for the primary decision metric. Our findings validate the premise of causal message passing: that temporal variation in outcomes can serve as an effective substitute for network observation when estimating spillover effects. This has important practical implications: practitioners facing settings where network data is costly to collect, proprietary, or unreliable can instead exploit the temporal dynamics of their experimental data.
title Validating Causal Message Passing Against Network-Aware Methods on Real Experiments
topic Methodology
Econometrics
url https://arxiv.org/abs/2602.04230