Experimentation for Homogenous Policy Change
Fuente:
arXiv
Guardado en:
| Autores principales: | , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2021
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866913915136376832 |
|---|---|
| author | Offer-Westort, Molly Dimmery, Drew |
| author_facet | Offer-Westort, Molly Dimmery, Drew |
| contents | When the Stable Unit Treatment Value Assumption is violated and there is interference among units, there is not a uniquely defined Average Treatment Effect, and alternative estimands may be of interest. Among these are average unit-level differences in outcomes under different homogeneous treatment policies. We refer to such targets as Global Average Treatment Effects. We consider approaches to experimental design with multiple treatment conditions under partial interference and, given the estimand of interest, we show that difference-in-means estimators may perform better than correctly specified regression models in finite samples on root mean squared error for such targets. With errors correlated at the cluster level, we demonstrate that two-stage randomization procedures with intra-cluster correlation of treatment strictly between zero and one may dominate one-stage randomization designs on the same metric. Simulations illustrate performance of this approach; we consider an application to online experiments at Facebook. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2101_12318 |
| institution | arXiv |
| publishDate | 2021 |
| record_format | arxiv |
| spellingShingle | Experimentation for Homogenous Policy Change Offer-Westort, Molly Dimmery, Drew Methodology Applications When the Stable Unit Treatment Value Assumption is violated and there is interference among units, there is not a uniquely defined Average Treatment Effect, and alternative estimands may be of interest. Among these are average unit-level differences in outcomes under different homogeneous treatment policies. We refer to such targets as Global Average Treatment Effects. We consider approaches to experimental design with multiple treatment conditions under partial interference and, given the estimand of interest, we show that difference-in-means estimators may perform better than correctly specified regression models in finite samples on root mean squared error for such targets. With errors correlated at the cluster level, we demonstrate that two-stage randomization procedures with intra-cluster correlation of treatment strictly between zero and one may dominate one-stage randomization designs on the same metric. Simulations illustrate performance of this approach; we consider an application to online experiments at Facebook. |
| title | Experimentation for Homogenous Policy Change |
| topic | Methodology Applications |
| url | https://arxiv.org/abs/2101.12318 |