Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2410.11212 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912073254961152 |
|---|---|
| author | Cortes-Gomez, Santiago Raman, Naveen Singh, Aarti Wilder, Bryan |
| author_facet | Cortes-Gomez, Santiago Raman, Naveen Singh, Aarti Wilder, Bryan |
| contents | Randomized controlled trials (RCTs) can be used to generate guarantees on treatment effects. However, RCTs often spend unnecessary resources exploring sub-optimal treatments, which can reduce the power of treatment guarantees. To address these concerns, we develop a two-stage RCT where, first on a data-driven screening stage, we prune low-impact treatments, while in the second stage, we develop high probability lower bounds on the treatment effect. Unlike existing adaptive RCT frameworks, our method is simple enough to be implemented in scenarios with limited adaptivity. We derive optimal designs for two-stage RCTs and demonstrate how we can implement such designs through sample splitting. Empirically, we demonstrate that two-stage designs improve upon single-stage approaches, especially in scenarios where domain knowledge is available in the form of a prior. Our work is thus, a simple, yet effective, method to estimate high probablility certificates for high performant treatment effects on a RCT. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_11212 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Data-driven Design of Randomized Control Trials with Guaranteed Treatment Effects Cortes-Gomez, Santiago Raman, Naveen Singh, Aarti Wilder, Bryan Computers and Society Randomized controlled trials (RCTs) can be used to generate guarantees on treatment effects. However, RCTs often spend unnecessary resources exploring sub-optimal treatments, which can reduce the power of treatment guarantees. To address these concerns, we develop a two-stage RCT where, first on a data-driven screening stage, we prune low-impact treatments, while in the second stage, we develop high probability lower bounds on the treatment effect. Unlike existing adaptive RCT frameworks, our method is simple enough to be implemented in scenarios with limited adaptivity. We derive optimal designs for two-stage RCTs and demonstrate how we can implement such designs through sample splitting. Empirically, we demonstrate that two-stage designs improve upon single-stage approaches, especially in scenarios where domain knowledge is available in the form of a prior. Our work is thus, a simple, yet effective, method to estimate high probablility certificates for high performant treatment effects on a RCT. |
| title | Data-driven Design of Randomized Control Trials with Guaranteed Treatment Effects |
| topic | Computers and Society |
| url | https://arxiv.org/abs/2410.11212 |