AExGym: Benchmarks and Environments for Adaptive Experimentation

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Wang, Jimmy, Che, Ethan, Jiang, Daniel R., Namkoong, Hongseok
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866916350577868800
author Wang, Jimmy
Che, Ethan
Jiang, Daniel R.
Namkoong, Hongseok
author_facet Wang, Jimmy
Che, Ethan
Jiang, Daniel R.
Namkoong, Hongseok
contents Innovations across science and industry are evaluated using randomized trials (a.k.a. A/B tests). While simple and robust, such static designs are inefficient or infeasible for testing many hypotheses. Adaptive designs can greatly improve statistical power in theory, but they have seen limited adoption due to their fragility in practice. We present a benchmark for adaptive experimentation based on real-world datasets, highlighting prominent practical challenges to operationalizing adaptivity: non-stationarity, batched/delayed feedback, multiple outcomes and objectives, and external validity. Our benchmark aims to spur methodological development that puts practical performance (e.g., robustness) as a central concern, rather than mathematical guarantees on contrived instances. We release an open source library, AExGym, which is designed with modularity and extensibility in mind to allow experimentation practitioners to develop custom environments and algorithms.
format Preprint
id arxiv_https___arxiv_org_abs_2408_04531
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle AExGym: Benchmarks and Environments for Adaptive Experimentation
Wang, Jimmy
Che, Ethan
Jiang, Daniel R.
Namkoong, Hongseok
Machine Learning
Innovations across science and industry are evaluated using randomized trials (a.k.a. A/B tests). While simple and robust, such static designs are inefficient or infeasible for testing many hypotheses. Adaptive designs can greatly improve statistical power in theory, but they have seen limited adoption due to their fragility in practice. We present a benchmark for adaptive experimentation based on real-world datasets, highlighting prominent practical challenges to operationalizing adaptivity: non-stationarity, batched/delayed feedback, multiple outcomes and objectives, and external validity. Our benchmark aims to spur methodological development that puts practical performance (e.g., robustness) as a central concern, rather than mathematical guarantees on contrived instances. We release an open source library, AExGym, which is designed with modularity and extensibility in mind to allow experimentation practitioners to develop custom environments and algorithms.
title AExGym: Benchmarks and Environments for Adaptive Experimentation
topic Machine Learning
url https://arxiv.org/abs/2408.04531