Cover Image

$t$-Testing the Waters: Empirically Validating Assumptions for Reliable A/B-Testing

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Jeunen, Olivier
Format:	Preprint
Published:	2025
Subjects:	Methodology Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Meta Off-Policy Estimation
by: Jeunen, Olivier
Published: (2025)

Counterfactual Inference under Thompson Sampling
by: Jeunen, Olivier
Published: (2025)

Unifying On- and Off-Policy Variance Reduction Methods
by: Jeunen, Olivier
Published: (2026)

Empirically Calibrated Conditional Independence Tests
by: Pan, Milleno, et al.
Published: (2026)

Assessing Extrapolation of Peaks Over Thresholds with Martingale Testing
by: de Vilmarest, Joseph, et al.
Published: (2025)

Learning Metrics that Maximise Power for Accelerated A/B-Tests
by: Jeunen, Olivier, et al.
Published: (2024)

Learning to Bet for Horizon-Aware Anytime-Valid Testing
by: Taga, Ege Onur, et al.
Published: (2026)

Asymptotic Validity and Finite-Sample Properties of Approximate Randomization Tests
by: Toulis, Panos
Published: (2019)

A Randomized Permutation Whole-Model Test Heuristic for Self-Validated Ensemble Models (SVEM)
by: Karl, Andrew T.
Published: (2024)

Predictive Performance Test based on the Exhaustive Nested Cross-Validation for High-dimensional data
by: Gauran, Iris Ivy, et al.
Published: (2024)

Beyond ATE: Multi-Criteria Design for A/B Testing
by: Li, Jiachun, et al.
Published: (2025)

ML-assisted Randomization Tests for Detecting Treatment Effects in A/B Experiments
by: Guo, Wenxuan, et al.
Published: (2025)

Designing Time Series Experiments in A/B Testing with Transformer Reinforcement Learning
by: Wu, Xiangkun, et al.
Published: (2026)

Kernel Tests of Equivalence
by: Liu, Xing, et al.
Published: (2026)

Graphical Modelling without Independence Assumptions for Uncentered Data
by: Andrew, Bailey, et al.
Published: (2024)

Assumption violations in causal discovery and the robustness of score matching
by: Montagna, Francesco, et al.
Published: (2023)

Assumption-Lean and Data-Adaptive Post-Prediction Inference
by: Miao, Jiacheng, et al.
Published: (2023)

Independence Testing for Temporal Data
by: Shen, Cencheng, et al.
Published: (2019)

Journey to the Centre of Cluster: Harnessing Interior Nodes for A/B Testing under Network Interference
by: Chen, Qianyi, et al.
Published: (2026)

Choice of Scoring Rules for Indirect Elicitation of Properties with Parametric Assumptions
by: Hu, Lingfang, et al.
Published: (2025)

A Unified View of Optimal Kernel Hypothesis Testing
by: Schrab, Antonin
Published: (2025)

A Bootstrap-based Method for Testing Network Similarity
by: Bhadra, Somnath, et al.
Published: (2019)

A Semi-Supervised Kernel Two-Sample Test
by: Lee, Gyumin, et al.
Published: (2026)

On the Hardness of Conditional Independence Testing In Practice
by: He, Zheng, et al.
Published: (2025)

Active Sequential Two-Sample Testing
by: Li, Weizhi, et al.
Published: (2023)

Composite Goodness-of-fit Tests with Kernels
by: Key, Oscar, et al.
Published: (2021)

Extreme Conformal Prediction: Reliable Intervals for High-Impact Events
by: Pasche, Olivier C., et al.
Published: (2025)

Ranking by Lifts: A Cost-Benefit Approach to Large-Scale A/B Tests
by: Basu, Pallavi, et al.
Published: (2024)

A Locally Adaptive Algorithm for Multiple Testing with Network Structure
by: Liang, Ziyi, et al.
Published: (2022)

Permutation-Free High-Order Interaction Tests
by: Liu, Zhaolu, et al.
Published: (2025)

Testing Hypotheses of Covariate Effects on Topics of Discourse
by: Phelan, Gabriel, et al.
Published: (2025)

Synthetic-Powered Multiple Testing with FDR Control
by: Lee, Yonghoon, et al.
Published: (2026)

Data Fusion with Distributional Equivalence Test-then-pool
by: Yang, Linying, et al.
Published: (2026)

E-Valuating Classifier Two-Sample Tests
by: Pandeva, Teodora, et al.
Published: (2022)

Improving the Validity and Practical Usefulness of AI/ML Evaluations Using an Estimands Framework
by: Binette, Olivier, et al.
Published: (2024)

Adaptive Learn-then-Test: Statistically Valid and Efficient Hyperparameter Selection
by: Zecchin, Matteo, et al.
Published: (2024)

TRIP: A Nonparametric Test to Diagnose Biased Feature Importance Scores
by: Foote, Aaron, et al.
Published: (2025)

Testing Generalizability in Causal Inference
by: Manela, Daniel de Vassimon, et al.
Published: (2024)

LGB+: A Macroeconomic Forecasting Road Test
by: Coulombe, Philippe Goulet
Published: (2026)

Unified Conformalized Multiple Testing with Full Data Efficiency
by: Huo, Yuyang, et al.
Published: (2025)