Image de couverture de livre

Over-optimism in benchmark studies and the multiplicity of design and analysis options when interpreting their results

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Nießl, Christina, Herrmann, Moritz, Wiedemann, Chiara, Casalicchio, Giuseppe, Boulesteix, Anne-Laure
Format:	Preprint
Publié:	2021
Sujets:	Methodology
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Explaining the optimistic performance evaluation of newly proposed methods: a cross-design validation experiment
par: Nießl, Christina, et autres
Publié: (2022)

Rethinking the handling of method failure in comparison studies
par: Wünsch, Milena, et autres
Publié: (2024)

On "Confirmatory" Methodological Research in Statistics and Related Fields
par: Lange, F. J. D., et autres
Publié: (2025)

Statistical parametric simulation studies based on real data
par: Sauer, Christina, et autres
Publié: (2025)

Outlier Detection in Mendelian Randomisation
par: Mandl, Maximilian M, et autres
Publié: (2025)

Beyond algorithm hyperparameters: on preprocessing hyperparameters and associated pitfalls in machine learning applications
par: Sauer, Christina, et autres
Publié: (2024)

permApprox: a general framework for accurate permutation p-value approximation
par: Peschel, Stefanie, et autres
Publié: (2026)

Understanding overfitting in random forest for probability estimation: a visualization and simulation study
par: Barreñada, Lasai, et autres
Publié: (2024)

To tweak or not to tweak. How exploiting flexibilities in gene set analysis leads to over-optimism
par: Wünsch, Milena, et autres
Publié: (2024)

Addressing researcher degrees of freedom through minP adjustment
par: Mandl, Maximilian M, et autres
Publié: (2024)

Communicating results in trials with multiple hypotheses or adaptive design features
par: Asikanius, Elina, et autres
Publié: (2026)

How trace plots help interpret meta-analysis results
par: Röver, Christian, et autres
Publié: (2023)

Transportability of aggregate trial results to an external environment in causally interpretable meta-analysis
par: Le, Tran Trong Khoi, et autres
Publié: (2024)

Accounting for multiplicity in machine learning benchmark performance
par: Møllersen, Kajsa, et autres
Publié: (2023)

A maximin optimal approach for sampling designs in two-phase studies
par: Wang, Ruoyu, et autres
Publié: (2023)

Gibbs optimal design of experiments
par: Overstall, Antony M., et autres
Publié: (2023)

Causal interpretation of the sibling comparison and its relation to the cross-over design
par: Kristensen, Simon Bang, et autres
Publié: (2025)

Revisiting the apparent discrepancy between the frequentist and Bayesian interpretation of an adaptive design
par: Kristensen, Simon Bang, et autres
Publié: (2025)

Single CASANOVA? Not in multiple comparisons
par: Dormuth, Ina, et autres
Publié: (2024)

To Tweak or Not to Tweak. How Exploiting Flexibilities in Gene Set Analysis Leads to Overoptimism
par: Milena Wünsch, et autres
Publié: (2024)

CVXSADes: a stochastic algorithm for constructing optimal exact regression designs with single or multiple objectives
par: Yeh, Chi-Kuang, et autres
Publié: (2024)

Two-level D- and A-optimal designs of Ehlich type with run sizes three more than a multiple of four
par: Hameed, Mohammed Saif Ismail, et autres
Publié: (2025)

Identifiable and interpretable nonparametric factor analysis
par: Xu, Maoran, et autres
Publié: (2023)

A Guide to Feature Importance Methods for Scientific Inference
par: Ewald, Fiona Katharina, et autres
Publié: (2024)

A Simulation Study to Compare Inferential Properties when Modelling Ordinal Outcomes: The Case for the (Plain but Robust) Proportional Odds Model
par: Inerle, Stefan, et autres
Publié: (2026)

Low-order outcomes and clustered designs: combining design and analysis for causal inference under network interference
par: Eichhorn, Matthew, et autres
Publié: (2024)

Do-search -- a tool for causal inference and study design with multiple data sources
par: Karvanen, Juha, et autres
Publié: (2020)

Transporting results from a trial to an external target population when trial participation impacts adherence
par: Ross, Rachael K., et autres
Publié: (2025)

Estimands and cumulative incidence function regression in clinical trials: some new results on interpretability and robustness
par: Bühler, Alexandra, et autres
Publié: (2024)

Causally-interpretable meta-analysis using aggregate data
par: Shi, Qingyang, et autres
Publié: (2026)

Two-level D- and A-optimal main-effects designs with run sizes one and two more than a multiple of four
par: Hameed, Mohammed Saif Ismail, et autres
Publié: (2024)

An adaptive design for optimizing treatment assignment in randomized clinical trials
par: Zhang, Wei, et autres
Publié: (2025)

Fixed-budget optimal designs for multi-fidelity computer experiments
par: Chen, Gecheng, et autres
Publié: (2024)

Utility-based optimization of Fujikawa's basket trial design -- Pre-specified protocol of a comparison study
par: Sauer, Lukas D, et autres
Publié: (2024)

Estimating optimal interpretable individualized treatment regimes from a classification perspective using adaptive LASSO
par: Zhang, Yunshu, et autres
Publié: (2026)

A Bayesian design for dual-agent dose optimization with targeted therapies
par: Jiménez, José L., et autres
Publié: (2022)

Integration of aggregated data in causally interpretable meta-analysis by inverse weighting
par: Vo, Tat-Thang, et autres
Publié: (2025)

A general, flexible and harmonious framework to construct interpretable functions in regression analysis
par: Zhan, Tianyu, et autres
Publié: (2025)

Optimal two-phase sampling designs for generalized raking estimators with multiple parameters of interest
par: Yang, Jasper B., et autres
Publié: (2025)

Moving toward best practice when using propensity score weighting in survey observational studies
par: Zeng, Yukang, et autres
Publié: (2025)