Saved in:
Bibliographic Details
Main Authors: Sun, Yujia, Han, Yang, Wang, Xingya, Tang, Szu-Yu, Liu, Yushi, Hsu, Jason C.
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2510.23799
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917047658610688
author Sun, Yujia
Han, Yang
Wang, Xingya
Tang, Szu-Yu
Liu, Yushi
Hsu, Jason C.
author_facet Sun, Yujia
Han, Yang
Wang, Xingya
Tang, Szu-Yu
Liu, Yushi
Hsu, Jason C.
contents Transitioning from Phase 2 to Phase 3 in drug development, at a rate of $\approx$40%, is the most stringent among phase transitions (Hay et al. (2014)). Yet, success rate at Phase 3 leading to approval is only $\approx$50% (Arrowsmith (2011b)). To improve Confirmability, we propose a methodological shift: replacing multiple hypothesis testing with inference based on confidence sets, and substituting conventional power and sample size calculations with a Confidently Bounded Quantile (CBQ) framework. Our confidence set inferences to answer the questions of whether to transition to a Confirmatory study as well as what to designate as the endpoint in that study. Construction of our directed confidence sets follows the Partitioning Principle, taking the best of each of Pivoting and Neyman Confidence Set Construction. Rooted in Tukey's Confidently Bounded Allowance (CBA) (Tukey (1994a)), our proposed CBQ makes the transitioning decision following the Correct and Useful Inference principle in Hsu (1996). CBQ removes from "power" the probability of rejecting for wrong reasons, eliminating the need for informal discounting in power calculation that has existed in the biopharmaceutical industry. ETZ, the modeling principle proposed in Wang et al. (2025), quantifies the impact of three variability components on confirmability. In repeated-measures RCTs, it separates within-subject and between-subject variability, further dividing the latter into baseline and trajectory components. This enables informed investment decisions for the sponsors on targeting variability reduction to improve confirmability. A Shiny-based Confirmability App supports all computations.
format Preprint
id arxiv_https___arxiv_org_abs_2510_23799
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle ETZ: A Modeling Principle for Confirmability of Drug-Development Studies
Sun, Yujia
Han, Yang
Wang, Xingya
Tang, Szu-Yu
Liu, Yushi
Hsu, Jason C.
Methodology
Transitioning from Phase 2 to Phase 3 in drug development, at a rate of $\approx$40%, is the most stringent among phase transitions (Hay et al. (2014)). Yet, success rate at Phase 3 leading to approval is only $\approx$50% (Arrowsmith (2011b)). To improve Confirmability, we propose a methodological shift: replacing multiple hypothesis testing with inference based on confidence sets, and substituting conventional power and sample size calculations with a Confidently Bounded Quantile (CBQ) framework. Our confidence set inferences to answer the questions of whether to transition to a Confirmatory study as well as what to designate as the endpoint in that study. Construction of our directed confidence sets follows the Partitioning Principle, taking the best of each of Pivoting and Neyman Confidence Set Construction. Rooted in Tukey's Confidently Bounded Allowance (CBA) (Tukey (1994a)), our proposed CBQ makes the transitioning decision following the Correct and Useful Inference principle in Hsu (1996). CBQ removes from "power" the probability of rejecting for wrong reasons, eliminating the need for informal discounting in power calculation that has existed in the biopharmaceutical industry. ETZ, the modeling principle proposed in Wang et al. (2025), quantifies the impact of three variability components on confirmability. In repeated-measures RCTs, it separates within-subject and between-subject variability, further dividing the latter into baseline and trajectory components. This enables informed investment decisions for the sponsors on targeting variability reduction to improve confirmability. A Shiny-based Confirmability App supports all computations.
title ETZ: A Modeling Principle for Confirmability of Drug-Development Studies
topic Methodology
url https://arxiv.org/abs/2510.23799