Overcoming Model Uncertainty — How Equivalence Tests Can Benefit From Model Averaging

Fuente: Wiley Open Access
Salvato in:
Dettagli Bibliografici
Autori principali: Niklas Hagemann, Kathrin Möllenhoff
Natura: Artículo Open Access
Pubblicazione: Wiley 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1867017324396019712
author Niklas Hagemann
Kathrin Möllenhoff
author_facet Niklas Hagemann
Kathrin Möllenhoff
Niklas Hagemann
Kathrin Möllenhoff
collection Wiley Open Access
contents Overcoming Model Uncertainty — How Equivalence Tests Can Benefit From Model Averaging Niklas Hagemann Kathrin Möllenhoff Statistics in Medicine ABSTRACTA common problem in numerous research areas, particularly in clinical trials, is to test whether the effect of an explanatory variable on an outcome variable is equivalent across different groups. In practice, these tests are frequently used to compare the effect between patient groups, for example, based on gender, age, or treatments. Equivalence is usually assessed by testing whether the difference between the groups does not exceed a pre‐specified equivalence threshold. Classical approaches are based on testing the equivalence of single quantities, for example, the mean, the area under the curve or other values of interest. However, when differences depending on a particular covariate are observed, these approaches can turn out to be not very accurate. Instead, whole regression curves over the entire covariate range, describing for instance the time window or a dose range, are considered and tests are based on a suitable distance measure of two such curves, as, for example, the maximum absolute distance between them. In this regard, a key assumption is that the true underlying regression models are known, which is rarely the case in practice. However, misspecification can lead to severe problems as inflated type I errors or, on the other hand, conservative test procedures. In this paper, we propose a solution to this problem by introducing a flexible extension of such an equivalence test using model averaging in order to overcome this assumption and making the test applicable under model uncertainty. Precisely, we introduce model averaging based on smooth Bayesian information criterion weights and we propose a testing procedure which makes use of the duality between confidence intervals and hypothesis testing. We demonstrate the validity of our approach by means of a simulation study and illustrate its practical relevance considering a time‐response case study with toxicological gene expression data. 10.1002/sim.10309 http://creativecommons.org/licenses/by/4.0/
doi_str_mv 10.1002/sim.10309
format Artículo Open Access
id wiley_oa_10_1002_sim_10309
institution Wiley Open Access
license_str_mv http://creativecommons.org/licenses/by/4.0/
publishDate 2025
publisher Wiley
record_format wiley_oa
spellingShingle Overcoming Model Uncertainty — How Equivalence Tests Can Benefit From Model Averaging
Niklas Hagemann
Kathrin Möllenhoff
Statistics in Medicine
Overcoming Model Uncertainty — How Equivalence Tests Can Benefit From Model Averaging Niklas Hagemann Kathrin Möllenhoff Statistics in Medicine ABSTRACTA common problem in numerous research areas, particularly in clinical trials, is to test whether the effect of an explanatory variable on an outcome variable is equivalent across different groups. In practice, these tests are frequently used to compare the effect between patient groups, for example, based on gender, age, or treatments. Equivalence is usually assessed by testing whether the difference between the groups does not exceed a pre‐specified equivalence threshold. Classical approaches are based on testing the equivalence of single quantities, for example, the mean, the area under the curve or other values of interest. However, when differences depending on a particular covariate are observed, these approaches can turn out to be not very accurate. Instead, whole regression curves over the entire covariate range, describing for instance the time window or a dose range, are considered and tests are based on a suitable distance measure of two such curves, as, for example, the maximum absolute distance between them. In this regard, a key assumption is that the true underlying regression models are known, which is rarely the case in practice. However, misspecification can lead to severe problems as inflated type I errors or, on the other hand, conservative test procedures. In this paper, we propose a solution to this problem by introducing a flexible extension of such an equivalence test using model averaging in order to overcome this assumption and making the test applicable under model uncertainty. Precisely, we introduce model averaging based on smooth Bayesian information criterion weights and we propose a testing procedure which makes use of the duality between confidence intervals and hypothesis testing. We demonstrate the validity of our approach by means of a simulation study and illustrate its practical relevance considering a time‐response case study with toxicological gene expression data. 10.1002/sim.10309 http://creativecommons.org/licenses/by/4.0/
title Overcoming Model Uncertainty — How Equivalence Tests Can Benefit From Model Averaging
topic Statistics in Medicine
url https://onlinelibrary.wiley.com/doi/10.1002/sim.10309