Saved in:
Bibliographic Details
Main Authors: Selman, Chris J., Lee, Katherine J., Tong, Steven Y. C., Jones, Mark, Mahar, Robert K.
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2507.21473
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912508031270912
author Selman, Chris J.
Lee, Katherine J.
Tong, Steven Y. C.
Jones, Mark
Mahar, Robert K.
author_facet Selman, Chris J.
Lee, Katherine J.
Tong, Steven Y. C.
Jones, Mark
Mahar, Robert K.
contents Background: The proportional odds (PO) model is the most common analytic method for ordinal outcomes in randomised controlled trials. While parameter estimates obtained under departures from PO can be interpreted as an average odds ratio, they can obscure differing treatment effects across the distribution of the ordinal categories. Extensions to the PO model exist and this work evaluates their performance under deviations to the PO assumption. Methods: We evaluated the bias, coverage and mean square error of four modeling approaches for ordinal outcomes via Monte Carlo simulation. Specifically, independent logistic regression models, the PO model, and constrained and unconstrained partial proportional odds (PPO) models were fit to simulated ordinal outcome data. The simulated data were designed to represent a hypothetical two-arm randomised trial under a range of scenarios. Additionally, we report on a case study; an Australasian COVID-19 Trial that adopted multiple secondary ordinal endpoints. Results: The PO model performed best when the data are generated under PO, as expected, but can result in bias and poor coverage in the presence of non-PO, particularly with increasing effect size and number of categories. The odds ratios (ORs) estimated using the unconstrained PPO and separate logistic regression models in the presence of non-PO had negligible bias and good coverage across most scenarios. The unconstrained PPO model under-performed when there was sparse data within some categories. Conclusions: While the PO model is effective when PO holds, the unconstrained and constrained PPO and logistic regression models provide unbiased and efficient estimates under non-PO conditions.
format Preprint
id arxiv_https___arxiv_org_abs_2507_21473
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Evaluating the performance of Bayesian cumulative logistic models in randomised controlled trials: a simulation study
Selman, Chris J.
Lee, Katherine J.
Tong, Steven Y. C.
Jones, Mark
Mahar, Robert K.
Methodology
Background: The proportional odds (PO) model is the most common analytic method for ordinal outcomes in randomised controlled trials. While parameter estimates obtained under departures from PO can be interpreted as an average odds ratio, they can obscure differing treatment effects across the distribution of the ordinal categories. Extensions to the PO model exist and this work evaluates their performance under deviations to the PO assumption. Methods: We evaluated the bias, coverage and mean square error of four modeling approaches for ordinal outcomes via Monte Carlo simulation. Specifically, independent logistic regression models, the PO model, and constrained and unconstrained partial proportional odds (PPO) models were fit to simulated ordinal outcome data. The simulated data were designed to represent a hypothetical two-arm randomised trial under a range of scenarios. Additionally, we report on a case study; an Australasian COVID-19 Trial that adopted multiple secondary ordinal endpoints. Results: The PO model performed best when the data are generated under PO, as expected, but can result in bias and poor coverage in the presence of non-PO, particularly with increasing effect size and number of categories. The odds ratios (ORs) estimated using the unconstrained PPO and separate logistic regression models in the presence of non-PO had negligible bias and good coverage across most scenarios. The unconstrained PPO model under-performed when there was sparse data within some categories. Conclusions: While the PO model is effective when PO holds, the unconstrained and constrained PPO and logistic regression models provide unbiased and efficient estimates under non-PO conditions.
title Evaluating the performance of Bayesian cumulative logistic models in randomised controlled trials: a simulation study
topic Methodology
url https://arxiv.org/abs/2507.21473