Bayesian Joint Modeling of Interrater and Intrarater Reliability with Multilevel Data

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Hawila, Nour, Berg, Arthur
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911958623584256
author Hawila, Nour
Berg, Arthur
author_facet Hawila, Nour
Berg, Arthur
contents We formulate three generalized Bayesian models for analyzing interrater and intrarater reliability in the presence of multilevel data. Stan implementations of these models provide new estimates of interrater and intrarater reliability. We also derive formulas for calculating marginal correlations under each of the three models. Comparisons of the kappa estimates and marginal correlations across the different models are presented from two real-world datasets. Simulations demonstrate properties of the different measures of agreement under different model assumptions.
format Preprint
id arxiv_https___arxiv_org_abs_2407_12700
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Bayesian Joint Modeling of Interrater and Intrarater Reliability with Multilevel Data
Hawila, Nour
Berg, Arthur
Methodology
62F15 (Primary), 62J12 (Secondary), 62H12 (Secondary), 62P10 (Secondary)
We formulate three generalized Bayesian models for analyzing interrater and intrarater reliability in the presence of multilevel data. Stan implementations of these models provide new estimates of interrater and intrarater reliability. We also derive formulas for calculating marginal correlations under each of the three models. Comparisons of the kappa estimates and marginal correlations across the different models are presented from two real-world datasets. Simulations demonstrate properties of the different measures of agreement under different model assumptions.
title Bayesian Joint Modeling of Interrater and Intrarater Reliability with Multilevel Data
topic Methodology
62F15 (Primary), 62J12 (Secondary), 62H12 (Secondary), 62P10 (Secondary)
url https://arxiv.org/abs/2407.12700