Functional Post-Clustering Selective Inference with Applications to EHR Data Analysis

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zhu, Zihan, Gai, Xin, Zhang, Anru R.
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913342496440320
author Zhu, Zihan
Gai, Xin
Zhang, Anru R.
author_facet Zhu, Zihan
Gai, Xin
Zhang, Anru R.
contents In electronic health records (EHR) analysis, clustering patients according to patterns in their data is crucial for uncovering new subtypes of diseases. Existing medical literature often relies on classical hypothesis testing methods to test for differences in means between these clusters. Due to selection bias induced by clustering algorithms, the implementation of these classical methods on post-clustering data often leads to an inflated type-I error. In this paper, we introduce a new statistical approach that adjusts for this bias when analyzing data collected over time. Our method extends classical selective inference methods for cross-sectional data to longitudinal data. We provide theoretical guarantees for our approach with upper bounds on the selective type-I and type-II errors. We apply the method to simulated data and real-world Acute Kidney Injury (AKI) EHR datasets, thereby illustrating the advantages of our approach.
format Preprint
id arxiv_https___arxiv_org_abs_2405_03042
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Functional Post-Clustering Selective Inference with Applications to EHR Data Analysis
Zhu, Zihan
Gai, Xin
Zhang, Anru R.
Methodology
Applications
Computation
In electronic health records (EHR) analysis, clustering patients according to patterns in their data is crucial for uncovering new subtypes of diseases. Existing medical literature often relies on classical hypothesis testing methods to test for differences in means between these clusters. Due to selection bias induced by clustering algorithms, the implementation of these classical methods on post-clustering data often leads to an inflated type-I error. In this paper, we introduce a new statistical approach that adjusts for this bias when analyzing data collected over time. Our method extends classical selective inference methods for cross-sectional data to longitudinal data. We provide theoretical guarantees for our approach with upper bounds on the selective type-I and type-II errors. We apply the method to simulated data and real-world Acute Kidney Injury (AKI) EHR datasets, thereby illustrating the advantages of our approach.
title Functional Post-Clustering Selective Inference with Applications to EHR Data Analysis
topic Methodology
Applications
Computation
url https://arxiv.org/abs/2405.03042