Saved in:
Bibliographic Details
Main Authors: Kraft, Stefan, Theissler, Andreas, Wienhausen-Wilke, Vera, Walter, Philipp, Kasneci, Gjergji
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2409.13367
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913509771575296
author Kraft, Stefan
Theissler, Andreas
Wienhausen-Wilke, Vera
Walter, Philipp
Kasneci, Gjergji
author_facet Kraft, Stefan
Theissler, Andreas
Wienhausen-Wilke, Vera
Walter, Philipp
Kasneci, Gjergji
contents Detecting arousals in sleep is essential for diagnosing sleep disorders. However, using Machine Learning (ML) in clinical practice is impeded by fundamental issues, primarily due to mismatches between clinical protocols and ML methods. Clinicians typically annotate only the onset of arousals, while ML methods rely on annotations for both the beginning and end. Additionally, there is no standardized evaluation methodology tailored to clinical needs for arousal detection models. This work addresses these issues by introducing a novel post-processing and evaluation framework emphasizing approximate localization and precise event count (ALPEC) of arousals. We recommend that ML practitioners focus on detecting arousal onsets, aligning with clinical practice. We examine the impact of this shift on current training and evaluation schemes, addressing simplifications and challenges. We utilize a novel comprehensive polysomnographic dataset (CPS) that reflects the aforementioned clinical annotation constraints and includes modalities not present in existing polysomnographic datasets. We release the dataset alongside this paper, demonstrating the benefits of leveraging multimodal data for arousal onset detection. Our findings significantly contribute to integrating ML-based arousal detection in clinical settings, reducing the gap between technological advancements and clinical needs.
format Preprint
id arxiv_https___arxiv_org_abs_2409_13367
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle ALPEC: A Comprehensive Evaluation Framework and Dataset for Machine Learning-Based Arousal Detection in Clinical Practice
Kraft, Stefan
Theissler, Andreas
Wienhausen-Wilke, Vera
Walter, Philipp
Kasneci, Gjergji
Machine Learning
I.2
Detecting arousals in sleep is essential for diagnosing sleep disorders. However, using Machine Learning (ML) in clinical practice is impeded by fundamental issues, primarily due to mismatches between clinical protocols and ML methods. Clinicians typically annotate only the onset of arousals, while ML methods rely on annotations for both the beginning and end. Additionally, there is no standardized evaluation methodology tailored to clinical needs for arousal detection models. This work addresses these issues by introducing a novel post-processing and evaluation framework emphasizing approximate localization and precise event count (ALPEC) of arousals. We recommend that ML practitioners focus on detecting arousal onsets, aligning with clinical practice. We examine the impact of this shift on current training and evaluation schemes, addressing simplifications and challenges. We utilize a novel comprehensive polysomnographic dataset (CPS) that reflects the aforementioned clinical annotation constraints and includes modalities not present in existing polysomnographic datasets. We release the dataset alongside this paper, demonstrating the benefits of leveraging multimodal data for arousal onset detection. Our findings significantly contribute to integrating ML-based arousal detection in clinical settings, reducing the gap between technological advancements and clinical needs.
title ALPEC: A Comprehensive Evaluation Framework and Dataset for Machine Learning-Based Arousal Detection in Clinical Practice
topic Machine Learning
I.2
url https://arxiv.org/abs/2409.13367