Saved in:
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2503.15492 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917963056021504 |
|---|---|
| author | Holm, Benedikt Óskarsson, Arnar Þorleifsson, Björn Elvar Hafsteinsson, Hörður Þór Sigurðardóttir, Sigríður Grétarsdóttir, Heiður Hoelke, Kenan Jouan, Gabriel Marc Marie Penzel, Thomas Arnardottir, Erna Sif Óskarsdóttir, María |
| author_facet | Holm, Benedikt Óskarsson, Arnar Þorleifsson, Björn Elvar Hafsteinsson, Hörður Þór Sigurðardóttir, Sigríður Grétarsdóttir, Heiður Hoelke, Kenan Jouan, Gabriel Marc Marie Penzel, Thomas Arnardottir, Erna Sif Óskarsdóttir, María |
| contents | Manual scoring of polysomnography (PSG) is a time intensive task, prone to inter scorer variability that can impact diagnostic reliability. This study investigates the integration of decision support systems (DSS) into PSG scoring workflows, focusing on their effects on accuracy, scoring time, and potential biases toward recommendations from artificial intelligence (AI) compared to human generated recommendations. Using a novel online scoring platform, we conducted a repeated measures study with sleep technologists,
who scored traditional and self applied PSGs. Participants were occasionally presented with recommendations labeled as either human or AI generated. We found that traditional PSGs tended to be scored slightly more accurately than self applied PSGs, but this difference was not statistically significant. Correct recommendations significantly improved scoring accuracy for both PSG types, while incorrect recommendations reduced accuracy. No significant bias was observed toward or against AI generated recommendations compared to human generated recommendations. These findings highlight the potential of AI to enhance PSG scoring reliability. However, ensuring the accuracy of AI outputs is critical to maximizing its benefits. Future research should explore the long term impacts of DSS on scoring workflows and strategies for integrating AI in clinical practice. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_15492 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | World of ScoreCraft: Novel Multi Scorer Experiment on the Impact of a Decision Support System in Sleep Staging Holm, Benedikt Óskarsson, Arnar Þorleifsson, Björn Elvar Hafsteinsson, Hörður Þór Sigurðardóttir, Sigríður Grétarsdóttir, Heiður Hoelke, Kenan Jouan, Gabriel Marc Marie Penzel, Thomas Arnardottir, Erna Sif Óskarsdóttir, María Human-Computer Interaction Artificial Intelligence Manual scoring of polysomnography (PSG) is a time intensive task, prone to inter scorer variability that can impact diagnostic reliability. This study investigates the integration of decision support systems (DSS) into PSG scoring workflows, focusing on their effects on accuracy, scoring time, and potential biases toward recommendations from artificial intelligence (AI) compared to human generated recommendations. Using a novel online scoring platform, we conducted a repeated measures study with sleep technologists, who scored traditional and self applied PSGs. Participants were occasionally presented with recommendations labeled as either human or AI generated. We found that traditional PSGs tended to be scored slightly more accurately than self applied PSGs, but this difference was not statistically significant. Correct recommendations significantly improved scoring accuracy for both PSG types, while incorrect recommendations reduced accuracy. No significant bias was observed toward or against AI generated recommendations compared to human generated recommendations. These findings highlight the potential of AI to enhance PSG scoring reliability. However, ensuring the accuracy of AI outputs is critical to maximizing its benefits. Future research should explore the long term impacts of DSS on scoring workflows and strategies for integrating AI in clinical practice. |
| title | World of ScoreCraft: Novel Multi Scorer Experiment on the Impact of a Decision Support System in Sleep Staging |
| topic | Human-Computer Interaction Artificial Intelligence |
| url | https://arxiv.org/abs/2503.15492 |