Integrating Explainable AI in Medical Devices: Technical, Clinical and Regulatory Insights and Recommendations
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866910937371377664 |
|---|---|
| author | Alattal, Dima Azar, Asal Khoshravan Myles, Puja Branson, Richard Abdulhussein, Hatim Tucker, Allan |
| author_facet | Alattal, Dima Azar, Asal Khoshravan Myles, Puja Branson, Richard Abdulhussein, Hatim Tucker, Allan |
| contents | There is a growing demand for the use of Artificial Intelligence (AI) and Machine Learning (ML) in healthcare, particularly as clinical decision support systems to assist medical professionals. However, the complexity of many of these models, often referred to as black box models, raises concerns about their safe integration into clinical settings as it is difficult to understand how they arrived at their predictions. This paper discusses insights and recommendations derived from an expert working group convened by the UK Medicine and Healthcare products Regulatory Agency (MHRA). The group consisted of healthcare professionals, regulators, and data scientists, with a primary focus on evaluating the outputs from different AI algorithms in clinical decision-making contexts. Additionally, the group evaluated findings from a pilot study investigating clinicians' behaviour and interaction with AI methods during clinical diagnosis. Incorporating AI methods is crucial for ensuring the safety and trustworthiness of medical AI devices in clinical settings. Adequate training for stakeholders is essential to address potential issues, and further insights and recommendations for safely adopting AI systems in healthcare settings are provided. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_06620 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Integrating Explainable AI in Medical Devices: Technical, Clinical and Regulatory Insights and Recommendations Alattal, Dima Azar, Asal Khoshravan Myles, Puja Branson, Richard Abdulhussein, Hatim Tucker, Allan Human-Computer Interaction Artificial Intelligence H.5.2 There is a growing demand for the use of Artificial Intelligence (AI) and Machine Learning (ML) in healthcare, particularly as clinical decision support systems to assist medical professionals. However, the complexity of many of these models, often referred to as black box models, raises concerns about their safe integration into clinical settings as it is difficult to understand how they arrived at their predictions. This paper discusses insights and recommendations derived from an expert working group convened by the UK Medicine and Healthcare products Regulatory Agency (MHRA). The group consisted of healthcare professionals, regulators, and data scientists, with a primary focus on evaluating the outputs from different AI algorithms in clinical decision-making contexts. Additionally, the group evaluated findings from a pilot study investigating clinicians' behaviour and interaction with AI methods during clinical diagnosis. Incorporating AI methods is crucial for ensuring the safety and trustworthiness of medical AI devices in clinical settings. Adequate training for stakeholders is essential to address potential issues, and further insights and recommendations for safely adopting AI systems in healthcare settings are provided. |
| title | Integrating Explainable AI in Medical Devices: Technical, Clinical and Regulatory Insights and Recommendations |
| topic | Human-Computer Interaction Artificial Intelligence H.5.2 |
| url | https://arxiv.org/abs/2505.06620 |