Explainable fetal ultrasound quality assessment with progressive concept bottleneck models

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Lin, Manxi, Feragen, Aasa, Mikolaj, Kamil, Bashir, Zahra, Tolsgaard, Martin Grønnebæk, Christensen, Anders Nymark
Formato: Preprint
Publicado: 2022
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917944064212992
author Lin, Manxi
Feragen, Aasa
Mikolaj, Kamil
Bashir, Zahra
Tolsgaard, Martin Grønnebæk
Christensen, Anders Nymark
author_facet Lin, Manxi
Feragen, Aasa
Mikolaj, Kamil
Bashir, Zahra
Tolsgaard, Martin Grønnebæk
Christensen, Anders Nymark
contents The quality of fetal ultrasound screening scans directly influences the precision of biometric measurements. However, acquiring high-quality scans is labor-intensive and highly relies on the operator's skills. Considering the low contrastiveness and imaging artifacts that widely exist in ultrasound, even a dedicated deep-learning model can be vulnerable to learning from confounding information in the image. In this paper, we propose a holistic and explainable method for fetal ultrasound quality assessment, where we design a hierarchical concept bottleneck model by introducing human-readable ``concepts" into the task and imitating the sequential expert decision-making process. This hierarchical information flow forces the model to learn concepts from semantically meaningful areas: The model first passes through a layer of visual, segmentation-based concepts, and next a second layer of property concepts directly associated with the decision-making task. We consider the quality assessment to be in a more challenging but more realistic setting, with fine-grained image recognition. Experiments show that our model outperforms equivalent concept-free models on an in-house dataset, and shows better generalizability on two public benchmarks, one from Spain and one from Africa, without any fine-tuning.
format Preprint
id arxiv_https___arxiv_org_abs_2211_10630
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Explainable fetal ultrasound quality assessment with progressive concept bottleneck models
Lin, Manxi
Feragen, Aasa
Mikolaj, Kamil
Bashir, Zahra
Tolsgaard, Martin Grønnebæk
Christensen, Anders Nymark
Computer Vision and Pattern Recognition
Artificial Intelligence
The quality of fetal ultrasound screening scans directly influences the precision of biometric measurements. However, acquiring high-quality scans is labor-intensive and highly relies on the operator's skills. Considering the low contrastiveness and imaging artifacts that widely exist in ultrasound, even a dedicated deep-learning model can be vulnerable to learning from confounding information in the image. In this paper, we propose a holistic and explainable method for fetal ultrasound quality assessment, where we design a hierarchical concept bottleneck model by introducing human-readable ``concepts" into the task and imitating the sequential expert decision-making process. This hierarchical information flow forces the model to learn concepts from semantically meaningful areas: The model first passes through a layer of visual, segmentation-based concepts, and next a second layer of property concepts directly associated with the decision-making task. We consider the quality assessment to be in a more challenging but more realistic setting, with fine-grained image recognition. Experiments show that our model outperforms equivalent concept-free models on an in-house dataset, and shows better generalizability on two public benchmarks, one from Spain and one from Africa, without any fine-tuning.
title Explainable fetal ultrasound quality assessment with progressive concept bottleneck models
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2211.10630