Subgroup Performance of a Commercial Digital Breast Tomosynthesis Model for Breast Cancer Detection
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910880062504960 |
|---|---|
| author | Brown-Mulry, Beatrice Isaac, Rohan Satya Lee, Sang Hyup Seth, Ambika Min, KyungJee Dapamede, Theo Li, Frank Mansuri, Aawez Woo, MinJae Fauria-Robinson, Christian Allison Paryani, Bhavna Gichoya, Judy Wawira Trivedi, Hari |
| author_facet | Brown-Mulry, Beatrice Isaac, Rohan Satya Lee, Sang Hyup Seth, Ambika Min, KyungJee Dapamede, Theo Li, Frank Mansuri, Aawez Woo, MinJae Fauria-Robinson, Christian Allison Paryani, Bhavna Gichoya, Judy Wawira Trivedi, Hari |
| contents | While research has established the potential of AI models for mammography to improve breast cancer screening outcomes, there have not been any detailed subgroup evaluations performed to assess the strengths and weaknesses of commercial models for digital breast tomosynthesis (DBT) imaging. This study presents a granular evaluation of the Lunit INSIGHT DBT model on a large retrospective cohort of 163,449 screening mammography exams from the Emory Breast Imaging Dataset (EMBED). Model performance was evaluated in a binary context with various negative exam types (162,081 exams) compared against screen detected cancers (1,368 exams) as the positive class. The analysis was stratified across demographic, imaging, and pathologic subgroups to identify potential disparities. The model achieved an overall AUC of 0.91 (95% CI: 0.90-0.92) with a precision of 0.08 (95% CI: 0.08-0.08), and a recall of 0.73 (95% CI: 0.71-0.76). Performance was found to be robust across demographics, but cases with non-invasive cancers (AUC: 0.85, 95% CI: 0.83-0.87), calcifications (AUC: 0.80, 95% CI: 0.78-0.82), and dense breast tissue (AUC: 0.90, 95% CI: 0.88-0.91) were associated with significantly lower performance compared to other groups. These results highlight the need for detailed evaluation of model characteristics and vigilance in considering adoption of new tools for clinical deployment. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_13581 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Subgroup Performance of a Commercial Digital Breast Tomosynthesis Model for Breast Cancer Detection Brown-Mulry, Beatrice Isaac, Rohan Satya Lee, Sang Hyup Seth, Ambika Min, KyungJee Dapamede, Theo Li, Frank Mansuri, Aawez Woo, MinJae Fauria-Robinson, Christian Allison Paryani, Bhavna Gichoya, Judy Wawira Trivedi, Hari Image and Video Processing Computer Vision and Pattern Recognition While research has established the potential of AI models for mammography to improve breast cancer screening outcomes, there have not been any detailed subgroup evaluations performed to assess the strengths and weaknesses of commercial models for digital breast tomosynthesis (DBT) imaging. This study presents a granular evaluation of the Lunit INSIGHT DBT model on a large retrospective cohort of 163,449 screening mammography exams from the Emory Breast Imaging Dataset (EMBED). Model performance was evaluated in a binary context with various negative exam types (162,081 exams) compared against screen detected cancers (1,368 exams) as the positive class. The analysis was stratified across demographic, imaging, and pathologic subgroups to identify potential disparities. The model achieved an overall AUC of 0.91 (95% CI: 0.90-0.92) with a precision of 0.08 (95% CI: 0.08-0.08), and a recall of 0.73 (95% CI: 0.71-0.76). Performance was found to be robust across demographics, but cases with non-invasive cancers (AUC: 0.85, 95% CI: 0.83-0.87), calcifications (AUC: 0.80, 95% CI: 0.78-0.82), and dense breast tissue (AUC: 0.90, 95% CI: 0.88-0.91) were associated with significantly lower performance compared to other groups. These results highlight the need for detailed evaluation of model characteristics and vigilance in considering adoption of new tools for clinical deployment. |
| title | Subgroup Performance of a Commercial Digital Breast Tomosynthesis Model for Breast Cancer Detection |
| topic | Image and Video Processing Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2503.13581 |