Phrase-grounded Fact-checking for Automatically Generated Chest X-ray Reports
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866918148147511296 |
|---|---|
| author | Mahmood, Razi Machado-Reyes, Diego Wu, Joy Kaviani, Parisa Wong, Ken C. L. D'Souza, Niharika Kalra, Mannudeep Wang, Ge Yan, Pingkun Syeda-Mahmood, Tanveer |
| author_facet | Mahmood, Razi Machado-Reyes, Diego Wu, Joy Kaviani, Parisa Wong, Ken C. L. D'Souza, Niharika Kalra, Mannudeep Wang, Ge Yan, Pingkun Syeda-Mahmood, Tanveer |
| contents | With the emergence of large-scale vision language models (VLM), it is now possible to produce realistic-looking radiology reports for chest X-ray images. However, their clinical translation has been hampered by the factual errors and hallucinations in the produced descriptions during inference. In this paper, we present a novel phrase-grounded fact-checking model (FC model) that detects errors in findings and their indicated locations in automatically generated chest radiology reports.
Specifically, we simulate the errors in reports through a large synthetic dataset derived by perturbing findings and their locations in ground truth reports to form real and fake findings-location pairs with images. A new multi-label cross-modal contrastive regression network is then trained on this dataset. We present results demonstrating the robustness of our method in terms of accuracy of finding veracity prediction and localization on multiple X-ray datasets. We also show its effectiveness for error detection in reports of SOTA report generators on multiple datasets achieving a concordance correlation coefficient of 0.997 with ground truth-based verification, thus pointing to its utility during clinical inference in radiology workflows. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_21356 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Phrase-grounded Fact-checking for Automatically Generated Chest X-ray Reports Mahmood, Razi Machado-Reyes, Diego Wu, Joy Kaviani, Parisa Wong, Ken C. L. D'Souza, Niharika Kalra, Mannudeep Wang, Ge Yan, Pingkun Syeda-Mahmood, Tanveer Computer Vision and Pattern Recognition Artificial Intelligence With the emergence of large-scale vision language models (VLM), it is now possible to produce realistic-looking radiology reports for chest X-ray images. However, their clinical translation has been hampered by the factual errors and hallucinations in the produced descriptions during inference. In this paper, we present a novel phrase-grounded fact-checking model (FC model) that detects errors in findings and their indicated locations in automatically generated chest radiology reports. Specifically, we simulate the errors in reports through a large synthetic dataset derived by perturbing findings and their locations in ground truth reports to form real and fake findings-location pairs with images. A new multi-label cross-modal contrastive regression network is then trained on this dataset. We present results demonstrating the robustness of our method in terms of accuracy of finding veracity prediction and localization on multiple X-ray datasets. We also show its effectiveness for error detection in reports of SOTA report generators on multiple datasets achieving a concordance correlation coefficient of 0.997 with ground truth-based verification, thus pointing to its utility during clinical inference in radiology workflows. |
| title | Phrase-grounded Fact-checking for Automatically Generated Chest X-ray Reports |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence |
| url | https://arxiv.org/abs/2509.21356 |