RadIR: A Scalable Framework for Multi-Grained Medical Image Retrieval via Radiology Report Mining
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866912477917216768 |
|---|---|
| author | Zhang, Tengfei Zhao, Ziheng Wu, Chaoyi Zhou, Xiao Zhang, Ya Wang, Yanfeng Xie, Weidi |
| author_facet | Zhang, Tengfei Zhao, Ziheng Wu, Chaoyi Zhou, Xiao Zhang, Ya Wang, Yanfeng Xie, Weidi |
| contents | Developing advanced medical imaging retrieval systems is challenging due to the varying definitions of `similar images' across different medical contexts. This challenge is compounded by the lack of large-scale, high-quality medical imaging retrieval datasets and benchmarks. In this paper, we propose a novel methodology that leverages dense radiology reports to define image-wise similarity ordering at multiple granularities in a scalable and fully automatic manner. Using this approach, we construct two comprehensive medical imaging retrieval datasets: MIMIC-IR for Chest X-rays and CTRATE-IR for CT scans, providing detailed image-image ranking annotations conditioned on diverse anatomical structures. Furthermore, we develop two retrieval systems, RadIR-CXR and model-ChestCT, which demonstrate superior performance in traditional image-image and image-report retrieval tasks. These systems also enable flexible, effective image retrieval conditioned on specific anatomical structures described in text, achieving state-of-the-art results on 77 out of 78 metrics. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_04653 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | RadIR: A Scalable Framework for Multi-Grained Medical Image Retrieval via Radiology Report Mining Zhang, Tengfei Zhao, Ziheng Wu, Chaoyi Zhou, Xiao Zhang, Ya Wang, Yanfeng Xie, Weidi Computer Vision and Pattern Recognition Information Retrieval Image and Video Processing Developing advanced medical imaging retrieval systems is challenging due to the varying definitions of `similar images' across different medical contexts. This challenge is compounded by the lack of large-scale, high-quality medical imaging retrieval datasets and benchmarks. In this paper, we propose a novel methodology that leverages dense radiology reports to define image-wise similarity ordering at multiple granularities in a scalable and fully automatic manner. Using this approach, we construct two comprehensive medical imaging retrieval datasets: MIMIC-IR for Chest X-rays and CTRATE-IR for CT scans, providing detailed image-image ranking annotations conditioned on diverse anatomical structures. Furthermore, we develop two retrieval systems, RadIR-CXR and model-ChestCT, which demonstrate superior performance in traditional image-image and image-report retrieval tasks. These systems also enable flexible, effective image retrieval conditioned on specific anatomical structures described in text, achieving state-of-the-art results on 77 out of 78 metrics. |
| title | RadIR: A Scalable Framework for Multi-Grained Medical Image Retrieval via Radiology Report Mining |
| topic | Computer Vision and Pattern Recognition Information Retrieval Image and Video Processing |
| url | https://arxiv.org/abs/2503.04653 |