CheXalign: Preference fine-tuning in chest X-ray interpretation models without human feedback
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866912515379691520 |
|---|---|
| author | Hein, Dennis Chen, Zhihong Ostmeier, Sophie Xu, Justin Varma, Maya Reis, Eduardo Pontes Michalson, Arne Edward Bluethgen, Christian Shin, Hyun Joo Langlotz, Curtis Chaudhari, Akshay S |
| author_facet | Hein, Dennis Chen, Zhihong Ostmeier, Sophie Xu, Justin Varma, Maya Reis, Eduardo Pontes Michalson, Arne Edward Bluethgen, Christian Shin, Hyun Joo Langlotz, Curtis Chaudhari, Akshay S |
| contents | Radiologists play a crucial role in translating medical images into actionable reports. However, the field faces staffing shortages and increasing workloads. While automated approaches using vision-language models (VLMs) show promise as assistants, they require exceptionally high accuracy. Most current VLMs in radiology rely solely on supervised fine-tuning. Meanwhile, additional preference fine-tuning in the post-training pipeline has become standard practice in the general domain. The challenge in radiology lies in the prohibitive cost of obtaining radiologist feedback at scale. To address this challenge, we propose an automated pipeline for preference feedback, focusing on chest X-ray radiology report generation (RRG). Specifically, our method leverages publicly available datasets containing pairs of images and radiologist-written reference reports with reference-based metrics, or Judges, eliminating the need for additional radiologist feedback. We investigate reward overoptimization via length exploitation in this setting and introduce a length-controlled version of the GREEN score. Our best-performing setup achieves state-of-the-art CheXbert scores on the MIMIC-CXR dataset for the RRG task while on average maintaining robust performance across six additional image perception and reasoning tasks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_07025 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | CheXalign: Preference fine-tuning in chest X-ray interpretation models without human feedback Hein, Dennis Chen, Zhihong Ostmeier, Sophie Xu, Justin Varma, Maya Reis, Eduardo Pontes Michalson, Arne Edward Bluethgen, Christian Shin, Hyun Joo Langlotz, Curtis Chaudhari, Akshay S Computer Vision and Pattern Recognition Computation and Language Radiologists play a crucial role in translating medical images into actionable reports. However, the field faces staffing shortages and increasing workloads. While automated approaches using vision-language models (VLMs) show promise as assistants, they require exceptionally high accuracy. Most current VLMs in radiology rely solely on supervised fine-tuning. Meanwhile, additional preference fine-tuning in the post-training pipeline has become standard practice in the general domain. The challenge in radiology lies in the prohibitive cost of obtaining radiologist feedback at scale. To address this challenge, we propose an automated pipeline for preference feedback, focusing on chest X-ray radiology report generation (RRG). Specifically, our method leverages publicly available datasets containing pairs of images and radiologist-written reference reports with reference-based metrics, or Judges, eliminating the need for additional radiologist feedback. We investigate reward overoptimization via length exploitation in this setting and introduce a length-controlled version of the GREEN score. Our best-performing setup achieves state-of-the-art CheXbert scores on the MIMIC-CXR dataset for the RRG task while on average maintaining robust performance across six additional image perception and reasoning tasks. |
| title | CheXalign: Preference fine-tuning in chest X-ray interpretation models without human feedback |
| topic | Computer Vision and Pattern Recognition Computation and Language |
| url | https://arxiv.org/abs/2410.07025 |