LLM-Bootstrapped Targeted Finding Guidance for Factual MLLM-based Medical Report Generation
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2026
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866910035913736192 |
|---|---|
| author | Yang, Cunyuan Song, Dejuan Pang, Xiaotao Shen, Qianqian Nie, Wenjie Huang, Yifan Wu, Lei Han, Wei Wang, Haishuai Bu, Jiajun |
| author_facet | Yang, Cunyuan Song, Dejuan Pang, Xiaotao Shen, Qianqian Nie, Wenjie Huang, Yifan Wu, Lei Han, Wei Wang, Haishuai Bu, Jiajun |
| contents | The automatic generation of medical reports utilizing Multimodal Large Language Models (MLLMs) frequently encounters challenges related to factual instability, which may manifest as the omission of findings or the incorporation of inaccurate information, thereby constraining their applicability in clinical settings. Current methodologies typically produce reports based directly on image features, which inherently lack a definitive factual basis. In response to this limitation, we introduce Fact-Flow, an innovative framework that separates the process of visual fact identification from the generation of reports. This is achieved by initially predicting clinical findings from the image, which subsequently directs the MLLM to produce a report that is factually precise. A pivotal advancement of our approach is a pipeline that leverages a Large Language Model (LLM) to autonomously create a dataset of labeled medical findings, effectively eliminating the need for expensive manual annotation. Extensive experimental evaluations conducted on two disease-focused medical datasets validate the efficacy of our method, demonstrating a significant enhancement in factual accuracy compared to state-of-the-art models, while concurrently preserving high standards of text quality. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_00426 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | LLM-Bootstrapped Targeted Finding Guidance for Factual MLLM-based Medical Report Generation Yang, Cunyuan Song, Dejuan Pang, Xiaotao Shen, Qianqian Nie, Wenjie Huang, Yifan Wu, Lei Han, Wei Wang, Haishuai Bu, Jiajun Computation and Language Computer Vision and Pattern Recognition The automatic generation of medical reports utilizing Multimodal Large Language Models (MLLMs) frequently encounters challenges related to factual instability, which may manifest as the omission of findings or the incorporation of inaccurate information, thereby constraining their applicability in clinical settings. Current methodologies typically produce reports based directly on image features, which inherently lack a definitive factual basis. In response to this limitation, we introduce Fact-Flow, an innovative framework that separates the process of visual fact identification from the generation of reports. This is achieved by initially predicting clinical findings from the image, which subsequently directs the MLLM to produce a report that is factually precise. A pivotal advancement of our approach is a pipeline that leverages a Large Language Model (LLM) to autonomously create a dataset of labeled medical findings, effectively eliminating the need for expensive manual annotation. Extensive experimental evaluations conducted on two disease-focused medical datasets validate the efficacy of our method, demonstrating a significant enhancement in factual accuracy compared to state-of-the-art models, while concurrently preserving high standards of text quality. |
| title | LLM-Bootstrapped Targeted Finding Guidance for Factual MLLM-based Medical Report Generation |
| topic | Computation and Language Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2603.00426 |