Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2602.12004 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911443138379776 |
|---|---|
| author | Cronshaw, Robert Vilouras, Konstantinos Yan, Junyu Du, Yuning Chen, Feng McDonagh, Steven Tsaftaris, Sotirios A. |
| author_facet | Cronshaw, Robert Vilouras, Konstantinos Yan, Junyu Du, Yuning Chen, Feng McDonagh, Steven Tsaftaris, Sotirios A. |
| contents | Text-to-image generation has been increasingly applied in medical domains for various purposes such as data augmentation and education. Evaluating the quality and clinical reliability of these generated images is essential. However, existing methods mainly assess image realism or diversity, while failing to capture whether the generated images reflect the intended clinical semantics, such as anatomical location and pathology. In this study, we propose the Clinical Semantics Evaluator (CSEval), a framework that leverages language models to assess clinical semantic alignment between the generated images and their conditioning prompts. Our experiments show that CSEval identifies semantic inconsistencies overlooked by other metrics and correlates with expert judgment. CSEval provides a scalable and clinically meaningful complement to existing evaluation methods, supporting the safe adoption of generative models in healthcare. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_12004 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | CSEval: A Framework for Evaluating Clinical Semantics in Text-to-Image Generation Cronshaw, Robert Vilouras, Konstantinos Yan, Junyu Du, Yuning Chen, Feng McDonagh, Steven Tsaftaris, Sotirios A. Artificial Intelligence Text-to-image generation has been increasingly applied in medical domains for various purposes such as data augmentation and education. Evaluating the quality and clinical reliability of these generated images is essential. However, existing methods mainly assess image realism or diversity, while failing to capture whether the generated images reflect the intended clinical semantics, such as anatomical location and pathology. In this study, we propose the Clinical Semantics Evaluator (CSEval), a framework that leverages language models to assess clinical semantic alignment between the generated images and their conditioning prompts. Our experiments show that CSEval identifies semantic inconsistencies overlooked by other metrics and correlates with expert judgment. CSEval provides a scalable and clinically meaningful complement to existing evaluation methods, supporting the safe adoption of generative models in healthcare. |
| title | CSEval: A Framework for Evaluating Clinical Semantics in Text-to-Image Generation |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2602.12004 |