Weakly Supervised Fine-grained Span-Level Framework for Chinese Radiology Report Quality Assurance

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Kaiyu, Mu, Lin, Yang, Zhiyao, Li, Ximing, Gao, Xiaotang Zhou Wanfu, Zhang, Huimao
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908511185666048
author Wang, Kaiyu
Mu, Lin
Yang, Zhiyao
Li, Ximing
Gao, Xiaotang Zhou Wanfu
Zhang, Huimao
author_facet Wang, Kaiyu
Mu, Lin
Yang, Zhiyao
Li, Ximing
Gao, Xiaotang Zhou Wanfu
Zhang, Huimao
contents Quality Assurance (QA) for radiology reports refers to judging whether the junior reports (written by junior doctors) are qualified. The QA scores of one junior report are given by the senior doctor(s) after reviewing the image and junior report. This process requires intensive labor costs for senior doctors. Additionally, the QA scores may be inaccurate for reasons like diagnosis bias, the ability of senior doctors, and so on. To address this issue, we propose a Span-level Quality Assurance EvaluaTOR (Sqator) to mark QA scores automatically. Unlike the common document-level semantic comparison method, we try to analyze the semantic difference by exploring more fine-grained text spans. Specifically, Sqator measures QA scores by measuring the importance of revised spans between junior and senior reports, and outputs the final QA scores by merging all revised span scores. We evaluate Sqator using a collection of 12,013 radiology reports. Experimental results show that Sqator can achieve competitive QA scores. Moreover, the importance scores of revised spans can be also consistent with the judgments of senior doctors.
format Preprint
id arxiv_https___arxiv_org_abs_2508_08876
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Weakly Supervised Fine-grained Span-Level Framework for Chinese Radiology Report Quality Assurance
Wang, Kaiyu
Mu, Lin
Yang, Zhiyao
Li, Ximing
Gao, Xiaotang Zhou Wanfu
Zhang, Huimao
Computation and Language
Quality Assurance (QA) for radiology reports refers to judging whether the junior reports (written by junior doctors) are qualified. The QA scores of one junior report are given by the senior doctor(s) after reviewing the image and junior report. This process requires intensive labor costs for senior doctors. Additionally, the QA scores may be inaccurate for reasons like diagnosis bias, the ability of senior doctors, and so on. To address this issue, we propose a Span-level Quality Assurance EvaluaTOR (Sqator) to mark QA scores automatically. Unlike the common document-level semantic comparison method, we try to analyze the semantic difference by exploring more fine-grained text spans. Specifically, Sqator measures QA scores by measuring the importance of revised spans between junior and senior reports, and outputs the final QA scores by merging all revised span scores. We evaluate Sqator using a collection of 12,013 radiology reports. Experimental results show that Sqator can achieve competitive QA scores. Moreover, the importance scores of revised spans can be also consistent with the judgments of senior doctors.
title Weakly Supervised Fine-grained Span-Level Framework for Chinese Radiology Report Quality Assurance
topic Computation and Language
url https://arxiv.org/abs/2508.08876