OralGPT: A Two-Stage Vision-Language Model for Oral Mucosal Disease Diagnosis and Description
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866914096023076864 |
|---|---|
| author | Zhang, Jia Du, Bodong Miao, Yitong Sun, Dongwei Cao, Xiangyong |
| author_facet | Zhang, Jia Du, Bodong Miao, Yitong Sun, Dongwei Cao, Xiangyong |
| contents | Oral mucosal diseases such as leukoplakia, oral lichen planus, and recurrent
aphthous ulcers exhibit diverse and overlapping visual features,
making diagnosis challenging for non-specialists. While vision-language
models (VLMs) have shown promise in medical image interpretation,
their application in oral healthcare remains underexplored due to
the lack of large-scale, well-annotated datasets. In this work, we present
\textbf{OralGPT}, the first domain-specific two-stage vision-language
framework designed for oral mucosal disease diagnosis and captioning.
In Stage 1, OralGPT learns visual representations and disease-related
concepts from classification labels. In Stage 2, it enhances its language
generation ability using long-form expert-authored captions. To
overcome the annotation bottleneck, we propose a novel similarity-guided
data augmentation strategy that propagates descriptive knowledge from
expert-labeled images to weakly labeled ones. We also construct the
first benchmark dataset for oral mucosal diseases, integrating multi-source
image data with both structured and unstructured textual annotations.
Experimental results on four common oral conditions demonstrate that
OralGPT achieves competitive diagnostic performance while generating
fluent, clinically meaningful image descriptions. This study
provides a foundation for language-assisted diagnostic tools in oral
healthcare. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_13911 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | OralGPT: A Two-Stage Vision-Language Model for Oral Mucosal Disease Diagnosis and Description Zhang, Jia Du, Bodong Miao, Yitong Sun, Dongwei Cao, Xiangyong Quantitative Methods Oral mucosal diseases such as leukoplakia, oral lichen planus, and recurrent aphthous ulcers exhibit diverse and overlapping visual features, making diagnosis challenging for non-specialists. While vision-language models (VLMs) have shown promise in medical image interpretation, their application in oral healthcare remains underexplored due to the lack of large-scale, well-annotated datasets. In this work, we present \textbf{OralGPT}, the first domain-specific two-stage vision-language framework designed for oral mucosal disease diagnosis and captioning. In Stage 1, OralGPT learns visual representations and disease-related concepts from classification labels. In Stage 2, it enhances its language generation ability using long-form expert-authored captions. To overcome the annotation bottleneck, we propose a novel similarity-guided data augmentation strategy that propagates descriptive knowledge from expert-labeled images to weakly labeled ones. We also construct the first benchmark dataset for oral mucosal diseases, integrating multi-source image data with both structured and unstructured textual annotations. Experimental results on four common oral conditions demonstrate that OralGPT achieves competitive diagnostic performance while generating fluent, clinically meaningful image descriptions. This study provides a foundation for language-assisted diagnostic tools in oral healthcare. |
| title | OralGPT: A Two-Stage Vision-Language Model for Oral Mucosal Disease Diagnosis and Description |
| topic | Quantitative Methods |
| url | https://arxiv.org/abs/2510.13911 |