Guardado en:
Detalles Bibliográficos
Autores principales: Silva, Bernardo, Fontinele, Jefferson, Vieira, Carolina Letícia Zilli, Tavares, João Manuel R. S., Cury, Patricia Ramos, Oliveira, Luciano
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:https://arxiv.org/abs/2406.17915
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866910502095945728
author Silva, Bernardo
Fontinele, Jefferson
Vieira, Carolina Letícia Zilli
Tavares, João Manuel R. S.
Cury, Patricia Ramos
Oliveira, Luciano
author_facet Silva, Bernardo
Fontinele, Jefferson
Vieira, Carolina Letícia Zilli
Tavares, João Manuel R. S.
Cury, Patricia Ramos
Oliveira, Luciano
contents Dental panoramic radiographs offer vast diagnostic opportunities, but training supervised deep learning networks for automatic analysis of those radiology images is hampered by a shortage of labeled data. Here, a different perspective on this problem is introduced. A semi-supervised learning framework is proposed to classify thirteen dental conditions on panoramic radiographs, with a particular emphasis on teeth. Large language models were explored to annotate the most common dental conditions based on dental reports. Additionally, a masked autoencoder was employed to pre-train the classification neural network, and a Vision Transformer was used to leverage the unlabeled data. The analyses were validated using two of the most extensive datasets in the literature, comprising 8,795 panoramic radiographs and 8,029 paired reports and images. Encouragingly, the results consistently met or surpassed the baseline metrics for the Matthews correlation coefficient. A comparison of the proposed solution with human practitioners, supported by statistical analysis, highlighted its effectiveness and performance limitations; based on the degree of agreement among specialists, the solution demonstrated an accuracy level comparable to that of a junior specialist.
format Preprint
id arxiv_https___arxiv_org_abs_2406_17915
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Semi-supervised classification of dental conditions in panoramic radiographs using large language model and instance segmentation: A real-world dataset evaluation
Silva, Bernardo
Fontinele, Jefferson
Vieira, Carolina Letícia Zilli
Tavares, João Manuel R. S.
Cury, Patricia Ramos
Oliveira, Luciano
Computer Vision and Pattern Recognition
Artificial Intelligence
Dental panoramic radiographs offer vast diagnostic opportunities, but training supervised deep learning networks for automatic analysis of those radiology images is hampered by a shortage of labeled data. Here, a different perspective on this problem is introduced. A semi-supervised learning framework is proposed to classify thirteen dental conditions on panoramic radiographs, with a particular emphasis on teeth. Large language models were explored to annotate the most common dental conditions based on dental reports. Additionally, a masked autoencoder was employed to pre-train the classification neural network, and a Vision Transformer was used to leverage the unlabeled data. The analyses were validated using two of the most extensive datasets in the literature, comprising 8,795 panoramic radiographs and 8,029 paired reports and images. Encouragingly, the results consistently met or surpassed the baseline metrics for the Matthews correlation coefficient. A comparison of the proposed solution with human practitioners, supported by statistical analysis, highlighted its effectiveness and performance limitations; based on the degree of agreement among specialists, the solution demonstrated an accuracy level comparable to that of a junior specialist.
title Semi-supervised classification of dental conditions in panoramic radiographs using large language model and instance segmentation: A real-world dataset evaluation
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2406.17915