Low-Resolution Chest X-ray Classification via Knowledge Distillation and Multi-task Learning

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Akhter, Yasmeena, Ranjan, Rishabh, Singh, Richa, Vatsa, Mayank
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909208941690880
author Akhter, Yasmeena
Ranjan, Rishabh
Singh, Richa
Vatsa, Mayank
author_facet Akhter, Yasmeena
Ranjan, Rishabh
Singh, Richa
Vatsa, Mayank
contents This research addresses the challenges of diagnosing chest X-rays (CXRs) at low resolutions, a common limitation in resource-constrained healthcare settings. High-resolution CXR imaging is crucial for identifying small but critical anomalies, such as nodules or opacities. However, when images are downsized for processing in Computer-Aided Diagnosis (CAD) systems, vital spatial details and receptive fields are lost, hampering diagnosis accuracy. To address this, this paper presents the Multilevel Collaborative Attention Knowledge (MLCAK) method. This approach leverages the self-attention mechanism of Vision Transformers (ViT) to transfer critical diagnostic knowledge from high-resolution images to enhance the diagnostic efficacy of low-resolution CXRs. MLCAK incorporates local pathological findings to boost model explainability, enabling more accurate global predictions in a multi-task framework tailored for low-resolution CXR analysis. Our research, utilizing the Vindr CXR dataset, shows a considerable enhancement in the ability to diagnose diseases from low-resolution images (e.g. 28 x 28), suggesting a critical transition from the traditional reliance on high-resolution imaging (e.g. 224 x 224).
format Preprint
id arxiv_https___arxiv_org_abs_2405_13370
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Low-Resolution Chest X-ray Classification via Knowledge Distillation and Multi-task Learning
Akhter, Yasmeena
Ranjan, Rishabh
Singh, Richa
Vatsa, Mayank
Image and Video Processing
Computer Vision and Pattern Recognition
Machine Learning
This research addresses the challenges of diagnosing chest X-rays (CXRs) at low resolutions, a common limitation in resource-constrained healthcare settings. High-resolution CXR imaging is crucial for identifying small but critical anomalies, such as nodules or opacities. However, when images are downsized for processing in Computer-Aided Diagnosis (CAD) systems, vital spatial details and receptive fields are lost, hampering diagnosis accuracy. To address this, this paper presents the Multilevel Collaborative Attention Knowledge (MLCAK) method. This approach leverages the self-attention mechanism of Vision Transformers (ViT) to transfer critical diagnostic knowledge from high-resolution images to enhance the diagnostic efficacy of low-resolution CXRs. MLCAK incorporates local pathological findings to boost model explainability, enabling more accurate global predictions in a multi-task framework tailored for low-resolution CXR analysis. Our research, utilizing the Vindr CXR dataset, shows a considerable enhancement in the ability to diagnose diseases from low-resolution images (e.g. 28 x 28), suggesting a critical transition from the traditional reliance on high-resolution imaging (e.g. 224 x 224).
title Low-Resolution Chest X-ray Classification via Knowledge Distillation and Multi-task Learning
topic Image and Video Processing
Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2405.13370