DINO-LG: Enhancing Vision Transformers with Label Guidance for Coronary Artery Calcium Detection

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Gokmen, Mahmut S., Ozcan, Caner, Haque, Moneera N., Leung, Steve W., Parker, C. Seth, Seales, W. Brent, Bumgardner, Cody
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917261448577024
author Gokmen, Mahmut S.
Ozcan, Caner
Haque, Moneera N.
Leung, Steve W.
Parker, C. Seth
Seales, W. Brent
Bumgardner, Cody
author_facet Gokmen, Mahmut S.
Ozcan, Caner
Haque, Moneera N.
Leung, Steve W.
Parker, C. Seth
Seales, W. Brent
Bumgardner, Cody
contents Coronary artery disease (CAD), one of the leading causes of mortality worldwide, necessitates effective risk assessment strategies, with coronary artery calcium (CAC) scoring via computed tomography (CT) being a key method for prevention. Traditional methods, primarily based on UNET architectures implemented on pre-built models, face challenges like the scarcity of annotated CT scans containing CAC and imbalanced datasets, leading to reduced performance in segmentation and scoring tasks. In this study, we address these limitations by introducing DINO-LG, a novel label-guided extension of DINO (self-distillation with no labels) that incorporates targeted augmentation on annotated calcified regions during self-supervised pre-training. Our three-stage pipeline integrates Vision Transformer (ViT-Base/8) feature extraction via DINO-LG trained on 914 CT scans comprising 700 gated and 214 non-gated acquisitions, linear classification to identify calcified slices, and U-NET segmentation for CAC quantification and Agatston scoring. DINO-LG achieved 89% sensitivity and 90% specificity for detecting CAC-containing CT slices, compared to standard DINO's 79% sensitivity and 77% specificity, reducing false-negative and false-positive rates by 49% and 57% respectively. The integrated system achieves 90% accuracy in CAC risk classification on 45 test patients, outperforming standalone U-NET segmentation (76% accuracy) while processing only the relevant subset of CT slices. This targeted approach enhances CAC scoring accuracy by feeding the UNET model with relevant slices, improving diagnostic precision while lowering healthcare costs by minimizing unnecessary tests and treatments.
format Preprint
id arxiv_https___arxiv_org_abs_2411_07976
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle DINO-LG: Enhancing Vision Transformers with Label Guidance for Coronary Artery Calcium Detection
Gokmen, Mahmut S.
Ozcan, Caner
Haque, Moneera N.
Leung, Steve W.
Parker, C. Seth
Seales, W. Brent
Bumgardner, Cody
Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
Coronary artery disease (CAD), one of the leading causes of mortality worldwide, necessitates effective risk assessment strategies, with coronary artery calcium (CAC) scoring via computed tomography (CT) being a key method for prevention. Traditional methods, primarily based on UNET architectures implemented on pre-built models, face challenges like the scarcity of annotated CT scans containing CAC and imbalanced datasets, leading to reduced performance in segmentation and scoring tasks. In this study, we address these limitations by introducing DINO-LG, a novel label-guided extension of DINO (self-distillation with no labels) that incorporates targeted augmentation on annotated calcified regions during self-supervised pre-training. Our three-stage pipeline integrates Vision Transformer (ViT-Base/8) feature extraction via DINO-LG trained on 914 CT scans comprising 700 gated and 214 non-gated acquisitions, linear classification to identify calcified slices, and U-NET segmentation for CAC quantification and Agatston scoring. DINO-LG achieved 89% sensitivity and 90% specificity for detecting CAC-containing CT slices, compared to standard DINO's 79% sensitivity and 77% specificity, reducing false-negative and false-positive rates by 49% and 57% respectively. The integrated system achieves 90% accuracy in CAC risk classification on 45 test patients, outperforming standalone U-NET segmentation (76% accuracy) while processing only the relevant subset of CT slices. This targeted approach enhances CAC scoring accuracy by feeding the UNET model with relevant slices, improving diagnostic precision while lowering healthcare costs by minimizing unnecessary tests and treatments.
title DINO-LG: Enhancing Vision Transformers with Label Guidance for Coronary Artery Calcium Detection
topic Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2411.07976