Gaze-DETR: Using Expert Gaze to Reduce False Positives in Vulvovaginal Candidiasis Screening

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Kong, Yan, Wang, Sheng, Cai, Jiangdong, Zhao, Zihao, Shen, Zhenrong, Li, Yonghao, Fei, Manman, Wang, Qian
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910448543072256
author Kong, Yan
Wang, Sheng
Cai, Jiangdong
Zhao, Zihao
Shen, Zhenrong
Li, Yonghao
Fei, Manman
Wang, Qian
author_facet Kong, Yan
Wang, Sheng
Cai, Jiangdong
Zhao, Zihao
Shen, Zhenrong
Li, Yonghao
Fei, Manman
Wang, Qian
contents Accurate detection of vulvovaginal candidiasis is critical for women's health, yet its sparse distribution and visually ambiguous characteristics pose significant challenges for accurate identification by pathologists and neural networks alike. Our eye-tracking data reveals that areas garnering sustained attention - yet not marked by experts after deliberation - are often aligned with false positives of neural networks. Leveraging this finding, we introduce Gaze-DETR, a pioneering method that integrates gaze data to enhance neural network precision by diminishing false positives. Gaze-DETR incorporates a universal gaze-guided warm-up protocol applicable across various detection methods and a gaze-guided rectification strategy specifically designed for DETR-based models. Our comprehensive tests confirm that Gaze-DETR surpasses existing leading methods, showcasing remarkable improvements in detection accuracy and generalizability.
format Preprint
id arxiv_https___arxiv_org_abs_2405_09463
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Gaze-DETR: Using Expert Gaze to Reduce False Positives in Vulvovaginal Candidiasis Screening
Kong, Yan
Wang, Sheng
Cai, Jiangdong
Zhao, Zihao
Shen, Zhenrong
Li, Yonghao
Fei, Manman
Wang, Qian
Computer Vision and Pattern Recognition
Accurate detection of vulvovaginal candidiasis is critical for women's health, yet its sparse distribution and visually ambiguous characteristics pose significant challenges for accurate identification by pathologists and neural networks alike. Our eye-tracking data reveals that areas garnering sustained attention - yet not marked by experts after deliberation - are often aligned with false positives of neural networks. Leveraging this finding, we introduce Gaze-DETR, a pioneering method that integrates gaze data to enhance neural network precision by diminishing false positives. Gaze-DETR incorporates a universal gaze-guided warm-up protocol applicable across various detection methods and a gaze-guided rectification strategy specifically designed for DETR-based models. Our comprehensive tests confirm that Gaze-DETR surpasses existing leading methods, showcasing remarkable improvements in detection accuracy and generalizability.
title Gaze-DETR: Using Expert Gaze to Reduce False Positives in Vulvovaginal Candidiasis Screening
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2405.09463