Test-Time Intensity Consistency Adaptation for Shadow Detection

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhu, Leyi, Liu, Weihuang, Chen, Xinyi, Li, Zimeng, Chen, Xuhang, Wang, Zhen, Pun, Chi-Man
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929537516830720
author Zhu, Leyi
Liu, Weihuang
Chen, Xinyi
Li, Zimeng
Chen, Xuhang
Wang, Zhen
Pun, Chi-Man
author_facet Zhu, Leyi
Liu, Weihuang
Chen, Xinyi
Li, Zimeng
Chen, Xuhang
Wang, Zhen
Pun, Chi-Man
contents Shadow detection is crucial for accurate scene understanding in computer vision, yet it is challenged by the diverse appearances of shadows caused by variations in illumination, object geometry, and scene context. Deep learning models often struggle to generalize to real-world images due to the limited size and diversity of training datasets. To address this, we introduce TICA, a novel framework that leverages light-intensity information during test-time adaptation to enhance shadow detection accuracy. TICA exploits the inherent inconsistencies in light intensity across shadow regions to guide the model toward a more consistent prediction. A basic encoder-decoder model is initially trained on a labeled dataset for shadow detection. Then, during the testing phase, the network is adjusted for each test sample by enforcing consistent intensity predictions between two augmented input image versions. This consistency training specifically targets both foreground and background intersection regions to identify shadow regions within images accurately for robust adaptation. Extensive evaluations on the ISTD and SBU shadow detection datasets reveal that TICA significantly demonstrates that TICA outperforms existing state-of-the-art methods, achieving superior results in balanced error rate (BER).
format Preprint
id arxiv_https___arxiv_org_abs_2410_07695
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Test-Time Intensity Consistency Adaptation for Shadow Detection
Zhu, Leyi
Liu, Weihuang
Chen, Xinyi
Li, Zimeng
Chen, Xuhang
Wang, Zhen
Pun, Chi-Man
Computer Vision and Pattern Recognition
Shadow detection is crucial for accurate scene understanding in computer vision, yet it is challenged by the diverse appearances of shadows caused by variations in illumination, object geometry, and scene context. Deep learning models often struggle to generalize to real-world images due to the limited size and diversity of training datasets. To address this, we introduce TICA, a novel framework that leverages light-intensity information during test-time adaptation to enhance shadow detection accuracy. TICA exploits the inherent inconsistencies in light intensity across shadow regions to guide the model toward a more consistent prediction. A basic encoder-decoder model is initially trained on a labeled dataset for shadow detection. Then, during the testing phase, the network is adjusted for each test sample by enforcing consistent intensity predictions between two augmented input image versions. This consistency training specifically targets both foreground and background intersection regions to identify shadow regions within images accurately for robust adaptation. Extensive evaluations on the ISTD and SBU shadow detection datasets reveal that TICA significantly demonstrates that TICA outperforms existing state-of-the-art methods, achieving superior results in balanced error rate (BER).
title Test-Time Intensity Consistency Adaptation for Shadow Detection
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2410.07695