Towards Hard and Soft Shadow Removal via Dual-Branch Separation Network and Vision Transformer

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autor principal: Liang, Jiajia
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917928348155904
author Liang, Jiajia
author_facet Liang, Jiajia
contents Image shadow removal is a crucial task in computer vision. In real-world scenes, shadows alter image color and brightness, posing challenges for perception and texture recognition. Traditional and deep learning methods often overlook the distinct needs for handling hard and soft shadows, thereby lacking detailed processing to specifically address each type of shadow in images.We propose a dual-path model that processes these shadows separately using specially designed loss functions to accomplish the hard and soft shadow removal. The model classifies shadow types and processes them through appropriate paths to produce shadow-free outputs, integrating a Vision Transformer with UNet++ for enhanced edge detail and feature fusion. Our model outperforms state-of-the-art methods and achieves 2.905 RMSE value on the ISTD dataset, which demonstrates greater effectiveness than typical single-path approaches.
format Preprint
id arxiv_https___arxiv_org_abs_2501_01864
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Towards Hard and Soft Shadow Removal via Dual-Branch Separation Network and Vision Transformer
Liang, Jiajia
Computer Vision and Pattern Recognition
I.2.10
Image shadow removal is a crucial task in computer vision. In real-world scenes, shadows alter image color and brightness, posing challenges for perception and texture recognition. Traditional and deep learning methods often overlook the distinct needs for handling hard and soft shadows, thereby lacking detailed processing to specifically address each type of shadow in images.We propose a dual-path model that processes these shadows separately using specially designed loss functions to accomplish the hard and soft shadow removal. The model classifies shadow types and processes them through appropriate paths to produce shadow-free outputs, integrating a Vision Transformer with UNet++ for enhanced edge detail and feature fusion. Our model outperforms state-of-the-art methods and achieves 2.905 RMSE value on the ISTD dataset, which demonstrates greater effectiveness than typical single-path approaches.
title Towards Hard and Soft Shadow Removal via Dual-Branch Separation Network and Vision Transformer
topic Computer Vision and Pattern Recognition
I.2.10
url https://arxiv.org/abs/2501.01864