TDCNet: Transparent Objects Depth Completion with CNN-Transformer Dual-Branch Parallel Network
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866916532857077760 |
|---|---|
| author | Fan, Xianghui Ye, Chao Deng, Anping Wu, Xiaotian Pan, Mengyang Yang, Hang |
| author_facet | Fan, Xianghui Ye, Chao Deng, Anping Wu, Xiaotian Pan, Mengyang Yang, Hang |
| contents | The sensing and manipulation of transparent objects present a critical challenge in industrial and laboratory robotics. Conventional sensors face challenges in obtaining the full depth of transparent objects due to the refraction and reflection of light on their surfaces and their lack of visible texture. Previous research has attempted to obtain complete depth maps of transparent objects from RGB and damaged depth maps (collected by depth sensor) using deep learning models. However, existing methods fail to fully utilize the original depth map, resulting in limited accuracy for deep completion. To solve this problem, we propose TDCNet, a novel dual-branch CNN-Transformer parallel network for transparent object depth completion. The proposed framework consists of two different branches: one extracts features from partial depth maps, while the other processes RGB-D images. Experimental results demonstrate that our model achieves state-of-the-art performance across multiple public datasets. Our code and the pre-trained model are publicly available at https://github.com/XianghuiFan/TDCNet. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_14961 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | TDCNet: Transparent Objects Depth Completion with CNN-Transformer Dual-Branch Parallel Network Fan, Xianghui Ye, Chao Deng, Anping Wu, Xiaotian Pan, Mengyang Yang, Hang Computer Vision and Pattern Recognition The sensing and manipulation of transparent objects present a critical challenge in industrial and laboratory robotics. Conventional sensors face challenges in obtaining the full depth of transparent objects due to the refraction and reflection of light on their surfaces and their lack of visible texture. Previous research has attempted to obtain complete depth maps of transparent objects from RGB and damaged depth maps (collected by depth sensor) using deep learning models. However, existing methods fail to fully utilize the original depth map, resulting in limited accuracy for deep completion. To solve this problem, we propose TDCNet, a novel dual-branch CNN-Transformer parallel network for transparent object depth completion. The proposed framework consists of two different branches: one extracts features from partial depth maps, while the other processes RGB-D images. Experimental results demonstrate that our model achieves state-of-the-art performance across multiple public datasets. Our code and the pre-trained model are publicly available at https://github.com/XianghuiFan/TDCNet. |
| title | TDCNet: Transparent Objects Depth Completion with CNN-Transformer Dual-Branch Parallel Network |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2412.14961 |