Dual-branch Graph Feature Learning for NLOS Imaging

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Su, Xiongfei, Zhu, Tianyi, Liu, Lina, Chen, Zheng, Zhang, Yulun, Li, Siyuan, Ye, Juntian, Xu, Feihu, Yuan, Xin
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910847560843264
author Su, Xiongfei
Zhu, Tianyi
Liu, Lina
Chen, Zheng
Zhang, Yulun
Li, Siyuan
Ye, Juntian
Xu, Feihu
Yuan, Xin
author_facet Su, Xiongfei
Zhu, Tianyi
Liu, Lina
Chen, Zheng
Zhang, Yulun
Li, Siyuan
Ye, Juntian
Xu, Feihu
Yuan, Xin
contents The domain of non-line-of-sight (NLOS) imaging is advancing rapidly, offering the capability to reveal occluded scenes that are not directly visible. However, contemporary NLOS systems face several significant challenges: (1) The computational and storage requirements are profound due to the inherent three-dimensional grid data structure, which restricts practical application. (2) The simultaneous reconstruction of albedo and depth information requires a delicate balance using hyperparameters in the loss function, rendering the concurrent reconstruction of texture and depth information difficult. This paper introduces the innovative methodology, \xnet, which integrates an albedo-focused reconstruction branch dedicated to albedo information recovery and a depth-focused reconstruction branch that extracts geometrical structure, to overcome these obstacles. The dual-branch framework segregates content delivery to the respective reconstructions, thereby enhancing the quality of the retrieved data. To our knowledge, we are the first to employ the GNN as a fundamental component to transform dense NLOS grid data into sparse structural features for efficient reconstruction. Comprehensive experiments demonstrate that our method attains the highest level of performance among existing methods across synthetic and real data. https://github.com/Nicholassu/DG-NLOS.
format Preprint
id arxiv_https___arxiv_org_abs_2502_19683
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Dual-branch Graph Feature Learning for NLOS Imaging
Su, Xiongfei
Zhu, Tianyi
Liu, Lina
Chen, Zheng
Zhang, Yulun
Li, Siyuan
Ye, Juntian
Xu, Feihu
Yuan, Xin
Image and Video Processing
Computer Vision and Pattern Recognition
The domain of non-line-of-sight (NLOS) imaging is advancing rapidly, offering the capability to reveal occluded scenes that are not directly visible. However, contemporary NLOS systems face several significant challenges: (1) The computational and storage requirements are profound due to the inherent three-dimensional grid data structure, which restricts practical application. (2) The simultaneous reconstruction of albedo and depth information requires a delicate balance using hyperparameters in the loss function, rendering the concurrent reconstruction of texture and depth information difficult. This paper introduces the innovative methodology, \xnet, which integrates an albedo-focused reconstruction branch dedicated to albedo information recovery and a depth-focused reconstruction branch that extracts geometrical structure, to overcome these obstacles. The dual-branch framework segregates content delivery to the respective reconstructions, thereby enhancing the quality of the retrieved data. To our knowledge, we are the first to employ the GNN as a fundamental component to transform dense NLOS grid data into sparse structural features for efficient reconstruction. Comprehensive experiments demonstrate that our method attains the highest level of performance among existing methods across synthetic and real data. https://github.com/Nicholassu/DG-NLOS.
title Dual-branch Graph Feature Learning for NLOS Imaging
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2502.19683