Domain Reduction Strategy for Non Line of Sight Imaging

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Shim, Hyunbo, Cho, In, Kwon, Daekyu, Kim, Seon Joo
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910553327271936
author Shim, Hyunbo
Cho, In
Kwon, Daekyu
Kim, Seon Joo
author_facet Shim, Hyunbo
Cho, In
Kwon, Daekyu
Kim, Seon Joo
contents This paper presents a novel optimization-based method for non-line-of-sight (NLOS) imaging that aims to reconstruct hidden scenes under general setups with significantly reduced reconstruction time. In NLOS imaging, the visible surfaces of the target objects are notably sparse. To mitigate unnecessary computations arising from empty regions, we design our method to render the transients through partial propagations from a continuously sampled set of points from the hidden space. Our method is capable of accurately and efficiently modeling the view-dependent reflectance using surface normals, which enables us to obtain surface geometry as well as albedo. In this pipeline, we propose a novel domain reduction strategy to eliminate superfluous computations in empty regions. During the optimization process, our domain reduction procedure periodically prunes the empty regions from our sampling domain in a coarse-to-fine manner, leading to substantial improvement in efficiency. We demonstrate the effectiveness of our method in various NLOS scenarios with sparse scanning patterns. Experiments conducted on both synthetic and real-world data support the efficacy in general NLOS scenarios, and the improved efficiency of our method compared to the previous optimization-based solutions. Our code is available at https://github.com/hyunbo9/domain-reduction-strategy.
format Preprint
id arxiv_https___arxiv_org_abs_2308_10269
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Domain Reduction Strategy for Non Line of Sight Imaging
Shim, Hyunbo
Cho, In
Kwon, Daekyu
Kim, Seon Joo
Computer Vision and Pattern Recognition
Image and Video Processing
This paper presents a novel optimization-based method for non-line-of-sight (NLOS) imaging that aims to reconstruct hidden scenes under general setups with significantly reduced reconstruction time. In NLOS imaging, the visible surfaces of the target objects are notably sparse. To mitigate unnecessary computations arising from empty regions, we design our method to render the transients through partial propagations from a continuously sampled set of points from the hidden space. Our method is capable of accurately and efficiently modeling the view-dependent reflectance using surface normals, which enables us to obtain surface geometry as well as albedo. In this pipeline, we propose a novel domain reduction strategy to eliminate superfluous computations in empty regions. During the optimization process, our domain reduction procedure periodically prunes the empty regions from our sampling domain in a coarse-to-fine manner, leading to substantial improvement in efficiency. We demonstrate the effectiveness of our method in various NLOS scenarios with sparse scanning patterns. Experiments conducted on both synthetic and real-world data support the efficacy in general NLOS scenarios, and the improved efficiency of our method compared to the previous optimization-based solutions. Our code is available at https://github.com/hyunbo9/domain-reduction-strategy.
title Domain Reduction Strategy for Non Line of Sight Imaging
topic Computer Vision and Pattern Recognition
Image and Video Processing
url https://arxiv.org/abs/2308.10269