Enhancing Autonomous Navigation by Imaging Hidden Objects using Single-Photon LiDAR

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Young, Aaron, Batagoda, Nevindu M., Zhang, Harry, Dave, Akshat, Pediredla, Adithya, Negrut, Dan, Raskar, Ramesh
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866929752080646144
author Young, Aaron
Batagoda, Nevindu M.
Zhang, Harry
Dave, Akshat
Pediredla, Adithya
Negrut, Dan
Raskar, Ramesh
author_facet Young, Aaron
Batagoda, Nevindu M.
Zhang, Harry
Dave, Akshat
Pediredla, Adithya
Negrut, Dan
Raskar, Ramesh
contents Robust autonomous navigation in environments with limited visibility remains a critical challenge in robotics. We present a novel approach that leverages Non-Line-of-Sight (NLOS) sensing using single-photon LiDAR to improve visibility and enhance autonomous navigation. Our method enables mobile robots to "see around corners" by utilizing multi-bounce light information, effectively expanding their perceptual range without additional infrastructure. We propose a three-module pipeline: (1) Sensing, which captures multi-bounce histograms using SPAD-based LiDAR; (2) Perception, which estimates occupancy maps of hidden regions from these histograms using a convolutional neural network; and (3) Control, which allows a robot to follow safe paths based on the estimated occupancy. We evaluate our approach through simulations and real-world experiments on a mobile robot navigating an L-shaped corridor with hidden obstacles. Our work represents the first experimental demonstration of NLOS imaging for autonomous navigation, paving the way for safer and more efficient robotic systems operating in complex environments. We also contribute a novel dynamics-integrated transient rendering framework for simulating NLOS scenarios, facilitating future research in this domain.
format Preprint
id arxiv_https___arxiv_org_abs_2410_03555
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Enhancing Autonomous Navigation by Imaging Hidden Objects using Single-Photon LiDAR
Young, Aaron
Batagoda, Nevindu M.
Zhang, Harry
Dave, Akshat
Pediredla, Adithya
Negrut, Dan
Raskar, Ramesh
Robotics
Computer Vision and Pattern Recognition
Robust autonomous navigation in environments with limited visibility remains a critical challenge in robotics. We present a novel approach that leverages Non-Line-of-Sight (NLOS) sensing using single-photon LiDAR to improve visibility and enhance autonomous navigation. Our method enables mobile robots to "see around corners" by utilizing multi-bounce light information, effectively expanding their perceptual range without additional infrastructure. We propose a three-module pipeline: (1) Sensing, which captures multi-bounce histograms using SPAD-based LiDAR; (2) Perception, which estimates occupancy maps of hidden regions from these histograms using a convolutional neural network; and (3) Control, which allows a robot to follow safe paths based on the estimated occupancy. We evaluate our approach through simulations and real-world experiments on a mobile robot navigating an L-shaped corridor with hidden obstacles. Our work represents the first experimental demonstration of NLOS imaging for autonomous navigation, paving the way for safer and more efficient robotic systems operating in complex environments. We also contribute a novel dynamics-integrated transient rendering framework for simulating NLOS scenarios, facilitating future research in this domain.
title Enhancing Autonomous Navigation by Imaging Hidden Objects using Single-Photon LiDAR
topic Robotics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2410.03555