V-PRISM: Probabilistic Mapping of Unknown Tabletop Scenes

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wright, Herbert, Zhi, Weiming, Johnson-Roberson, Matthew, Hermans, Tucker
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911797423898624
author Wright, Herbert
Zhi, Weiming
Johnson-Roberson, Matthew
Hermans, Tucker
author_facet Wright, Herbert
Zhi, Weiming
Johnson-Roberson, Matthew
Hermans, Tucker
contents The ability to construct concise scene representations from sensor input is central to the field of robotics. This paper addresses the problem of robustly creating a 3D representation of a tabletop scene from a segmented RGB-D image. These representations are then critical for a range of downstream manipulation tasks. Many previous attempts to tackle this problem do not capture accurate uncertainty, which is required to subsequently produce safe motion plans. In this paper, we cast the representation of 3D tabletop scenes as a multi-class classification problem. To tackle this, we introduce V-PRISM, a framework and method for robustly creating probabilistic 3D segmentation maps of tabletop scenes. Our maps contain both occupancy estimates, segmentation information, and principled uncertainty measures. We evaluate the robustness of our method in (1) procedurally generated scenes using open-source object datasets, and (2) real-world tabletop data collected from a depth camera. Our experiments show that our approach outperforms alternative continuous reconstruction approaches that do not explicitly reason about objects in a multi-class formulation.
format Preprint
id arxiv_https___arxiv_org_abs_2403_08106
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle V-PRISM: Probabilistic Mapping of Unknown Tabletop Scenes
Wright, Herbert
Zhi, Weiming
Johnson-Roberson, Matthew
Hermans, Tucker
Robotics
The ability to construct concise scene representations from sensor input is central to the field of robotics. This paper addresses the problem of robustly creating a 3D representation of a tabletop scene from a segmented RGB-D image. These representations are then critical for a range of downstream manipulation tasks. Many previous attempts to tackle this problem do not capture accurate uncertainty, which is required to subsequently produce safe motion plans. In this paper, we cast the representation of 3D tabletop scenes as a multi-class classification problem. To tackle this, we introduce V-PRISM, a framework and method for robustly creating probabilistic 3D segmentation maps of tabletop scenes. Our maps contain both occupancy estimates, segmentation information, and principled uncertainty measures. We evaluate the robustness of our method in (1) procedurally generated scenes using open-source object datasets, and (2) real-world tabletop data collected from a depth camera. Our experiments show that our approach outperforms alternative continuous reconstruction approaches that do not explicitly reason about objects in a multi-class formulation.
title V-PRISM: Probabilistic Mapping of Unknown Tabletop Scenes
topic Robotics
url https://arxiv.org/abs/2403.08106