Saved in:
Bibliographic Details
Main Authors: Bhattacharjee, Subhransu S., Lu, Hao, Campbell, Dylan, Shome, Rahul
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2510.11014
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912644305256448
author Bhattacharjee, Subhransu S.
Lu, Hao
Campbell, Dylan
Shome, Rahul
author_facet Bhattacharjee, Subhransu S.
Lu, Hao
Campbell, Dylan
Shome, Rahul
contents Priors are vital for planning under partial observability, yet difficult to obtain in practice. We present a sampling-based pipeline that leverages large-scale pretrained generative models to produce probabilistic priors capturing environmental uncertainty and spatio-semantic relationships in a zero-shot manner. Conditioned on partial observations, the pipeline recovers complete RGB-D point cloud samples with occupancy and target semantics, formulated to be directly useful in configuration-space planning. We establish a Matterport3D benchmark of rooms partially visible through doorways, where a robot must navigate to an unobserved target object. Effective priors for this setting must represent both occupancy and target-location uncertainty in unobserved regions. Experiments show that our approach recovers commonsense spatial semantics consistent with ground truth, yielding diverse, clean 3D point clouds usable in motion planning, highlight the promise of generative models as a rich source of priors for robotic planning.
format Preprint
id arxiv_https___arxiv_org_abs_2510_11014
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Into the Unknown: Towards using Generative Models for Sampling Priors of Environment Uncertainty for Planning in Configuration Spaces
Bhattacharjee, Subhransu S.
Lu, Hao
Campbell, Dylan
Shome, Rahul
Robotics
Artificial Intelligence
Computer Vision and Pattern Recognition
Priors are vital for planning under partial observability, yet difficult to obtain in practice. We present a sampling-based pipeline that leverages large-scale pretrained generative models to produce probabilistic priors capturing environmental uncertainty and spatio-semantic relationships in a zero-shot manner. Conditioned on partial observations, the pipeline recovers complete RGB-D point cloud samples with occupancy and target semantics, formulated to be directly useful in configuration-space planning. We establish a Matterport3D benchmark of rooms partially visible through doorways, where a robot must navigate to an unobserved target object. Effective priors for this setting must represent both occupancy and target-location uncertainty in unobserved regions. Experiments show that our approach recovers commonsense spatial semantics consistent with ground truth, yielding diverse, clean 3D point clouds usable in motion planning, highlight the promise of generative models as a rich source of priors for robotic planning.
title Into the Unknown: Towards using Generative Models for Sampling Priors of Environment Uncertainty for Planning in Configuration Spaces
topic Robotics
Artificial Intelligence
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2510.11014