Saved in:
Bibliographic Details
Main Authors: Zhang, Zitong, Gautam, Suranjan, Yu, Rui
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2507.21371
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913964319834112
author Zhang, Zitong
Gautam, Suranjan
Yu, Rui
author_facet Zhang, Zitong
Gautam, Suranjan
Yu, Rui
contents Generating immersive 360° indoor panoramas from 2D top-down views has applications in virtual reality, interior design, real estate, and robotics. This task is challenging due to the lack of explicit 3D structure and the need for geometric consistency and photorealism. We propose Top2Pano, an end-to-end model for synthesizing realistic indoor panoramas from top-down views. Our method estimates volumetric occupancy to infer 3D structures, then uses volumetric rendering to generate coarse color and depth panoramas. These guide a diffusion-based refinement stage using ControlNet, enhancing realism and structural fidelity. Evaluations on two datasets show Top2Pano outperforms baselines, effectively reconstructing geometry, occlusions, and spatial arrangements. It also generalizes well, producing high-quality panoramas from schematic floorplans. Our results highlight Top2Pano's potential in bridging top-down views with immersive indoor synthesis.
format Preprint
id arxiv_https___arxiv_org_abs_2507_21371
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Top2Pano: Learning to Generate Indoor Panoramas from Top-Down View
Zhang, Zitong
Gautam, Suranjan
Yu, Rui
Computer Vision and Pattern Recognition
Generating immersive 360° indoor panoramas from 2D top-down views has applications in virtual reality, interior design, real estate, and robotics. This task is challenging due to the lack of explicit 3D structure and the need for geometric consistency and photorealism. We propose Top2Pano, an end-to-end model for synthesizing realistic indoor panoramas from top-down views. Our method estimates volumetric occupancy to infer 3D structures, then uses volumetric rendering to generate coarse color and depth panoramas. These guide a diffusion-based refinement stage using ControlNet, enhancing realism and structural fidelity. Evaluations on two datasets show Top2Pano outperforms baselines, effectively reconstructing geometry, occlusions, and spatial arrangements. It also generalizes well, producing high-quality panoramas from schematic floorplans. Our results highlight Top2Pano's potential in bridging top-down views with immersive indoor synthesis.
title Top2Pano: Learning to Generate Indoor Panoramas from Top-Down View
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2507.21371