uLayout: Unified Room Layout Estimation for Perspective and Panoramic Images

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Lee, Jonathan, Solarte, Bolivar, Wu, Chin-Hsuan, Jhang, Jin-Cheng, Wang, Fu-En, Tsai, Yi-Hsuan, Sun, Min
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912297435267072
author Lee, Jonathan
Solarte, Bolivar
Wu, Chin-Hsuan
Jhang, Jin-Cheng
Wang, Fu-En
Tsai, Yi-Hsuan
Sun, Min
author_facet Lee, Jonathan
Solarte, Bolivar
Wu, Chin-Hsuan
Jhang, Jin-Cheng
Wang, Fu-En
Tsai, Yi-Hsuan
Sun, Min
contents We present uLayout, a unified model for estimating room layout geometries from both perspective and panoramic images, whereas traditional solutions require different model designs for each image type. The key idea of our solution is to unify both domains into the equirectangular projection, particularly, allocating perspective images into the most suitable latitude coordinate to effectively exploit both domains seamlessly. To address the Field-of-View (FoV) difference between the input domains, we design uLayout with a shared feature extractor with an extra 1D-Convolution layer to condition each domain input differently. This conditioning allows us to efficiently formulate a column-wise feature regression problem regardless of the FoV input. This simple yet effective approach achieves competitive performance with current state-of-the-art solutions and shows for the first time a single end-to-end model for both domains. Extensive experiments in the real-world datasets, LSUN, Matterport3D, PanoContext, and Stanford 2D-3D evidence the contribution of our approach. Code is available at https://github.com/JonathanLee112/uLayout.
format Preprint
id arxiv_https___arxiv_org_abs_2503_21562
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle uLayout: Unified Room Layout Estimation for Perspective and Panoramic Images
Lee, Jonathan
Solarte, Bolivar
Wu, Chin-Hsuan
Jhang, Jin-Cheng
Wang, Fu-En
Tsai, Yi-Hsuan
Sun, Min
Computer Vision and Pattern Recognition
We present uLayout, a unified model for estimating room layout geometries from both perspective and panoramic images, whereas traditional solutions require different model designs for each image type. The key idea of our solution is to unify both domains into the equirectangular projection, particularly, allocating perspective images into the most suitable latitude coordinate to effectively exploit both domains seamlessly. To address the Field-of-View (FoV) difference between the input domains, we design uLayout with a shared feature extractor with an extra 1D-Convolution layer to condition each domain input differently. This conditioning allows us to efficiently formulate a column-wise feature regression problem regardless of the FoV input. This simple yet effective approach achieves competitive performance with current state-of-the-art solutions and shows for the first time a single end-to-end model for both domains. Extensive experiments in the real-world datasets, LSUN, Matterport3D, PanoContext, and Stanford 2D-3D evidence the contribution of our approach. Code is available at https://github.com/JonathanLee112/uLayout.
title uLayout: Unified Room Layout Estimation for Perspective and Panoramic Images
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.21562