360Anything: Geometry-Free Lifting of Images and Videos to 360°

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Wu, Ziyi, Watson, Daniel, Tagliasacchi, Andrea, Fleet, David J., Brubaker, Marcus A., Saxena, Saurabh
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866918300186836992
author Wu, Ziyi
Watson, Daniel
Tagliasacchi, Andrea
Fleet, David J.
Brubaker, Marcus A.
Saxena, Saurabh
author_facet Wu, Ziyi
Watson, Daniel
Tagliasacchi, Andrea
Fleet, David J.
Brubaker, Marcus A.
Saxena, Saurabh
contents Lifting perspective images and videos to 360° panoramas enables immersive 3D world generation. Existing approaches often rely on explicit geometric alignment between the perspective and the equirectangular projection (ERP) space. Yet, this requires known camera metadata, obscuring the application to in-the-wild data where such calibration is typically absent or noisy. We propose 360Anything, a geometry-free framework built upon pre-trained diffusion transformers. By treating the perspective input and the panorama target simply as token sequences, 360Anything learns the perspective-to-equirectangular mapping in a purely data-driven way, eliminating the need for camera information. Our approach achieves state-of-the-art performance on both image and video perspective-to-360° generation, outperforming prior works that use ground-truth camera information. We also trace the root cause of the seam artifacts at ERP boundaries to zero-padding in the VAE encoder, and introduce Circular Latent Encoding to facilitate seamless generation. Finally, we show competitive results in zero-shot camera FoV and orientation estimation benchmarks, demonstrating 360Anything's deep geometric understanding and broader utility in computer vision tasks. Additional results are available at https://360anything.github.io/.
format Preprint
id arxiv_https___arxiv_org_abs_2601_16192
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle 360Anything: Geometry-Free Lifting of Images and Videos to 360°
Wu, Ziyi
Watson, Daniel
Tagliasacchi, Andrea
Fleet, David J.
Brubaker, Marcus A.
Saxena, Saurabh
Computer Vision and Pattern Recognition
Lifting perspective images and videos to 360° panoramas enables immersive 3D world generation. Existing approaches often rely on explicit geometric alignment between the perspective and the equirectangular projection (ERP) space. Yet, this requires known camera metadata, obscuring the application to in-the-wild data where such calibration is typically absent or noisy. We propose 360Anything, a geometry-free framework built upon pre-trained diffusion transformers. By treating the perspective input and the panorama target simply as token sequences, 360Anything learns the perspective-to-equirectangular mapping in a purely data-driven way, eliminating the need for camera information. Our approach achieves state-of-the-art performance on both image and video perspective-to-360° generation, outperforming prior works that use ground-truth camera information. We also trace the root cause of the seam artifacts at ERP boundaries to zero-padding in the VAE encoder, and introduce Circular Latent Encoding to facilitate seamless generation. Finally, we show competitive results in zero-shot camera FoV and orientation estimation benchmarks, demonstrating 360Anything's deep geometric understanding and broader utility in computer vision tasks. Additional results are available at https://360anything.github.io/.
title 360Anything: Geometry-Free Lifting of Images and Videos to 360°
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2601.16192