HouseTour: A Virtual Real Estate A(I)gent

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Çelen, Ata, Pollefeys, Marc, Barath, Daniel, Armeni, Iro
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909860596023296
author Çelen, Ata
Pollefeys, Marc
Barath, Daniel
Armeni, Iro
author_facet Çelen, Ata
Pollefeys, Marc
Barath, Daniel
Armeni, Iro
contents We introduce HouseTour, a method for spatially-aware 3D camera trajectory and natural language summary generation from a collection of images depicting an existing 3D space. Unlike existing vision-language models (VLMs), which struggle with geometric reasoning, our approach generates smooth video trajectories via a diffusion process constrained by known camera poses and integrates this information into the VLM for 3D-grounded descriptions. We synthesize the final video using 3D Gaussian splatting to render novel views along the trajectory. To support this task, we present the HouseTour dataset, which includes over 1,200 house-tour videos with camera poses, 3D reconstructions, and real estate descriptions. Experiments demonstrate that incorporating 3D camera trajectories into the text generation process improves performance over methods handling each task independently. We evaluate both individual and end-to-end performance, introducing a new joint metric. Our work enables automated, professional-quality video creation for real estate and touristic applications without requiring specialized expertise or equipment.
format Preprint
id arxiv_https___arxiv_org_abs_2510_18054
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle HouseTour: A Virtual Real Estate A(I)gent
Çelen, Ata
Pollefeys, Marc
Barath, Daniel
Armeni, Iro
Computer Vision and Pattern Recognition
Computation and Language
We introduce HouseTour, a method for spatially-aware 3D camera trajectory and natural language summary generation from a collection of images depicting an existing 3D space. Unlike existing vision-language models (VLMs), which struggle with geometric reasoning, our approach generates smooth video trajectories via a diffusion process constrained by known camera poses and integrates this information into the VLM for 3D-grounded descriptions. We synthesize the final video using 3D Gaussian splatting to render novel views along the trajectory. To support this task, we present the HouseTour dataset, which includes over 1,200 house-tour videos with camera poses, 3D reconstructions, and real estate descriptions. Experiments demonstrate that incorporating 3D camera trajectories into the text generation process improves performance over methods handling each task independently. We evaluate both individual and end-to-end performance, introducing a new joint metric. Our work enables automated, professional-quality video creation for real estate and touristic applications without requiring specialized expertise or equipment.
title HouseTour: A Virtual Real Estate A(I)gent
topic Computer Vision and Pattern Recognition
Computation and Language
url https://arxiv.org/abs/2510.18054