ColabSfM: Collaborative Structure-from-Motion by Point Cloud Registration

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Edstedt, Johan, Mateus, André, Jaenal, Alberto
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913750127214592
author Edstedt, Johan
Mateus, André
Jaenal, Alberto
author_facet Edstedt, Johan
Mateus, André
Jaenal, Alberto
contents Structure-from-Motion (SfM) is the task of estimating 3D structure and camera poses from images. We define Collaborative SfM (ColabSfM) as sharing distributed SfM reconstructions. Sharing maps requires estimating a joint reference frame, which is typically referred to as registration. However, there is a lack of scalable methods and training datasets for registering SfM reconstructions. In this paper, we tackle this challenge by proposing the scalable task of point cloud registration for SfM reconstructions. We find that current registration methods cannot register SfM point clouds when trained on existing datasets. To this end, we propose a SfM registration dataset generation pipeline, leveraging partial reconstructions from synthetically generated camera trajectories for each scene. Finally, we propose a simple but impactful neural refiner on top of the SotA registration method RoITr that yields significant improvements, which we call RefineRoITr. Our extensive experimental evaluation shows that our proposed pipeline and model enables ColabSfM. Code is available at https://github.com/EricssonResearch/ColabSfM
format Preprint
id arxiv_https___arxiv_org_abs_2503_17093
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle ColabSfM: Collaborative Structure-from-Motion by Point Cloud Registration
Edstedt, Johan
Mateus, André
Jaenal, Alberto
Computer Vision and Pattern Recognition
Structure-from-Motion (SfM) is the task of estimating 3D structure and camera poses from images. We define Collaborative SfM (ColabSfM) as sharing distributed SfM reconstructions. Sharing maps requires estimating a joint reference frame, which is typically referred to as registration. However, there is a lack of scalable methods and training datasets for registering SfM reconstructions. In this paper, we tackle this challenge by proposing the scalable task of point cloud registration for SfM reconstructions. We find that current registration methods cannot register SfM point clouds when trained on existing datasets. To this end, we propose a SfM registration dataset generation pipeline, leveraging partial reconstructions from synthetically generated camera trajectories for each scene. Finally, we propose a simple but impactful neural refiner on top of the SotA registration method RoITr that yields significant improvements, which we call RefineRoITr. Our extensive experimental evaluation shows that our proposed pipeline and model enables ColabSfM. Code is available at https://github.com/EricssonResearch/ColabSfM
title ColabSfM: Collaborative Structure-from-Motion by Point Cloud Registration
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.17093