Benchmarking Egocentric Visual-Inertial SLAM at City Scale

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Krishnan, Anusha, Liu, Shaohui, Sarlin, Paul-Edouard, Gentilhomme, Oscar, Caruso, David, Monge, Maurizio, Newcombe, Richard, Engel, Jakob, Pollefeys, Marc
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912618734682112
author Krishnan, Anusha
Liu, Shaohui
Sarlin, Paul-Edouard
Gentilhomme, Oscar
Caruso, David
Monge, Maurizio
Newcombe, Richard
Engel, Jakob
Pollefeys, Marc
author_facet Krishnan, Anusha
Liu, Shaohui
Sarlin, Paul-Edouard
Gentilhomme, Oscar
Caruso, David
Monge, Maurizio
Newcombe, Richard
Engel, Jakob
Pollefeys, Marc
contents Precise 6-DoF simultaneous localization and mapping (SLAM) from onboard sensors is critical for wearable devices capturing egocentric data, which exhibits specific challenges, such as a wider diversity of motions and viewpoints, prevalent dynamic visual content, or long sessions affected by time-varying sensor calibration. While recent progress on SLAM has been swift, academic research is still driven by benchmarks that do not reflect these challenges or do not offer sufficiently accurate ground truth poses. In this paper, we introduce a new dataset and benchmark for visual-inertial SLAM with egocentric, multi-modal data. We record hours and kilometers of trajectories through a city center with glasses-like devices equipped with various sensors. We leverage surveying tools to obtain control points as indirect pose annotations that are metric, centimeter-accurate, and available at city scale. This makes it possible to evaluate extreme trajectories that involve walking at night or traveling in a vehicle. We show that state-of-the-art systems developed by academia are not robust to these challenges and we identify components that are responsible for this. In addition, we design tracks with different levels of difficulty to ease in-depth analysis and evaluation of less mature approaches. The dataset and benchmark are available at https://www.lamaria.ethz.ch.
format Preprint
id arxiv_https___arxiv_org_abs_2509_26639
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Benchmarking Egocentric Visual-Inertial SLAM at City Scale
Krishnan, Anusha
Liu, Shaohui
Sarlin, Paul-Edouard
Gentilhomme, Oscar
Caruso, David
Monge, Maurizio
Newcombe, Richard
Engel, Jakob
Pollefeys, Marc
Computer Vision and Pattern Recognition
Robotics
Precise 6-DoF simultaneous localization and mapping (SLAM) from onboard sensors is critical for wearable devices capturing egocentric data, which exhibits specific challenges, such as a wider diversity of motions and viewpoints, prevalent dynamic visual content, or long sessions affected by time-varying sensor calibration. While recent progress on SLAM has been swift, academic research is still driven by benchmarks that do not reflect these challenges or do not offer sufficiently accurate ground truth poses. In this paper, we introduce a new dataset and benchmark for visual-inertial SLAM with egocentric, multi-modal data. We record hours and kilometers of trajectories through a city center with glasses-like devices equipped with various sensors. We leverage surveying tools to obtain control points as indirect pose annotations that are metric, centimeter-accurate, and available at city scale. This makes it possible to evaluate extreme trajectories that involve walking at night or traveling in a vehicle. We show that state-of-the-art systems developed by academia are not robust to these challenges and we identify components that are responsible for this. In addition, we design tracks with different levels of difficulty to ease in-depth analysis and evaluation of less mature approaches. The dataset and benchmark are available at https://www.lamaria.ethz.ch.
title Benchmarking Egocentric Visual-Inertial SLAM at City Scale
topic Computer Vision and Pattern Recognition
Robotics
url https://arxiv.org/abs/2509.26639