VINS-Multi: A Robust Asynchronous Multi-camera-IMU State Estimator

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Luqi, Xu, Yang, Shen, Shaojie
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911885033472000
author Wang, Luqi
Xu, Yang
Shen, Shaojie
author_facet Wang, Luqi
Xu, Yang
Shen, Shaojie
contents State estimation is a critical foundational module in robotics applications, where robustness and performance are paramount. Although in recent years, many works have been focusing on improving one of the most widely adopted state estimation methods, visual inertial odometry (VIO), by incorporating multiple cameras, these efforts predominantly address synchronous camera systems. Asynchronous cameras, which offer simpler hardware configurations and enhanced resilience, have been largely overlooked. To fill this gap, this paper presents VINS-Multi, a novel multi-camera-IMU state estimator for asynchronous cameras. The estimator comprises parallel front ends, a front end coordinator, and a back end optimization module capable of handling asynchronous input frames. It utilizes the frames effectively through a dynamic feature number allocation and a frame priority coordination strategy. The proposed estimator is integrated into a customized quadrotor platform and tested in multiple realistic and challenging scenarios to validate its practicality. Additionally, comprehensive benchmark results are provided to showcase the robustness and superior performance of the proposed estimator.
format Preprint
id arxiv_https___arxiv_org_abs_2405_14539
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle VINS-Multi: A Robust Asynchronous Multi-camera-IMU State Estimator
Wang, Luqi
Xu, Yang
Shen, Shaojie
Robotics
State estimation is a critical foundational module in robotics applications, where robustness and performance are paramount. Although in recent years, many works have been focusing on improving one of the most widely adopted state estimation methods, visual inertial odometry (VIO), by incorporating multiple cameras, these efforts predominantly address synchronous camera systems. Asynchronous cameras, which offer simpler hardware configurations and enhanced resilience, have been largely overlooked. To fill this gap, this paper presents VINS-Multi, a novel multi-camera-IMU state estimator for asynchronous cameras. The estimator comprises parallel front ends, a front end coordinator, and a back end optimization module capable of handling asynchronous input frames. It utilizes the frames effectively through a dynamic feature number allocation and a frame priority coordination strategy. The proposed estimator is integrated into a customized quadrotor platform and tested in multiple realistic and challenging scenarios to validate its practicality. Additionally, comprehensive benchmark results are provided to showcase the robustness and superior performance of the proposed estimator.
title VINS-Multi: A Robust Asynchronous Multi-camera-IMU State Estimator
topic Robotics
url https://arxiv.org/abs/2405.14539