EqNIO: Subequivariant Neural Inertial Odometry

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Jayanth, Royina Karegoudra, Xu, Yinshuang, Wang, Ziyun, Chatzipantazis, Evangelos, Gehrig, Daniel, Daniilidis, Kostas
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866912067968040960
author Jayanth, Royina Karegoudra
Xu, Yinshuang
Wang, Ziyun
Chatzipantazis, Evangelos
Gehrig, Daniel
Daniilidis, Kostas
author_facet Jayanth, Royina Karegoudra
Xu, Yinshuang
Wang, Ziyun
Chatzipantazis, Evangelos
Gehrig, Daniel
Daniilidis, Kostas
contents Neural networks are seeing rapid adoption in purely inertial odometry, where accelerometer and gyroscope measurements from commodity inertial measurement units (IMU) are used to regress displacements and associated uncertainties. They can learn informative displacement priors, which can be directly fused with the raw data with off-the-shelf non-linear filters. Nevertheless, these networks do not consider the physical roto-reflective symmetries inherent in IMU data, leading to the need to memorize the same priors for every possible motion direction, which hinders generalization. In this work, we characterize these symmetries and show that the IMU data and the resulting displacement and covariance transform equivariantly, when rotated around the gravity vector and reflected with respect to arbitrary planes parallel to gravity. We design a neural network that respects these symmetries by design through equivariant processing in three steps: First, it estimates an equivariant gravity-aligned frame from equivariant vectors and invariant scalars derived from IMU data, leveraging expressive linear and non-linear layers tailored to commute with the underlying symmetry transformation. We then map the IMU data into this frame, thereby achieving an invariant canonicalization that can be directly used with off-the-shelf inertial odometry networks. Finally, we map these network outputs back into the original frame, thereby obtaining equivariant covariances and displacements. We demonstrate the generality of our framework by applying it to the filter-based approach based on TLIO, and the end-to-end RONIN architecture, and show better performance on the TLIO, Aria, RIDI and OxIOD datasets than existing methods.
format Preprint
id arxiv_https___arxiv_org_abs_2408_06321
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle EqNIO: Subequivariant Neural Inertial Odometry
Jayanth, Royina Karegoudra
Xu, Yinshuang
Wang, Ziyun
Chatzipantazis, Evangelos
Gehrig, Daniel
Daniilidis, Kostas
Robotics
Computer Vision and Pattern Recognition
Neural networks are seeing rapid adoption in purely inertial odometry, where accelerometer and gyroscope measurements from commodity inertial measurement units (IMU) are used to regress displacements and associated uncertainties. They can learn informative displacement priors, which can be directly fused with the raw data with off-the-shelf non-linear filters. Nevertheless, these networks do not consider the physical roto-reflective symmetries inherent in IMU data, leading to the need to memorize the same priors for every possible motion direction, which hinders generalization. In this work, we characterize these symmetries and show that the IMU data and the resulting displacement and covariance transform equivariantly, when rotated around the gravity vector and reflected with respect to arbitrary planes parallel to gravity. We design a neural network that respects these symmetries by design through equivariant processing in three steps: First, it estimates an equivariant gravity-aligned frame from equivariant vectors and invariant scalars derived from IMU data, leveraging expressive linear and non-linear layers tailored to commute with the underlying symmetry transformation. We then map the IMU data into this frame, thereby achieving an invariant canonicalization that can be directly used with off-the-shelf inertial odometry networks. Finally, we map these network outputs back into the original frame, thereby obtaining equivariant covariances and displacements. We demonstrate the generality of our framework by applying it to the filter-based approach based on TLIO, and the end-to-end RONIN architecture, and show better performance on the TLIO, Aria, RIDI and OxIOD datasets than existing methods.
title EqNIO: Subequivariant Neural Inertial Odometry
topic Robotics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2408.06321