eNavi: Event-based Imitation Policies for Low-Light Indoor Mobile Robot Navigation

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Ramesh, Prithvi Jai, Chanda, Kaustav, Vinod, Krishna, Vishal, Joseph Raj, Yang, Yezhou, Chakravarthi, Bharatesh
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912967158661120
author Ramesh, Prithvi Jai
Chanda, Kaustav
Vinod, Krishna
Vishal, Joseph Raj
Yang, Yezhou
Chakravarthi, Bharatesh
author_facet Ramesh, Prithvi Jai
Chanda, Kaustav
Vinod, Krishna
Vishal, Joseph Raj
Yang, Yezhou
Chakravarthi, Bharatesh
contents Event cameras provide high dynamic range and microsecond-level temporal resolution, making them well-suited for indoor robot navigation, where conventional RGB cameras degrade under fast motion or low-light conditions. Despite advances in event-based perception spanning detection, SLAM, and pose estimation, there remains limited research on end-to-end control policies that exploit the asynchronous nature of event streams. To address this gap, we introduce a real-world indoor person-following dataset collected using a TurtleBot 2 robot, featuring synchronized raw event streams, RGB frames, and expert control actions across multiple indoor maps, trajectories under both normal and low-light conditions. We further build a multimodal data preprocessing pipeline that temporally aligns event and RGB observations while reconstructing ground-truth actions from odometry to support high-quality imitation learning. Building on this dataset, we propose a late-fusion RGB-Event navigation policy that combines dual MobileNet encoders with a transformer-based fusion module trained via behavioral cloning. A systematic evaluation of RGB-only, Event-only, and RGB-Event fusion models across 12 training variations ranging from single-path imitation to general multi-path imitation shows that policies incorporating event data, particularly the fusion model, achieve improved robustness and lower action prediction error, especially in unseen low-light conditions where RGB-only models fail. We release the dataset, synchronization pipeline, and trained models at https://eventbasedvision.github.io/eNavi/
format Preprint
id arxiv_https___arxiv_org_abs_2603_14397
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle eNavi: Event-based Imitation Policies for Low-Light Indoor Mobile Robot Navigation
Ramesh, Prithvi Jai
Chanda, Kaustav
Vinod, Krishna
Vishal, Joseph Raj
Yang, Yezhou
Chakravarthi, Bharatesh
Robotics
Event cameras provide high dynamic range and microsecond-level temporal resolution, making them well-suited for indoor robot navigation, where conventional RGB cameras degrade under fast motion or low-light conditions. Despite advances in event-based perception spanning detection, SLAM, and pose estimation, there remains limited research on end-to-end control policies that exploit the asynchronous nature of event streams. To address this gap, we introduce a real-world indoor person-following dataset collected using a TurtleBot 2 robot, featuring synchronized raw event streams, RGB frames, and expert control actions across multiple indoor maps, trajectories under both normal and low-light conditions. We further build a multimodal data preprocessing pipeline that temporally aligns event and RGB observations while reconstructing ground-truth actions from odometry to support high-quality imitation learning. Building on this dataset, we propose a late-fusion RGB-Event navigation policy that combines dual MobileNet encoders with a transformer-based fusion module trained via behavioral cloning. A systematic evaluation of RGB-only, Event-only, and RGB-Event fusion models across 12 training variations ranging from single-path imitation to general multi-path imitation shows that policies incorporating event data, particularly the fusion model, achieve improved robustness and lower action prediction error, especially in unseen low-light conditions where RGB-only models fail. We release the dataset, synchronization pipeline, and trained models at https://eventbasedvision.github.io/eNavi/
title eNavi: Event-based Imitation Policies for Low-Light Indoor Mobile Robot Navigation
topic Robotics
url https://arxiv.org/abs/2603.14397