Saved in:
Bibliographic Details
Main Authors: Li, Jinghang, Li, Shichao, Lian, Qing, Li, Peiliang, Chen, Xiaozhi, Zhou, Yi
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2603.16303
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914401975533568
author Li, Jinghang
Li, Shichao
Lian, Qing
Li, Peiliang
Chen, Xiaozhi
Zhou, Yi
author_facet Li, Jinghang
Li, Shichao
Lian, Qing
Li, Peiliang
Chen, Xiaozhi
Zhou, Yi
contents Recent visual autonomous perception systems achieve remarkable performances with deep representation learning. However, they fail in scenarios with challenging illumination.While event cameras can mitigate this problem, there is a lack of a large-scale dataset to develop event-enhanced deep visual perception models in autonomous driving scenes. To address the gap, we present the eAP (event-enhanced Autonomous Perception) dataset, the largest dataset with event cameras for autonomous perception. We demonstrate how eAP can facilitate the study of different autonomous perception tasks, including 3D vehicle detection and object time-to-contact (TTC) estimation, through deep representation learning. Based on eAP, we demonstrate the ffrst successful use of events to improve a popular 3D vehicle detection network in challenging illumination scenarios. eAP also enables a devoted study of the representation learning problem of object TTC estimation. We show how a geometryaware representation learning framework leads to the best eventbased object TTC estimation network that operates at 200 FPS. The dataset, code, and pre-trained models will be made publicly available for future research.
format Preprint
id arxiv_https___arxiv_org_abs_2603_16303
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Toward Deep Representation Learning for Event-Enhanced Visual Autonomous Perception: the eAP Dataset
Li, Jinghang
Li, Shichao
Lian, Qing
Li, Peiliang
Chen, Xiaozhi
Zhou, Yi
Robotics
Recent visual autonomous perception systems achieve remarkable performances with deep representation learning. However, they fail in scenarios with challenging illumination.While event cameras can mitigate this problem, there is a lack of a large-scale dataset to develop event-enhanced deep visual perception models in autonomous driving scenes. To address the gap, we present the eAP (event-enhanced Autonomous Perception) dataset, the largest dataset with event cameras for autonomous perception. We demonstrate how eAP can facilitate the study of different autonomous perception tasks, including 3D vehicle detection and object time-to-contact (TTC) estimation, through deep representation learning. Based on eAP, we demonstrate the ffrst successful use of events to improve a popular 3D vehicle detection network in challenging illumination scenarios. eAP also enables a devoted study of the representation learning problem of object TTC estimation. We show how a geometryaware representation learning framework leads to the best eventbased object TTC estimation network that operates at 200 FPS. The dataset, code, and pre-trained models will be made publicly available for future research.
title Toward Deep Representation Learning for Event-Enhanced Visual Autonomous Perception: the eAP Dataset
topic Robotics
url https://arxiv.org/abs/2603.16303