An Event-based Fast Intensity Reconstruction Scheme for UAV Real-time Perception

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Dong, Xin, Zhang, Yiwei, Cui, Yangjie, Xiang, Jinwu, Li, Daochun, Tu, Zhan
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912518410076160
author Dong, Xin
Zhang, Yiwei
Cui, Yangjie
Xiang, Jinwu
Li, Daochun
Tu, Zhan
author_facet Dong, Xin
Zhang, Yiwei
Cui, Yangjie
Xiang, Jinwu
Li, Daochun
Tu, Zhan
contents Event cameras offer significant advantages, including a wide dynamic range, high temporal resolution, and immunity to motion blur, making them highly promising for addressing challenging visual conditions. Extracting and utilizing effective information from asynchronous event streams is essential for the onboard implementation of event cameras. In this paper, we propose a streamlined event-based intensity reconstruction scheme, event-based single integration (ESI), to address such implementation challenges. This method guarantees the portability of conventional frame-based vision methods to event-based scenarios and maintains the intrinsic advantages of event cameras. The ESI approach reconstructs intensity images by performing a single integration of the event streams combined with an enhanced decay algorithm. Such a method enables real-time intensity reconstruction at a high frame rate, typically 100 FPS. Furthermore, the relatively low computation load of ESI fits onboard implementation suitably, such as in UAV-based visual tracking scenarios. Extensive experiments have been conducted to evaluate the performance comparison of ESI and state-of-the-art algorithms. Compared to state-of-the-art algorithms, ESI demonstrates remarkable runtime efficiency improvements, superior reconstruction quality, and a high frame rate. As a result, ESI enhances UAV onboard perception significantly under visual adversary surroundings. In-flight tests, ESI demonstrates effective performance for UAV onboard visual tracking under extremely low illumination conditions(2-10lux), whereas other comparative algorithms fail due to insufficient frame rate, poor image quality, or limited real-time performance.
format Preprint
id arxiv_https___arxiv_org_abs_2508_02238
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle An Event-based Fast Intensity Reconstruction Scheme for UAV Real-time Perception
Dong, Xin
Zhang, Yiwei
Cui, Yangjie
Xiang, Jinwu
Li, Daochun
Tu, Zhan
Computer Vision and Pattern Recognition
Robotics
Event cameras offer significant advantages, including a wide dynamic range, high temporal resolution, and immunity to motion blur, making them highly promising for addressing challenging visual conditions. Extracting and utilizing effective information from asynchronous event streams is essential for the onboard implementation of event cameras. In this paper, we propose a streamlined event-based intensity reconstruction scheme, event-based single integration (ESI), to address such implementation challenges. This method guarantees the portability of conventional frame-based vision methods to event-based scenarios and maintains the intrinsic advantages of event cameras. The ESI approach reconstructs intensity images by performing a single integration of the event streams combined with an enhanced decay algorithm. Such a method enables real-time intensity reconstruction at a high frame rate, typically 100 FPS. Furthermore, the relatively low computation load of ESI fits onboard implementation suitably, such as in UAV-based visual tracking scenarios. Extensive experiments have been conducted to evaluate the performance comparison of ESI and state-of-the-art algorithms. Compared to state-of-the-art algorithms, ESI demonstrates remarkable runtime efficiency improvements, superior reconstruction quality, and a high frame rate. As a result, ESI enhances UAV onboard perception significantly under visual adversary surroundings. In-flight tests, ESI demonstrates effective performance for UAV onboard visual tracking under extremely low illumination conditions(2-10lux), whereas other comparative algorithms fail due to insufficient frame rate, poor image quality, or limited real-time performance.
title An Event-based Fast Intensity Reconstruction Scheme for UAV Real-time Perception
topic Computer Vision and Pattern Recognition
Robotics
url https://arxiv.org/abs/2508.02238