Saved in:
Bibliographic Details
Main Authors: Wang, Ziwei, Molloy, Timothy, van Goor, Pieter, Mahony, Robert
Format: Preprint
Published: 2023
Subjects:
Online Access:https://arxiv.org/abs/2307.10593
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913491161448448
author Wang, Ziwei
Molloy, Timothy
van Goor, Pieter
Mahony, Robert
author_facet Wang, Ziwei
Molloy, Timothy
van Goor, Pieter
Mahony, Robert
contents Event-based cameras are popular for tracking fast-moving objects due to their high temporal resolution, low latency, and high dynamic range. In this paper, we propose a novel algorithm for tracking event blobs using raw events asynchronously in real time. We introduce the concept of an event blob as a spatio-temporal likelihood of event occurrence where the conditional spatial likelihood is blob-like. Many real-world objects such as car headlights or any quickly moving foreground objects generate event blob data. The proposed algorithm uses a nearest neighbour classifier with a dynamic threshold criteria for data association coupled with an extended Kalman filter to track the event blob state. Our algorithm achieves highly accurate blob tracking, velocity estimation, and shape estimation even under challenging lighting conditions and high-speed motions (> 11000 pixels/s). The microsecond time resolution achieved means that the filter output can be used to derive secondary information such as time-to-contact or range estimation, that will enable applications to real-world problems such as collision avoidance in autonomous driving.
format Preprint
id arxiv_https___arxiv_org_abs_2307_10593
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Asynchronous Blob Tracker for Event Cameras
Wang, Ziwei
Molloy, Timothy
van Goor, Pieter
Mahony, Robert
Computer Vision and Pattern Recognition
Event-based cameras are popular for tracking fast-moving objects due to their high temporal resolution, low latency, and high dynamic range. In this paper, we propose a novel algorithm for tracking event blobs using raw events asynchronously in real time. We introduce the concept of an event blob as a spatio-temporal likelihood of event occurrence where the conditional spatial likelihood is blob-like. Many real-world objects such as car headlights or any quickly moving foreground objects generate event blob data. The proposed algorithm uses a nearest neighbour classifier with a dynamic threshold criteria for data association coupled with an extended Kalman filter to track the event blob state. Our algorithm achieves highly accurate blob tracking, velocity estimation, and shape estimation even under challenging lighting conditions and high-speed motions (> 11000 pixels/s). The microsecond time resolution achieved means that the filter output can be used to derive secondary information such as time-to-contact or range estimation, that will enable applications to real-world problems such as collision avoidance in autonomous driving.
title Asynchronous Blob Tracker for Event Cameras
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2307.10593