Event-Based Motion Segmentation by Motion Compensation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Stoffregen, Timo, Gallego, Guillermo, Drummond, Tom, Kleeman, Lindsay, Scaramuzza, Davide
Formato: Preprint
Publicado: 2019
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909663229902848
author Stoffregen, Timo
Gallego, Guillermo
Drummond, Tom
Kleeman, Lindsay
Scaramuzza, Davide
author_facet Stoffregen, Timo
Gallego, Guillermo
Drummond, Tom
Kleeman, Lindsay
Scaramuzza, Davide
contents In contrast to traditional cameras, whose pixels have a common exposure time, event-based cameras are novel bio-inspired sensors whose pixels work independently and asynchronously output intensity changes (called "events"), with microsecond resolution. Since events are caused by the apparent motion of objects, event-based cameras sample visual information based on the scene dynamics and are, therefore, a more natural fit than traditional cameras to acquire motion, especially at high speeds, where traditional cameras suffer from motion blur. However, distinguishing between events caused by different moving objects and by the camera's ego-motion is a challenging task. We present the first per-event segmentation method for splitting a scene into independently moving objects. Our method jointly estimates the event-object associations (i.e., segmentation) and the motion parameters of the objects (or the background) by maximization of an objective function, which builds upon recent results on event-based motion-compensation. We provide a thorough evaluation of our method on a public dataset, outperforming the state-of-the-art by as much as 10%. We also show the first quantitative evaluation of a segmentation algorithm for event cameras, yielding around 90% accuracy at 4 pixels relative displacement.
format Preprint
id arxiv_https___arxiv_org_abs_1904_01293
institution arXiv
publishDate 2019
record_format arxiv
spellingShingle Event-Based Motion Segmentation by Motion Compensation
Stoffregen, Timo
Gallego, Guillermo
Drummond, Tom
Kleeman, Lindsay
Scaramuzza, Davide
Computer Vision and Pattern Recognition
In contrast to traditional cameras, whose pixels have a common exposure time, event-based cameras are novel bio-inspired sensors whose pixels work independently and asynchronously output intensity changes (called "events"), with microsecond resolution. Since events are caused by the apparent motion of objects, event-based cameras sample visual information based on the scene dynamics and are, therefore, a more natural fit than traditional cameras to acquire motion, especially at high speeds, where traditional cameras suffer from motion blur. However, distinguishing between events caused by different moving objects and by the camera's ego-motion is a challenging task. We present the first per-event segmentation method for splitting a scene into independently moving objects. Our method jointly estimates the event-object associations (i.e., segmentation) and the motion parameters of the objects (or the background) by maximization of an objective function, which builds upon recent results on event-based motion-compensation. We provide a thorough evaluation of our method on a public dataset, outperforming the state-of-the-art by as much as 10%. We also show the first quantitative evaluation of a segmentation algorithm for event cameras, yielding around 90% accuracy at 4 pixels relative displacement.
title Event-Based Motion Segmentation by Motion Compensation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/1904.01293