Iterative Event-based Motion Segmentation by Variational Contrast Maximization

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Yamaki, Ryo, Shiba, Shintaro, Gallego, Guillermo, Aoki, Yoshimitsu
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913807651045376
author Yamaki, Ryo
Shiba, Shintaro
Gallego, Guillermo
Aoki, Yoshimitsu
author_facet Yamaki, Ryo
Shiba, Shintaro
Gallego, Guillermo
Aoki, Yoshimitsu
contents Event cameras provide rich signals that are suitable for motion estimation since they respond to changes in the scene. As any visual changes in the scene produce event data, it is paramount to classify the data into different motions (i.e., motion segmentation), which is useful for various tasks such as object detection and visual servoing. We propose an iterative motion segmentation method, by classifying events into background (e.g., dominant motion hypothesis) and foreground (independent motion residuals), thus extending the Contrast Maximization framework. Experimental results demonstrate that the proposed method successfully classifies event clusters both for public and self-recorded datasets, producing sharp, motion-compensated edge-like images. The proposed method achieves state-of-the-art accuracy on moving object detection benchmarks with an improvement of over 30%, and demonstrates its possibility of applying to more complex and noisy real-world scenes. We hope this work broadens the sensitivity of Contrast Maximization with respect to both motion parameters and input events, thus contributing to theoretical advancements in event-based motion segmentation estimation. https://github.com/aoki-media-lab/event_based_segmentation_vcmax
format Preprint
id arxiv_https___arxiv_org_abs_2504_18447
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Iterative Event-based Motion Segmentation by Variational Contrast Maximization
Yamaki, Ryo
Shiba, Shintaro
Gallego, Guillermo
Aoki, Yoshimitsu
Computer Vision and Pattern Recognition
Artificial Intelligence
Image and Video Processing
Event cameras provide rich signals that are suitable for motion estimation since they respond to changes in the scene. As any visual changes in the scene produce event data, it is paramount to classify the data into different motions (i.e., motion segmentation), which is useful for various tasks such as object detection and visual servoing. We propose an iterative motion segmentation method, by classifying events into background (e.g., dominant motion hypothesis) and foreground (independent motion residuals), thus extending the Contrast Maximization framework. Experimental results demonstrate that the proposed method successfully classifies event clusters both for public and self-recorded datasets, producing sharp, motion-compensated edge-like images. The proposed method achieves state-of-the-art accuracy on moving object detection benchmarks with an improvement of over 30%, and demonstrates its possibility of applying to more complex and noisy real-world scenes. We hope this work broadens the sensitivity of Contrast Maximization with respect to both motion parameters and input events, thus contributing to theoretical advancements in event-based motion segmentation estimation. https://github.com/aoki-media-lab/event_based_segmentation_vcmax
title Iterative Event-based Motion Segmentation by Variational Contrast Maximization
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Image and Video Processing
url https://arxiv.org/abs/2504.18447