Retina-Inspired Object Motion Segmentation for Event-Cameras
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866913599911362560 |
|---|---|
| author | Clerico, Victoria Snyder, Shay Lohia, Arya Kaiser, Md Abdullah-Al Schwartz, Gregory Jaiswal, Akhilesh Parsa, Maryam |
| author_facet | Clerico, Victoria Snyder, Shay Lohia, Arya Kaiser, Md Abdullah-Al Schwartz, Gregory Jaiswal, Akhilesh Parsa, Maryam |
| contents | Event-cameras have emerged as a revolutionary technology with a high temporal resolution that far surpasses standard active pixel cameras. This technology draws biological inspiration from photoreceptors and the initial retinal synapse. This research showcases the potential of additional retinal functionalities to extract visual features. We provide a domain-agnostic and efficient algorithm for ego-motion compensation based on Object Motion Sensitivity (OMS), one of the multiple features computed within the mammalian retina. We develop a method based on experimental neuroscience that translates OMS' biological circuitry to a low-overhead algorithm to suppress camera motion bypassing the need for deep networks and learning. Our system processes event data from dynamic scenes to perform pixel-wise object motion segmentation using a real and synthetic dataset. This paper introduces a bio-inspired computer vision method that dramatically reduces the number of parameters by $\text{10}^\text{3}$ to $\text{10}^\text{6}$ orders of magnitude compared to previous approaches. Our work paves the way for robust, high-speed, and low-bandwidth decision-making for in-sensor computations. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_09454 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Retina-Inspired Object Motion Segmentation for Event-Cameras Clerico, Victoria Snyder, Shay Lohia, Arya Kaiser, Md Abdullah-Al Schwartz, Gregory Jaiswal, Akhilesh Parsa, Maryam Computer Vision and Pattern Recognition Neural and Evolutionary Computing Image and Video Processing Event-cameras have emerged as a revolutionary technology with a high temporal resolution that far surpasses standard active pixel cameras. This technology draws biological inspiration from photoreceptors and the initial retinal synapse. This research showcases the potential of additional retinal functionalities to extract visual features. We provide a domain-agnostic and efficient algorithm for ego-motion compensation based on Object Motion Sensitivity (OMS), one of the multiple features computed within the mammalian retina. We develop a method based on experimental neuroscience that translates OMS' biological circuitry to a low-overhead algorithm to suppress camera motion bypassing the need for deep networks and learning. Our system processes event data from dynamic scenes to perform pixel-wise object motion segmentation using a real and synthetic dataset. This paper introduces a bio-inspired computer vision method that dramatically reduces the number of parameters by $\text{10}^\text{3}$ to $\text{10}^\text{6}$ orders of magnitude compared to previous approaches. Our work paves the way for robust, high-speed, and low-bandwidth decision-making for in-sensor computations. |
| title | Retina-Inspired Object Motion Segmentation for Event-Cameras |
| topic | Computer Vision and Pattern Recognition Neural and Evolutionary Computing Image and Video Processing |
| url | https://arxiv.org/abs/2408.09454 |