On the Benefits of Visual Stabilization for Frame- and Event-based Perception
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866914927327838208 |
|---|---|
| author | Rodriguez-Gomez, Juan Pablo Dios, Jose Ramiro Martinez-de Ollero, Anibal Gallego, Guillermo |
| author_facet | Rodriguez-Gomez, Juan Pablo Dios, Jose Ramiro Martinez-de Ollero, Anibal Gallego, Guillermo |
| contents | Vision-based perception systems are typically exposed to large orientation changes in different robot applications. In such conditions, their performance might be compromised due to the inherent complexity of processing data captured under challenging motion. Integration of mechanical stabilizers to compensate for the camera rotation is not always possible due to the robot payload constraints. This paper presents a processing-based stabilization approach to compensate the camera's rotational motion both on events and on frames (i.e., images). Assuming that the camera's attitude is available, we evaluate the benefits of stabilization in two perception applications: feature tracking and estimating the translation component of the camera's ego-motion. The validation is performed using synthetic data and sequences from well-known event-based vision datasets. The experiments unveil that stabilization can improve feature tracking and camera ego-motion estimation accuracy in 27.37% and 34.82%, respectively. Concurrently, stabilization can reduce the processing time of computing the camera's linear velocity by at least 25%. Code is available at https://github.com/tub-rip/visual_stabilization |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_15602 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | On the Benefits of Visual Stabilization for Frame- and Event-based Perception Rodriguez-Gomez, Juan Pablo Dios, Jose Ramiro Martinez-de Ollero, Anibal Gallego, Guillermo Robotics Computer Vision and Pattern Recognition Image and Video Processing Vision-based perception systems are typically exposed to large orientation changes in different robot applications. In such conditions, their performance might be compromised due to the inherent complexity of processing data captured under challenging motion. Integration of mechanical stabilizers to compensate for the camera rotation is not always possible due to the robot payload constraints. This paper presents a processing-based stabilization approach to compensate the camera's rotational motion both on events and on frames (i.e., images). Assuming that the camera's attitude is available, we evaluate the benefits of stabilization in two perception applications: feature tracking and estimating the translation component of the camera's ego-motion. The validation is performed using synthetic data and sequences from well-known event-based vision datasets. The experiments unveil that stabilization can improve feature tracking and camera ego-motion estimation accuracy in 27.37% and 34.82%, respectively. Concurrently, stabilization can reduce the processing time of computing the camera's linear velocity by at least 25%. Code is available at https://github.com/tub-rip/visual_stabilization |
| title | On the Benefits of Visual Stabilization for Frame- and Event-based Perception |
| topic | Robotics Computer Vision and Pattern Recognition Image and Video Processing |
| url | https://arxiv.org/abs/2408.15602 |