Saved in:
Bibliographic Details
Main Authors: Chen, Suchang, Fan, Dongliang, Feng, Huijuan, Dai, Jian S
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2410.08691
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911314920603648
author Chen, Suchang
Fan, Dongliang
Feng, Huijuan
Dai, Jian S
author_facet Chen, Suchang
Fan, Dongliang
Feng, Huijuan
Dai, Jian S
contents This work introduces a novel bio-inspired reconfigurable stereo vision system for robotics, leveraging omnidirectional cameras and a novel algorithm to achieve flexible visual capabilities. Inspired by the adaptive vision of various species, our visual system addresses traditional stereo vision limitations, i.e., immutable camera alignment with narrow fields of view, by introducing a reconfigurable stereo vision system to robotics. Our key innovations include the reconfigurable stereo vision strategy that allows dynamic camera alignment, a robust depth measurement system utilizing a nonrectified geometrical method combined with a deep neural network for feature matching, and a geometrical compensation technique to enhance visual accuracy. Implemented on a metamorphic robot, this vision system demonstrates its great adaptability to various scenarios by switching its configurations of 316° monocular with 79° binocular field for fast target seeking and 242° monocular with 150° binocular field for detailed close inspection.
format Preprint
id arxiv_https___arxiv_org_abs_2410_08691
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Bio-inspired reconfigurable stereo vision for robotics using omnidirectional cameras
Chen, Suchang
Fan, Dongliang
Feng, Huijuan
Dai, Jian S
Robotics
This work introduces a novel bio-inspired reconfigurable stereo vision system for robotics, leveraging omnidirectional cameras and a novel algorithm to achieve flexible visual capabilities. Inspired by the adaptive vision of various species, our visual system addresses traditional stereo vision limitations, i.e., immutable camera alignment with narrow fields of view, by introducing a reconfigurable stereo vision system to robotics. Our key innovations include the reconfigurable stereo vision strategy that allows dynamic camera alignment, a robust depth measurement system utilizing a nonrectified geometrical method combined with a deep neural network for feature matching, and a geometrical compensation technique to enhance visual accuracy. Implemented on a metamorphic robot, this vision system demonstrates its great adaptability to various scenarios by switching its configurations of 316° monocular with 79° binocular field for fast target seeking and 242° monocular with 150° binocular field for detailed close inspection.
title Bio-inspired reconfigurable stereo vision for robotics using omnidirectional cameras
topic Robotics
url https://arxiv.org/abs/2410.08691