Vision-assisted Avocado Harvesting with Aerial Bimanual Manipulation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Liu, Zhichao, Zhou, Jingzong, Mucchiani, Caio, Karydis, Konstantinos
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911992980176896
author Liu, Zhichao
Zhou, Jingzong
Mucchiani, Caio
Karydis, Konstantinos
author_facet Liu, Zhichao
Zhou, Jingzong
Mucchiani, Caio
Karydis, Konstantinos
contents Robotic fruit harvesting holds potential in precision agriculture to improve harvesting efficiency. While ground mobile robots are mostly employed in fruit harvesting, certain crops, like avocado trees, cannot be harvested efficiently from the ground alone. This is because of unstructured ground and planting arrangement and high-to-reach fruits. In such cases, aerial robots integrated with manipulation capabilities can pave new ways in robotic harvesting. This paper outlines the design and implementation of a bimanual UAV that employs visual perception and learning to autonomously detect avocados, reach, and harvest them. The dual-arm system comprises a gripper and a fixer arm, to address a key challenge when harvesting avocados: once grasped, a rotational motion is the most efficient way to detach the avocado from the peduncle; however, the peduncle may store elastic energy preventing the avocado from being harvested. The fixer arm aims to stabilize the peduncle, allowing the gripper arm to harvest. The integrated visual perception process enables the detection of avocados and the determination of their pose; the latter is then used to determine target points for a bimanual manipulation planner. Several experiments are conducted to assess the efficacy of each component, and integrated experiments assess the effectiveness of the system.
format Preprint
id arxiv_https___arxiv_org_abs_2408_09058
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Vision-assisted Avocado Harvesting with Aerial Bimanual Manipulation
Liu, Zhichao
Zhou, Jingzong
Mucchiani, Caio
Karydis, Konstantinos
Robotics
Robotic fruit harvesting holds potential in precision agriculture to improve harvesting efficiency. While ground mobile robots are mostly employed in fruit harvesting, certain crops, like avocado trees, cannot be harvested efficiently from the ground alone. This is because of unstructured ground and planting arrangement and high-to-reach fruits. In such cases, aerial robots integrated with manipulation capabilities can pave new ways in robotic harvesting. This paper outlines the design and implementation of a bimanual UAV that employs visual perception and learning to autonomously detect avocados, reach, and harvest them. The dual-arm system comprises a gripper and a fixer arm, to address a key challenge when harvesting avocados: once grasped, a rotational motion is the most efficient way to detach the avocado from the peduncle; however, the peduncle may store elastic energy preventing the avocado from being harvested. The fixer arm aims to stabilize the peduncle, allowing the gripper arm to harvest. The integrated visual perception process enables the detection of avocados and the determination of their pose; the latter is then used to determine target points for a bimanual manipulation planner. Several experiments are conducted to assess the efficacy of each component, and integrated experiments assess the effectiveness of the system.
title Vision-assisted Avocado Harvesting with Aerial Bimanual Manipulation
topic Robotics
url https://arxiv.org/abs/2408.09058