A Novel Perception and Semantic Mapping Method for Robot Autonomy in Orchards

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Pan, Yaoqiang, Cao, Hao, Hu, Kewei, Kang, Hanwen, Wang, Xing
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909153292713984
author Pan, Yaoqiang
Cao, Hao
Hu, Kewei
Kang, Hanwen
Wang, Xing
author_facet Pan, Yaoqiang
Cao, Hao
Hu, Kewei
Kang, Hanwen
Wang, Xing
contents Agricultural robots must navigate challenging dynamic and semi-structured environments. Recently, environmental modeling using LiDAR-based SLAM has shown promise in providing highly accurate geometry. However, how this chaotic environmental information can be used to achieve effective robot automation in the agricultural sector remains unexplored. In this study, we propose a novel semantic mapping and navigation framework for achieving robotic autonomy in orchards. It consists of two main components: a semantic processing module and a navigation module. First, we present a novel 3D detection network architecture, 3D-ODN, which can accurately process object instance information from point clouds. Second, we develop a framework to construct the visibility map by incorporating semantic information and terrain analysis. By combining these two critical components, our framework is evaluated in a number of key horticultural production scenarios, including a robotic system for in-situ phenotyping and daily monitoring, and a selective harvesting system in apple orchards. The experimental results show that our method can ensure high accuracy in understanding the environment and enable reliable robot autonomy in agricultural environments.
format Preprint
id arxiv_https___arxiv_org_abs_2308_16748
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle A Novel Perception and Semantic Mapping Method for Robot Autonomy in Orchards
Pan, Yaoqiang
Cao, Hao
Hu, Kewei
Kang, Hanwen
Wang, Xing
Robotics
Agricultural robots must navigate challenging dynamic and semi-structured environments. Recently, environmental modeling using LiDAR-based SLAM has shown promise in providing highly accurate geometry. However, how this chaotic environmental information can be used to achieve effective robot automation in the agricultural sector remains unexplored. In this study, we propose a novel semantic mapping and navigation framework for achieving robotic autonomy in orchards. It consists of two main components: a semantic processing module and a navigation module. First, we present a novel 3D detection network architecture, 3D-ODN, which can accurately process object instance information from point clouds. Second, we develop a framework to construct the visibility map by incorporating semantic information and terrain analysis. By combining these two critical components, our framework is evaluated in a number of key horticultural production scenarios, including a robotic system for in-situ phenotyping and daily monitoring, and a selective harvesting system in apple orchards. The experimental results show that our method can ensure high accuracy in understanding the environment and enable reliable robot autonomy in agricultural environments.
title A Novel Perception and Semantic Mapping Method for Robot Autonomy in Orchards
topic Robotics
url https://arxiv.org/abs/2308.16748