Real-time object detection and robotic manipulation for agriculture using a YOLO-based learning approach
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913213859233792 |
|---|---|
| author | Zhao, Hongyu Tang, Zezhi Li, Zhenhong Dong, Yi Si, Yuancheng Lu, Mingyang Panoutsos, George |
| author_facet | Zhao, Hongyu Tang, Zezhi Li, Zhenhong Dong, Yi Si, Yuancheng Lu, Mingyang Panoutsos, George |
| contents | The optimisation of crop harvesting processes for commonly cultivated crops is of great importance in the aim of agricultural industrialisation. Nowadays, the utilisation of machine vision has enabled the automated identification of crops, leading to the enhancement of harvesting efficiency, but challenges still exist. This study presents a new framework that combines two separate architectures of convolutional neural networks (CNNs) in order to simultaneously accomplish the tasks of crop detection and harvesting (robotic manipulation) inside a simulated environment. Crop images in the simulated environment are subjected to random rotations, cropping, brightness, and contrast adjustments to create augmented images for dataset generation. The you only look once algorithmic framework is employed with traditional rectangular bounding boxes for crop localization. The proposed method subsequently utilises the acquired image data via a visual geometry group model in order to reveal the grasping positions for the robotic manipulation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_15785 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Real-time object detection and robotic manipulation for agriculture using a YOLO-based learning approach Zhao, Hongyu Tang, Zezhi Li, Zhenhong Dong, Yi Si, Yuancheng Lu, Mingyang Panoutsos, George Computer Vision and Pattern Recognition Machine Learning Robotics The optimisation of crop harvesting processes for commonly cultivated crops is of great importance in the aim of agricultural industrialisation. Nowadays, the utilisation of machine vision has enabled the automated identification of crops, leading to the enhancement of harvesting efficiency, but challenges still exist. This study presents a new framework that combines two separate architectures of convolutional neural networks (CNNs) in order to simultaneously accomplish the tasks of crop detection and harvesting (robotic manipulation) inside a simulated environment. Crop images in the simulated environment are subjected to random rotations, cropping, brightness, and contrast adjustments to create augmented images for dataset generation. The you only look once algorithmic framework is employed with traditional rectangular bounding boxes for crop localization. The proposed method subsequently utilises the acquired image data via a visual geometry group model in order to reveal the grasping positions for the robotic manipulation. |
| title | Real-time object detection and robotic manipulation for agriculture using a YOLO-based learning approach |
| topic | Computer Vision and Pattern Recognition Machine Learning Robotics |
| url | https://arxiv.org/abs/2401.15785 |