Autonomous Aggregate Sorting in Construction and Mining via Computer Vision-Aided Robotic Arm Systems

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Shawon, Md. Taherul Islam, Li, Yuan, Cai, Yincai, Niu, Junjie, Peng, Ting
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916926014357504
author Shawon, Md. Taherul Islam
Li, Yuan
Cai, Yincai
Niu, Junjie
Peng, Ting
author_facet Shawon, Md. Taherul Islam
Li, Yuan
Cai, Yincai
Niu, Junjie
Peng, Ting
contents Traditional aggregate sorting methods, whether manual or mechanical, often suffer from low precision, limited flexibility, and poor adaptability to diverse material properties such as size, shape, and lithology. To address these limitations, this study presents a computer vision-aided robotic arm system designed for autonomous aggregate sorting in construction and mining applications. The system integrates a six-degree-of-freedom robotic arm, a binocular stereo camera for 3D perception, and a ROS-based control framework. Core techniques include an attention-augmented YOLOv8 model for aggregate detection, stereo matching for 3D localization, Denavit-Hartenberg kinematic modeling for arm motion control, minimum enclosing rectangle analysis for size estimation, and hand-eye calibration for precise coordinate alignment. Experimental validation with four aggregate types achieved an average grasping and sorting success rate of 97.5%, with comparable classification accuracy. Remaining challenges include the reliable handling of small aggregates and texture-based misclassification. Overall, the proposed system demonstrates significant potential to enhance productivity, reduce operational costs, and improve safety in aggregate handling, while providing a scalable framework for advancing smart automation in construction, mining, and recycling industries.
format Preprint
id arxiv_https___arxiv_org_abs_2509_00339
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Autonomous Aggregate Sorting in Construction and Mining via Computer Vision-Aided Robotic Arm Systems
Shawon, Md. Taherul Islam
Li, Yuan
Cai, Yincai
Niu, Junjie
Peng, Ting
Robotics
Traditional aggregate sorting methods, whether manual or mechanical, often suffer from low precision, limited flexibility, and poor adaptability to diverse material properties such as size, shape, and lithology. To address these limitations, this study presents a computer vision-aided robotic arm system designed for autonomous aggregate sorting in construction and mining applications. The system integrates a six-degree-of-freedom robotic arm, a binocular stereo camera for 3D perception, and a ROS-based control framework. Core techniques include an attention-augmented YOLOv8 model for aggregate detection, stereo matching for 3D localization, Denavit-Hartenberg kinematic modeling for arm motion control, minimum enclosing rectangle analysis for size estimation, and hand-eye calibration for precise coordinate alignment. Experimental validation with four aggregate types achieved an average grasping and sorting success rate of 97.5%, with comparable classification accuracy. Remaining challenges include the reliable handling of small aggregates and texture-based misclassification. Overall, the proposed system demonstrates significant potential to enhance productivity, reduce operational costs, and improve safety in aggregate handling, while providing a scalable framework for advancing smart automation in construction, mining, and recycling industries.
title Autonomous Aggregate Sorting in Construction and Mining via Computer Vision-Aided Robotic Arm Systems
topic Robotics
url https://arxiv.org/abs/2509.00339