AI-driven visual monitoring of industrial assembly tasks

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Nardon, Mattia, Messelodi, Stefano, Granata, Antonio, Poiesi, Fabio, Danese, Alberto, Boscaini, Davide
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916841656418304
author Nardon, Mattia
Messelodi, Stefano
Granata, Antonio
Poiesi, Fabio
Danese, Alberto
Boscaini, Davide
author_facet Nardon, Mattia
Messelodi, Stefano
Granata, Antonio
Poiesi, Fabio
Danese, Alberto
Boscaini, Davide
contents Visual monitoring of industrial assembly tasks is critical for preventing equipment damage due to procedural errors and ensuring worker safety. Although commercial solutions exist, they typically require rigid workspace setups or the application of visual markers to simplify the problem. We introduce ViMAT, a novel AI-driven system for real-time visual monitoring of assembly tasks that operates without these constraints. ViMAT combines a perception module that extracts visual observations from multi-view video streams with a reasoning module that infers the most likely action being performed based on the observed assembly state and prior task knowledge. We validate ViMAT on two assembly tasks, involving the replacement of LEGO components and the reconfiguration of hydraulic press molds, demonstrating its effectiveness through quantitative and qualitative analysis in challenging real-world scenarios characterized by partial and uncertain visual observations. Project page: https://tev-fbk.github.io/ViMAT
format Preprint
id arxiv_https___arxiv_org_abs_2506_15285
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle AI-driven visual monitoring of industrial assembly tasks
Nardon, Mattia
Messelodi, Stefano
Granata, Antonio
Poiesi, Fabio
Danese, Alberto
Boscaini, Davide
Computer Vision and Pattern Recognition
Visual monitoring of industrial assembly tasks is critical for preventing equipment damage due to procedural errors and ensuring worker safety. Although commercial solutions exist, they typically require rigid workspace setups or the application of visual markers to simplify the problem. We introduce ViMAT, a novel AI-driven system for real-time visual monitoring of assembly tasks that operates without these constraints. ViMAT combines a perception module that extracts visual observations from multi-view video streams with a reasoning module that infers the most likely action being performed based on the observed assembly state and prior task knowledge. We validate ViMAT on two assembly tasks, involving the replacement of LEGO components and the reconfiguration of hydraulic press molds, demonstrating its effectiveness through quantitative and qualitative analysis in challenging real-world scenarios characterized by partial and uncertain visual observations. Project page: https://tev-fbk.github.io/ViMAT
title AI-driven visual monitoring of industrial assembly tasks
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.15285