Multimodal Behaviour Trees for Robotic Laboratory Task Automation

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Fakhruldeen, Hatem, Nambiar, Arvind Raveendran, Veeramani, Satheeshkumar, Tailor, Bonilkumar Vijaykumar, Juneghani, Hadi Beyzaee, Pizzuto, Gabriella, Cooper, Andrew Ian
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866908421409734656
author Fakhruldeen, Hatem
Nambiar, Arvind Raveendran
Veeramani, Satheeshkumar
Tailor, Bonilkumar Vijaykumar
Juneghani, Hadi Beyzaee
Pizzuto, Gabriella
Cooper, Andrew Ian
author_facet Fakhruldeen, Hatem
Nambiar, Arvind Raveendran
Veeramani, Satheeshkumar
Tailor, Bonilkumar Vijaykumar
Juneghani, Hadi Beyzaee
Pizzuto, Gabriella
Cooper, Andrew Ian
contents Laboratory robotics offer the capability to conduct experiments with a high degree of precision and reproducibility, with the potential to transform scientific research. Trivial and repeatable tasks; e.g., sample transportation for analysis and vial capping are well-suited for robots; if done successfully and reliably, chemists could contribute their efforts towards more critical research activities. Currently, robots can perform these tasks faster than chemists, but how reliable are they? Improper capping could result in human exposure to toxic chemicals which could be fatal. To ensure that robots perform these tasks as accurately as humans, sensory feedback is required to assess the progress of task execution. To address this, we propose a novel methodology based on behaviour trees with multimodal perception. Along with automating robotic tasks, this methodology also verifies the successful execution of the task, a fundamental requirement in safety-critical environments. The experimental evaluation was conducted on two lab tasks: sample vial capping and laboratory rack insertion. The results show high success rate, i.e., 88% for capping and 92% for insertion, along with strong error detection capabilities. This ultimately proves the robustness and reliability of our approach and that using multimodal behaviour trees should pave the way towards the next generation of robotic chemists.
format Preprint
id arxiv_https___arxiv_org_abs_2506_20399
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Multimodal Behaviour Trees for Robotic Laboratory Task Automation
Fakhruldeen, Hatem
Nambiar, Arvind Raveendran
Veeramani, Satheeshkumar
Tailor, Bonilkumar Vijaykumar
Juneghani, Hadi Beyzaee
Pizzuto, Gabriella
Cooper, Andrew Ian
Robotics
Laboratory robotics offer the capability to conduct experiments with a high degree of precision and reproducibility, with the potential to transform scientific research. Trivial and repeatable tasks; e.g., sample transportation for analysis and vial capping are well-suited for robots; if done successfully and reliably, chemists could contribute their efforts towards more critical research activities. Currently, robots can perform these tasks faster than chemists, but how reliable are they? Improper capping could result in human exposure to toxic chemicals which could be fatal. To ensure that robots perform these tasks as accurately as humans, sensory feedback is required to assess the progress of task execution. To address this, we propose a novel methodology based on behaviour trees with multimodal perception. Along with automating robotic tasks, this methodology also verifies the successful execution of the task, a fundamental requirement in safety-critical environments. The experimental evaluation was conducted on two lab tasks: sample vial capping and laboratory rack insertion. The results show high success rate, i.e., 88% for capping and 92% for insertion, along with strong error detection capabilities. This ultimately proves the robustness and reliability of our approach and that using multimodal behaviour trees should pave the way towards the next generation of robotic chemists.
title Multimodal Behaviour Trees for Robotic Laboratory Task Automation
topic Robotics
url https://arxiv.org/abs/2506.20399