Voice control interface for surgical robot assistants

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Davila, Ana, Colan, Jacinto, Hasegawa, Yasuhisa
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910889147367424
author Davila, Ana
Colan, Jacinto
Hasegawa, Yasuhisa
author_facet Davila, Ana
Colan, Jacinto
Hasegawa, Yasuhisa
contents Traditional control interfaces for robotic-assisted minimally invasive surgery impose a significant cognitive load on surgeons. To improve surgical efficiency, surgeon-robot collaboration capabilities, and reduce surgeon burden, we present a novel voice control interface for surgical robotic assistants. Our system integrates Whisper, state-of-the-art speech recognition, within the ROS framework to enable real-time interpretation and execution of voice commands for surgical manipulator control. The proposed system consists of a speech recognition module, an action mapping module, and a robot control module. Experimental results demonstrate the system's high accuracy and inference speed, and demonstrates its feasibility for surgical applications in a tissue triangulation task. Future work will focus on further improving its robustness and clinical applicability.
format Preprint
id arxiv_https___arxiv_org_abs_2409_10225
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Voice control interface for surgical robot assistants
Davila, Ana
Colan, Jacinto
Hasegawa, Yasuhisa
Robotics
Human-Computer Interaction
Traditional control interfaces for robotic-assisted minimally invasive surgery impose a significant cognitive load on surgeons. To improve surgical efficiency, surgeon-robot collaboration capabilities, and reduce surgeon burden, we present a novel voice control interface for surgical robotic assistants. Our system integrates Whisper, state-of-the-art speech recognition, within the ROS framework to enable real-time interpretation and execution of voice commands for surgical manipulator control. The proposed system consists of a speech recognition module, an action mapping module, and a robot control module. Experimental results demonstrate the system's high accuracy and inference speed, and demonstrates its feasibility for surgical applications in a tissue triangulation task. Future work will focus on further improving its robustness and clinical applicability.
title Voice control interface for surgical robot assistants
topic Robotics
Human-Computer Interaction
url https://arxiv.org/abs/2409.10225