Enhancing Surgical Robots with Embodied Intelligence for Autonomous Ultrasound Scanning
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866914839411032064 |
|---|---|
| author | Xu, Huan Wu, Jinlin Cao, Guanglin Lei, Zhen Chen, Zhen Liu, Hongbin |
| author_facet | Xu, Huan Wu, Jinlin Cao, Guanglin Lei, Zhen Chen, Zhen Liu, Hongbin |
| contents | Ultrasound robots are increasingly used in medical diagnostics and early disease screening. However, current ultrasound robots lack the intelligence to understand human intentions and instructions, hindering autonomous ultrasound scanning. To solve this problem, we propose a novel Ultrasound Embodied Intelligence system that equips ultrasound robots with the large language model (LLM) and domain knowledge, thereby improving the efficiency of ultrasound robots. Specifically, we first design an ultrasound operation knowledge database to add expertise in ultrasound scanning to the LLM, enabling the LLM to perform precise motion planning. Furthermore, we devise a dynamic ultrasound scanning strategy based on a \textit{think-observe-execute} prompt engineering, allowing LLMs to dynamically adjust motion planning strategies during the scanning procedures. Extensive experiments demonstrate that our system significantly improves ultrasound scan efficiency and quality from verbal commands. This advancement in autonomous medical scanning technology contributes to non-invasive diagnostics and streamlined medical workflows. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_00461 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Enhancing Surgical Robots with Embodied Intelligence for Autonomous Ultrasound Scanning Xu, Huan Wu, Jinlin Cao, Guanglin Lei, Zhen Chen, Zhen Liu, Hongbin Robotics Artificial Intelligence Computation and Language Human-Computer Interaction Ultrasound robots are increasingly used in medical diagnostics and early disease screening. However, current ultrasound robots lack the intelligence to understand human intentions and instructions, hindering autonomous ultrasound scanning. To solve this problem, we propose a novel Ultrasound Embodied Intelligence system that equips ultrasound robots with the large language model (LLM) and domain knowledge, thereby improving the efficiency of ultrasound robots. Specifically, we first design an ultrasound operation knowledge database to add expertise in ultrasound scanning to the LLM, enabling the LLM to perform precise motion planning. Furthermore, we devise a dynamic ultrasound scanning strategy based on a \textit{think-observe-execute} prompt engineering, allowing LLMs to dynamically adjust motion planning strategies during the scanning procedures. Extensive experiments demonstrate that our system significantly improves ultrasound scan efficiency and quality from verbal commands. This advancement in autonomous medical scanning technology contributes to non-invasive diagnostics and streamlined medical workflows. |
| title | Enhancing Surgical Robots with Embodied Intelligence for Autonomous Ultrasound Scanning |
| topic | Robotics Artificial Intelligence Computation and Language Human-Computer Interaction |
| url | https://arxiv.org/abs/2405.00461 |