Intelligent Virtual Sonographer (IVS): Enhancing Physician-Robot-Patient Communication
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911061380169728 |
|---|---|
| author | Song, Tianyu Li, Feng Bi, Yuan Karlas, Angelos Yousefi, Amir Branzan, Daniela Jiang, Zhongliang Eck, Ulrich Navab, Nassir |
| author_facet | Song, Tianyu Li, Feng Bi, Yuan Karlas, Angelos Yousefi, Amir Branzan, Daniela Jiang, Zhongliang Eck, Ulrich Navab, Nassir |
| contents | The advancement and maturity of large language models (LLMs) and robotics have unlocked vast potential for human-computer interaction, particularly in the field of robotic ultrasound. While existing research primarily focuses on either patient-robot or physician-robot interaction, the role of an intelligent virtual sonographer (IVS) bridging physician-robot-patient communication remains underexplored. This work introduces a conversational virtual agent in Extended Reality (XR) that facilitates real-time interaction between physicians, a robotic ultrasound system(RUS), and patients. The IVS agent communicates with physicians in a professional manner while offering empathetic explanations and reassurance to patients. Furthermore, it actively controls the RUS by executing physician commands and transparently relays these actions to the patient. By integrating LLM-powered dialogue with speech-to-text, text-to-speech, and robotic control, our system enhances the efficiency, clarity, and accessibility of robotic ultrasound acquisition. This work constitutes a first step toward understanding how IVS can bridge communication gaps in physician-robot-patient interaction, providing more control and therefore trust into physician-robot interaction while improving patient experience and acceptance of robotic ultrasound. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_13052 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Intelligent Virtual Sonographer (IVS): Enhancing Physician-Robot-Patient Communication Song, Tianyu Li, Feng Bi, Yuan Karlas, Angelos Yousefi, Amir Branzan, Daniela Jiang, Zhongliang Eck, Ulrich Navab, Nassir Human-Computer Interaction Robotics The advancement and maturity of large language models (LLMs) and robotics have unlocked vast potential for human-computer interaction, particularly in the field of robotic ultrasound. While existing research primarily focuses on either patient-robot or physician-robot interaction, the role of an intelligent virtual sonographer (IVS) bridging physician-robot-patient communication remains underexplored. This work introduces a conversational virtual agent in Extended Reality (XR) that facilitates real-time interaction between physicians, a robotic ultrasound system(RUS), and patients. The IVS agent communicates with physicians in a professional manner while offering empathetic explanations and reassurance to patients. Furthermore, it actively controls the RUS by executing physician commands and transparently relays these actions to the patient. By integrating LLM-powered dialogue with speech-to-text, text-to-speech, and robotic control, our system enhances the efficiency, clarity, and accessibility of robotic ultrasound acquisition. This work constitutes a first step toward understanding how IVS can bridge communication gaps in physician-robot-patient interaction, providing more control and therefore trust into physician-robot interaction while improving patient experience and acceptance of robotic ultrasound. |
| title | Intelligent Virtual Sonographer (IVS): Enhancing Physician-Robot-Patient Communication |
| topic | Human-Computer Interaction Robotics |
| url | https://arxiv.org/abs/2507.13052 |