Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2501.05322 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915098530938880 |
|---|---|
| author | Luo, Xuewen Ding, Fan Chen, Ruiqi Panda, Rishikesh Loo, Junnyong Zhang, Shuyun |
| author_facet | Luo, Xuewen Ding, Fan Chen, Ruiqi Panda, Rishikesh Loo, Junnyong Zhang, Shuyun |
| contents | Public distrust of self-driving cars is growing. Studies emphasize the need for interpreting the behavior of these vehicles to passengers to promote trust in autonomous systems. Interpreters can enhance trust by improving transparency and reducing perceived risk. However, current solutions often lack a human-centric approach to integrating multimodal interpretations. This paper introduces a novel Human-centered Multimodal Interpreter (HMI) system that leverages human preferences to provide visual, textual, and auditory feedback. The system combines a visual interface with Bird's Eye View (BEV), map, and text display, along with voice interaction using a fine-tuned large language model (LLM). Our user study, involving diverse participants, demonstrated that the HMI system significantly boosts passenger trust in AVs, increasing average trust levels by over 8%, with trust in ordinary environments rising by up to 30%. These results underscore the potential of the HMI system to improve the acceptance and reliability of autonomous vehicles by providing clear, real-time, and context-sensitive explanations of vehicle actions. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_05322 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | "What's Happening"- A Human-centered Multimodal Interpreter Explaining the Actions of Autonomous Vehicles Luo, Xuewen Ding, Fan Chen, Ruiqi Panda, Rishikesh Loo, Junnyong Zhang, Shuyun Human-Computer Interaction Public distrust of self-driving cars is growing. Studies emphasize the need for interpreting the behavior of these vehicles to passengers to promote trust in autonomous systems. Interpreters can enhance trust by improving transparency and reducing perceived risk. However, current solutions often lack a human-centric approach to integrating multimodal interpretations. This paper introduces a novel Human-centered Multimodal Interpreter (HMI) system that leverages human preferences to provide visual, textual, and auditory feedback. The system combines a visual interface with Bird's Eye View (BEV), map, and text display, along with voice interaction using a fine-tuned large language model (LLM). Our user study, involving diverse participants, demonstrated that the HMI system significantly boosts passenger trust in AVs, increasing average trust levels by over 8%, with trust in ordinary environments rising by up to 30%. These results underscore the potential of the HMI system to improve the acceptance and reliability of autonomous vehicles by providing clear, real-time, and context-sensitive explanations of vehicle actions. |
| title | "What's Happening"- A Human-centered Multimodal Interpreter Explaining the Actions of Autonomous Vehicles |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2501.05322 |