Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Xiang, Wei, Lei, Ziyue, Wang, Jie, Huang, Yingying, Zheng, Qi, Zhang, Tianyi, Zhao, An, Sun, Lingyun
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2511.14233
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914162957877248
author Xiang, Wei
Lei, Ziyue
Wang, Jie
Huang, Yingying
Zheng, Qi
Zhang, Tianyi
Zhao, An
Sun, Lingyun
author_facet Xiang, Wei
Lei, Ziyue
Wang, Jie
Huang, Yingying
Zheng, Qi
Zhang, Tianyi
Zhao, An
Sun, Lingyun
contents Drivers' perception of risky situations has always been a challenge in driving. Existing risk-detection methods excel at identifying collisions but face challenges in assessing the behavior of road users in non-collision situations. This paper introduces Visionary Co-Driver, a system that leverages large language models to identify non-collision roadside risks and alert drivers based on their eye movements. Specifically, the system combines video processing algorithms and LLMs to identify potentially risky road users. These risks are dynamically indicated on an adaptive heads-up display interface to enhance drivers' attention. A user study with 41 drivers confirms that Visionary Co-Driver improves drivers' risk perception and supports their recognition of roadside risks.
format Preprint
id arxiv_https___arxiv_org_abs_2511_14233
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Visionary Co-Driver: Enhancing Driver Perception of Potential Risks with LLM and HUD
Xiang, Wei
Lei, Ziyue
Wang, Jie
Huang, Yingying
Zheng, Qi
Zhang, Tianyi
Zhao, An
Sun, Lingyun
Human-Computer Interaction
Drivers' perception of risky situations has always been a challenge in driving. Existing risk-detection methods excel at identifying collisions but face challenges in assessing the behavior of road users in non-collision situations. This paper introduces Visionary Co-Driver, a system that leverages large language models to identify non-collision roadside risks and alert drivers based on their eye movements. Specifically, the system combines video processing algorithms and LLMs to identify potentially risky road users. These risks are dynamically indicated on an adaptive heads-up display interface to enhance drivers' attention. A user study with 41 drivers confirms that Visionary Co-Driver improves drivers' risk perception and supports their recognition of roadside risks.
title Visionary Co-Driver: Enhancing Driver Perception of Potential Risks with LLM and HUD
topic Human-Computer Interaction
url https://arxiv.org/abs/2511.14233