Enregistré dans:
Détails bibliographiques
Auteurs principaux: Qu, Weiming, Du, Jiawei, Yuan, Shenghai, Wang, Jia, Sun, Yang, Liu, Shengyi, Zhu, Yuanhao, Yu, Jianfeng, Cao, Song, Xia, Rui, Tang, Xiaoyu, Wu, Xihong, Luo, Dingsheng
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:https://arxiv.org/abs/2504.16374
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912341871820800
author Qu, Weiming
Du, Jiawei
Yuan, Shenghai
Wang, Jia
Sun, Yang
Liu, Shengyi
Zhu, Yuanhao
Yu, Jianfeng
Cao, Song
Xia, Rui
Tang, Xiaoyu
Wu, Xihong
Luo, Dingsheng
author_facet Qu, Weiming
Du, Jiawei
Yuan, Shenghai
Wang, Jia
Sun, Yang
Liu, Shengyi
Zhu, Yuanhao
Yu, Jianfeng
Cao, Song
Xia, Rui
Tang, Xiaoyu
Wu, Xihong
Luo, Dingsheng
contents Modern robots must coexist with humans in dense urban environments. A key challenge is the ghost probe problem, where pedestrians or objects unexpectedly rush into traffic paths. This issue affects both autonomous vehicles and human drivers. Existing works propose vehicle-to-everything (V2X) strategies and non-line-of-sight (NLOS) imaging for ghost probe zone detection. However, most require high computational power or specialized hardware, limiting real-world feasibility. Additionally, many methods do not explicitly address this issue. To tackle this, we propose DPGP, a hybrid 2D-3D fusion framework for ghost probe zone prediction using only a monocular camera during training and inference. With unsupervised depth prediction, we observe ghost probe zones align with depth discontinuities, but different depth representations offer varying robustness. To exploit this, we fuse multiple feature embeddings to improve prediction. To validate our approach, we created a 12K-image dataset annotated with ghost probe zones, carefully sourced and cross-checked for accuracy. Experimental results show our framework outperforms existing methods while remaining cost-effective. To our knowledge, this is the first work extending ghost probe zone prediction beyond vehicles, addressing diverse non-vehicle objects. We will open-source our code and dataset for community benefit.
format Preprint
id arxiv_https___arxiv_org_abs_2504_16374
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle DPGP: A Hybrid 2D-3D Dual Path Potential Ghost Probe Zone Prediction Framework for Safe Autonomous Driving
Qu, Weiming
Du, Jiawei
Yuan, Shenghai
Wang, Jia
Sun, Yang
Liu, Shengyi
Zhu, Yuanhao
Yu, Jianfeng
Cao, Song
Xia, Rui
Tang, Xiaoyu
Wu, Xihong
Luo, Dingsheng
Robotics
Modern robots must coexist with humans in dense urban environments. A key challenge is the ghost probe problem, where pedestrians or objects unexpectedly rush into traffic paths. This issue affects both autonomous vehicles and human drivers. Existing works propose vehicle-to-everything (V2X) strategies and non-line-of-sight (NLOS) imaging for ghost probe zone detection. However, most require high computational power or specialized hardware, limiting real-world feasibility. Additionally, many methods do not explicitly address this issue. To tackle this, we propose DPGP, a hybrid 2D-3D fusion framework for ghost probe zone prediction using only a monocular camera during training and inference. With unsupervised depth prediction, we observe ghost probe zones align with depth discontinuities, but different depth representations offer varying robustness. To exploit this, we fuse multiple feature embeddings to improve prediction. To validate our approach, we created a 12K-image dataset annotated with ghost probe zones, carefully sourced and cross-checked for accuracy. Experimental results show our framework outperforms existing methods while remaining cost-effective. To our knowledge, this is the first work extending ghost probe zone prediction beyond vehicles, addressing diverse non-vehicle objects. We will open-source our code and dataset for community benefit.
title DPGP: A Hybrid 2D-3D Dual Path Potential Ghost Probe Zone Prediction Framework for Safe Autonomous Driving
topic Robotics
url https://arxiv.org/abs/2504.16374