V2X-Real: a Large-Scale Dataset for Vehicle-to-Everything Cooperative Perception
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912159033720832 |
|---|---|
| author | Xiang, Hao Zheng, Zhaoliang Xia, Xin Xu, Runsheng Gao, Letian Zhou, Zewei Han, Xu Ji, Xinkai Li, Mingxi Meng, Zonglin Jin, Li Lei, Mingyue Ma, Zhaoyang He, Zihang Ma, Haoxuan Yuan, Yunshuang Zhao, Yingqian Ma, Jiaqi |
| author_facet | Xiang, Hao Zheng, Zhaoliang Xia, Xin Xu, Runsheng Gao, Letian Zhou, Zewei Han, Xu Ji, Xinkai Li, Mingxi Meng, Zonglin Jin, Li Lei, Mingyue Ma, Zhaoyang He, Zihang Ma, Haoxuan Yuan, Yunshuang Zhao, Yingqian Ma, Jiaqi |
| contents | Recent advancements in Vehicle-to-Everything (V2X) technologies have enabled autonomous vehicles to share sensing information to see through occlusions, greatly boosting the perception capability. However, there are no real-world datasets to facilitate the real V2X cooperative perception research -- existing datasets either only support Vehicle-to-Infrastructure cooperation or Vehicle-to-Vehicle cooperation. In this paper, we present V2X-Real, a large-scale dataset that includes a mixture of multiple vehicles and smart infrastructure to facilitate the V2X cooperative perception development with multi-modality sensing data. Our V2X-Real is collected using two connected automated vehicles and two smart infrastructure, which are all equipped with multi-modal sensors including LiDAR sensors and multi-view cameras. The whole dataset contains 33K LiDAR frames and 171K camera data with over 1.2M annotated bounding boxes of 10 categories in very challenging urban scenarios. According to the collaboration mode and ego perspective, we derive four types of datasets for Vehicle-Centric, Infrastructure-Centric, Vehicle-to-Vehicle, and Infrastructure-to-Infrastructure cooperative perception. Comprehensive multi-class multi-agent benchmarks of SOTA cooperative perception methods are provided. The V2X-Real dataset and codebase are available at https://mobility-lab.seas.ucla.edu/v2x-real. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_16034 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | V2X-Real: a Large-Scale Dataset for Vehicle-to-Everything Cooperative Perception Xiang, Hao Zheng, Zhaoliang Xia, Xin Xu, Runsheng Gao, Letian Zhou, Zewei Han, Xu Ji, Xinkai Li, Mingxi Meng, Zonglin Jin, Li Lei, Mingyue Ma, Zhaoyang He, Zihang Ma, Haoxuan Yuan, Yunshuang Zhao, Yingqian Ma, Jiaqi Computer Vision and Pattern Recognition Recent advancements in Vehicle-to-Everything (V2X) technologies have enabled autonomous vehicles to share sensing information to see through occlusions, greatly boosting the perception capability. However, there are no real-world datasets to facilitate the real V2X cooperative perception research -- existing datasets either only support Vehicle-to-Infrastructure cooperation or Vehicle-to-Vehicle cooperation. In this paper, we present V2X-Real, a large-scale dataset that includes a mixture of multiple vehicles and smart infrastructure to facilitate the V2X cooperative perception development with multi-modality sensing data. Our V2X-Real is collected using two connected automated vehicles and two smart infrastructure, which are all equipped with multi-modal sensors including LiDAR sensors and multi-view cameras. The whole dataset contains 33K LiDAR frames and 171K camera data with over 1.2M annotated bounding boxes of 10 categories in very challenging urban scenarios. According to the collaboration mode and ego perspective, we derive four types of datasets for Vehicle-Centric, Infrastructure-Centric, Vehicle-to-Vehicle, and Infrastructure-to-Infrastructure cooperative perception. Comprehensive multi-class multi-agent benchmarks of SOTA cooperative perception methods are provided. The V2X-Real dataset and codebase are available at https://mobility-lab.seas.ucla.edu/v2x-real. |
| title | V2X-Real: a Large-Scale Dataset for Vehicle-to-Everything Cooperative Perception |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2403.16034 |