GenAD: Generalized Predictive Model for Autonomous Driving
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866910560130433024 |
|---|---|
| author | Yang, Jiazhi Gao, Shenyuan Qiu, Yihang Chen, Li Li, Tianyu Dai, Bo Chitta, Kashyap Wu, Penghao Zeng, Jia Luo, Ping Zhang, Jun Geiger, Andreas Qiao, Yu Li, Hongyang |
| author_facet | Yang, Jiazhi Gao, Shenyuan Qiu, Yihang Chen, Li Li, Tianyu Dai, Bo Chitta, Kashyap Wu, Penghao Zeng, Jia Luo, Ping Zhang, Jun Geiger, Andreas Qiao, Yu Li, Hongyang |
| contents | In this paper, we introduce the first large-scale video prediction model in the autonomous driving discipline. To eliminate the restriction of high-cost data collection and empower the generalization ability of our model, we acquire massive data from the web and pair it with diverse and high-quality text descriptions. The resultant dataset accumulates over 2000 hours of driving videos, spanning areas all over the world with diverse weather conditions and traffic scenarios. Inheriting the merits from recent latent diffusion models, our model, dubbed GenAD, handles the challenging dynamics in driving scenes with novel temporal reasoning blocks. We showcase that it can generalize to various unseen driving datasets in a zero-shot manner, surpassing general or driving-specific video prediction counterparts. Furthermore, GenAD can be adapted into an action-conditioned prediction model or a motion planner, holding great potential for real-world driving applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_09630 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | GenAD: Generalized Predictive Model for Autonomous Driving Yang, Jiazhi Gao, Shenyuan Qiu, Yihang Chen, Li Li, Tianyu Dai, Bo Chitta, Kashyap Wu, Penghao Zeng, Jia Luo, Ping Zhang, Jun Geiger, Andreas Qiao, Yu Li, Hongyang Computer Vision and Pattern Recognition In this paper, we introduce the first large-scale video prediction model in the autonomous driving discipline. To eliminate the restriction of high-cost data collection and empower the generalization ability of our model, we acquire massive data from the web and pair it with diverse and high-quality text descriptions. The resultant dataset accumulates over 2000 hours of driving videos, spanning areas all over the world with diverse weather conditions and traffic scenarios. Inheriting the merits from recent latent diffusion models, our model, dubbed GenAD, handles the challenging dynamics in driving scenes with novel temporal reasoning blocks. We showcase that it can generalize to various unseen driving datasets in a zero-shot manner, surpassing general or driving-specific video prediction counterparts. Furthermore, GenAD can be adapted into an action-conditioned prediction model or a motion planner, holding great potential for real-world driving applications. |
| title | GenAD: Generalized Predictive Model for Autonomous Driving |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2403.09630 |