Data Scaling Laws for Imitation Learning-Based End-to-End Autonomous Driving

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zheng, Yupeng, Yang, Pengxuan, Xia, Zhongpu, Zhang, Qichao, Zheng, Yuhang, Gu, Songen, Jin, Bu, Zhang, Teng, Lu, Ben, Han, Chao, Lang, Xianpeng, Zhao, Dongbin
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915547255406592
author Zheng, Yupeng
Yang, Pengxuan
Xia, Zhongpu
Zhang, Qichao
Zheng, Yuhang
Gu, Songen
Jin, Bu
Zhang, Teng
Lu, Ben
Han, Chao
Lang, Xianpeng
Zhao, Dongbin
author_facet Zheng, Yupeng
Yang, Pengxuan
Xia, Zhongpu
Zhang, Qichao
Zheng, Yuhang
Gu, Songen
Jin, Bu
Zhang, Teng
Lu, Ben
Han, Chao
Lang, Xianpeng
Zhao, Dongbin
contents The end-to-end autonomous driving paradigm has recently attracted lots of attention due to its scalability. However, existing methods are constrained by the limited scale of real-world data, which hinders a comprehensive exploration of the scaling laws associated with end-to-end autonomous driving. To address this issue, we collected substantial data from various driving scenarios and behaviors and conducted an extensive study on the scaling laws of existing imitation learning-based end-to-end autonomous driving paradigms. Specifically, approximately 4 million demonstrations from 23 different scenario types were gathered, amounting to over 30,000 hours of driving demonstrations. We performed open-loop evaluations and closed-loop simulation evaluations in 1,400 diverse driving demonstrations (1,300 for open-loop and 100 for closed-loop) under stringent assessment conditions. Through experimental analysis, we discovered that (1) the performance of the driving model exhibits a power-law relationship with the amount of data, but this is not the case in closed-loop evaluation. The inconsistency between the two assessments shifts our focus toward the distribution of data rather than merely expanding its volume. (2) a small increase in the quantity of long-tailed data can significantly improve the performance for the corresponding scenarios; (3) appropriate scaling of data enables the model to achieve combinatorial generalization in novel scenes and actions. Our results highlight the critical role of data scaling in improving the generalizability of models across diverse autonomous driving scenarios, assuring safe deployment in the real world.. Project repository: https://github.com/ucaszyp/Driving-Scaling-Law
format Preprint
id arxiv_https___arxiv_org_abs_2412_02689
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Data Scaling Laws for Imitation Learning-Based End-to-End Autonomous Driving
Zheng, Yupeng
Yang, Pengxuan
Xia, Zhongpu
Zhang, Qichao
Zheng, Yuhang
Gu, Songen
Jin, Bu
Zhang, Teng
Lu, Ben
Han, Chao
Lang, Xianpeng
Zhao, Dongbin
Robotics
The end-to-end autonomous driving paradigm has recently attracted lots of attention due to its scalability. However, existing methods are constrained by the limited scale of real-world data, which hinders a comprehensive exploration of the scaling laws associated with end-to-end autonomous driving. To address this issue, we collected substantial data from various driving scenarios and behaviors and conducted an extensive study on the scaling laws of existing imitation learning-based end-to-end autonomous driving paradigms. Specifically, approximately 4 million demonstrations from 23 different scenario types were gathered, amounting to over 30,000 hours of driving demonstrations. We performed open-loop evaluations and closed-loop simulation evaluations in 1,400 diverse driving demonstrations (1,300 for open-loop and 100 for closed-loop) under stringent assessment conditions. Through experimental analysis, we discovered that (1) the performance of the driving model exhibits a power-law relationship with the amount of data, but this is not the case in closed-loop evaluation. The inconsistency between the two assessments shifts our focus toward the distribution of data rather than merely expanding its volume. (2) a small increase in the quantity of long-tailed data can significantly improve the performance for the corresponding scenarios; (3) appropriate scaling of data enables the model to achieve combinatorial generalization in novel scenes and actions. Our results highlight the critical role of data scaling in improving the generalizability of models across diverse autonomous driving scenarios, assuring safe deployment in the real world.. Project repository: https://github.com/ucaszyp/Driving-Scaling-Law
title Data Scaling Laws for Imitation Learning-Based End-to-End Autonomous Driving
topic Robotics
url https://arxiv.org/abs/2412.02689