RoCA: Robust Cross-Domain End-to-End Autonomous Driving

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Yasarla, Rajeev, Han, Shizhong, Cheng, Hsin-Pai, Liu, Litian, Mahajan, Shweta, Bhattacharyya, Apratim, Shi, Yunxiao, Garrepalli, Risheek, Cai, Hong, Porikli, Fatih
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866908411007860736
author Yasarla, Rajeev
Han, Shizhong
Cheng, Hsin-Pai
Liu, Litian
Mahajan, Shweta
Bhattacharyya, Apratim
Shi, Yunxiao
Garrepalli, Risheek
Cai, Hong
Porikli, Fatih
author_facet Yasarla, Rajeev
Han, Shizhong
Cheng, Hsin-Pai
Liu, Litian
Mahajan, Shweta
Bhattacharyya, Apratim
Shi, Yunxiao
Garrepalli, Risheek
Cai, Hong
Porikli, Fatih
contents End-to-end (E2E) autonomous driving has recently emerged as a new paradigm, offering significant potential. However, few studies have looked into the practical challenge of deployment across domains (e.g., cities). Although several works have incorporated Large Language Models (LLMs) to leverage their open-world knowledge, LLMs do not guarantee cross-domain driving performance and may incur prohibitive retraining costs during domain adaptation. In this paper, we propose RoCA, a novel framework for robust cross-domain E2E autonomous driving. RoCA formulates the joint probabilistic distribution over the tokens that encode ego and surrounding vehicle information in the E2E pipeline. Instantiating with a Gaussian process (GP), RoCA learns a set of basis tokens with corresponding trajectories, which span diverse driving scenarios. Then, given any driving scene, it is able to probabilistically infer the future trajectory. By using RoCA together with a base E2E model in source-domain training, we improve the generalizability of the base model, without requiring extra inference computation. In addition, RoCA enables robust adaptation on new target domains, significantly outperforming direct finetuning. We extensively evaluate RoCA on various cross-domain scenarios and show that it achieves strong domain generalization and adaptation performance.
format Preprint
id arxiv_https___arxiv_org_abs_2506_10145
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle RoCA: Robust Cross-Domain End-to-End Autonomous Driving
Yasarla, Rajeev
Han, Shizhong
Cheng, Hsin-Pai
Liu, Litian
Mahajan, Shweta
Bhattacharyya, Apratim
Shi, Yunxiao
Garrepalli, Risheek
Cai, Hong
Porikli, Fatih
Computer Vision and Pattern Recognition
End-to-end (E2E) autonomous driving has recently emerged as a new paradigm, offering significant potential. However, few studies have looked into the practical challenge of deployment across domains (e.g., cities). Although several works have incorporated Large Language Models (LLMs) to leverage their open-world knowledge, LLMs do not guarantee cross-domain driving performance and may incur prohibitive retraining costs during domain adaptation. In this paper, we propose RoCA, a novel framework for robust cross-domain E2E autonomous driving. RoCA formulates the joint probabilistic distribution over the tokens that encode ego and surrounding vehicle information in the E2E pipeline. Instantiating with a Gaussian process (GP), RoCA learns a set of basis tokens with corresponding trajectories, which span diverse driving scenarios. Then, given any driving scene, it is able to probabilistically infer the future trajectory. By using RoCA together with a base E2E model in source-domain training, we improve the generalizability of the base model, without requiring extra inference computation. In addition, RoCA enables robust adaptation on new target domains, significantly outperforming direct finetuning. We extensively evaluate RoCA on various cross-domain scenarios and show that it achieves strong domain generalization and adaptation performance.
title RoCA: Robust Cross-Domain End-to-End Autonomous Driving
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.10145