Addressing the Waypoint-Action Gap in End-to-End Autonomous Driving via Vehicle Motion Models

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Rodríguez-Vidal, Jorge Daniel, Villalonga, Gabriel, Porres, Diego, Peña, Antonio M. López
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915785653354496
author Rodríguez-Vidal, Jorge Daniel
Villalonga, Gabriel
Porres, Diego
Peña, Antonio M. López
author_facet Rodríguez-Vidal, Jorge Daniel
Villalonga, Gabriel
Porres, Diego
Peña, Antonio M. López
contents End-to-End Autonomous Driving (E2E-AD) systems are typically grouped by the nature of their outputs: (i) waypoint-based models that predict a future trajectory, and (ii) action-based models that directly output throttle, steer and brake. Most recent benchmark protocols and training pipelines are waypoint-based, which makes action-based policies harder to train and compare, slowing their progress. To bridge this waypoint-action gap, we propose a novel, differentiable vehicle-model framework that rolls out predicted action sequences to their corresponding ego-frame waypoint trajectories while supervising in waypoint space. Our approach enables action-based architectures to be trained and evaluated, for the first time, within waypoint-based benchmarks without modifying the underlying evaluation protocol. We extensively evaluate our framework across multiple challenging benchmarks and observe consistent improvements over the baselines. In particular, on NAVSIM \texttt{navhard} our approach achieves state-of-the-art performance. Our code will be made publicly available upon acceptance.
format Preprint
id arxiv_https___arxiv_org_abs_2602_06214
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Addressing the Waypoint-Action Gap in End-to-End Autonomous Driving via Vehicle Motion Models
Rodríguez-Vidal, Jorge Daniel
Villalonga, Gabriel
Porres, Diego
Peña, Antonio M. López
Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
Robotics
End-to-End Autonomous Driving (E2E-AD) systems are typically grouped by the nature of their outputs: (i) waypoint-based models that predict a future trajectory, and (ii) action-based models that directly output throttle, steer and brake. Most recent benchmark protocols and training pipelines are waypoint-based, which makes action-based policies harder to train and compare, slowing their progress. To bridge this waypoint-action gap, we propose a novel, differentiable vehicle-model framework that rolls out predicted action sequences to their corresponding ego-frame waypoint trajectories while supervising in waypoint space. Our approach enables action-based architectures to be trained and evaluated, for the first time, within waypoint-based benchmarks without modifying the underlying evaluation protocol. We extensively evaluate our framework across multiple challenging benchmarks and observe consistent improvements over the baselines. In particular, on NAVSIM \texttt{navhard} our approach achieves state-of-the-art performance. Our code will be made publicly available upon acceptance.
title Addressing the Waypoint-Action Gap in End-to-End Autonomous Driving via Vehicle Motion Models
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
Robotics
url https://arxiv.org/abs/2602.06214