HAD: Combining Hierarchical Diffusion with Metric-Decoupled RL for End-to-End Driving

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Yao, Wenhao, Sun, Xinglong, Li, Zhenxin, Lan, Shiyi, Wang, Zi, Alvarez, Jose M., Wu, Zuxuan
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914445535477760
author Yao, Wenhao
Sun, Xinglong
Li, Zhenxin
Lan, Shiyi
Wang, Zi
Alvarez, Jose M.
Wu, Zuxuan
author_facet Yao, Wenhao
Sun, Xinglong
Li, Zhenxin
Lan, Shiyi
Wang, Zi
Alvarez, Jose M.
Wu, Zuxuan
contents End-to-end planning has emerged as a dominant paradigm for autonomous driving, where recent models often adopt a scoring-selection framework to choose trajectories from a large set of candidates, with diffusion-based decoding showing strong promise. However, directly selecting from the entire candidate space remains difficult to optimize, and Gaussian perturbations used in diffusion often introduce unrealistic trajectories that complicate the denoising process. In addition, for training these models, reinforcement learning (RL) has shown promise, but existing end-to-end RL approaches typically rely on a single coupled reward without structured signals, limiting optimization effectiveness. To address these challenges, we propose HAD, an end-to-end planning framework with a Hierarchical Diffusion Policy that decomposes planning into a coarse-to-fine process. To improve trajectory generation, we introduce Structure-Preserved Trajectory Expansion, which produces realistic candidates while maintaining kinematic structure. For policy learning, we develop Metric-Decoupled Policy Optimization (MDPO) to enable structured RL optimization across multiple driving objectives. Extensive experiments show that HAD achieves new state-of-the-art performance on both NAVSIM and HUGSIM, outperforming prior arts by a huge margin: +2.3 EPDMS on NAVSIM and +4.9 Route Completion on HUGSIM.
format Preprint
id arxiv_https___arxiv_org_abs_2604_03581
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle HAD: Combining Hierarchical Diffusion with Metric-Decoupled RL for End-to-End Driving
Yao, Wenhao
Sun, Xinglong
Li, Zhenxin
Lan, Shiyi
Wang, Zi
Alvarez, Jose M.
Wu, Zuxuan
Robotics
Computer Vision and Pattern Recognition
End-to-end planning has emerged as a dominant paradigm for autonomous driving, where recent models often adopt a scoring-selection framework to choose trajectories from a large set of candidates, with diffusion-based decoding showing strong promise. However, directly selecting from the entire candidate space remains difficult to optimize, and Gaussian perturbations used in diffusion often introduce unrealistic trajectories that complicate the denoising process. In addition, for training these models, reinforcement learning (RL) has shown promise, but existing end-to-end RL approaches typically rely on a single coupled reward without structured signals, limiting optimization effectiveness. To address these challenges, we propose HAD, an end-to-end planning framework with a Hierarchical Diffusion Policy that decomposes planning into a coarse-to-fine process. To improve trajectory generation, we introduce Structure-Preserved Trajectory Expansion, which produces realistic candidates while maintaining kinematic structure. For policy learning, we develop Metric-Decoupled Policy Optimization (MDPO) to enable structured RL optimization across multiple driving objectives. Extensive experiments show that HAD achieves new state-of-the-art performance on both NAVSIM and HUGSIM, outperforming prior arts by a huge margin: +2.3 EPDMS on NAVSIM and +4.9 Route Completion on HUGSIM.
title HAD: Combining Hierarchical Diffusion with Metric-Decoupled RL for End-to-End Driving
topic Robotics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2604.03581