Hierarchical and Decoupled BEV Perception Learning Framework for Autonomous Driving

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Dai, Yuqi, Sun, Jian, Li, Shengbo Eben, Xu, Qing, Wang, Jianqiang, He, Lei, Li, Keqiang
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913446607454208
author Dai, Yuqi
Sun, Jian
Li, Shengbo Eben
Xu, Qing
Wang, Jianqiang
He, Lei
Li, Keqiang
author_facet Dai, Yuqi
Sun, Jian
Li, Shengbo Eben
Xu, Qing
Wang, Jianqiang
He, Lei
Li, Keqiang
contents Perception is essential for autonomous driving system. Recent approaches based on Bird's-eye-view (BEV) and deep learning have made significant progress. However, there exists challenging issues including lengthy development cycles, poor reusability, and complex sensor setups in perception algorithm development process. To tackle the above challenges, this paper proposes a novel hierarchical BEV perception paradigm, aiming to provide a library of fundamental perception modules and user-friendly graphical interface, enabling swift construction of customized models. We conduct the Pretrain-Finetune strategy to effectively utilize large scale public datasets and streamline development processes. Moreover, we present a Multi-Module Learning (MML) approach, enhancing performance through synergistic and iterative training of multiple models. Extensive experimental results on the Nuscenes dataset demonstrate that our approach renders significant improvement over the traditional training scheme.
format Preprint
id arxiv_https___arxiv_org_abs_2407_12491
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Hierarchical and Decoupled BEV Perception Learning Framework for Autonomous Driving
Dai, Yuqi
Sun, Jian
Li, Shengbo Eben
Xu, Qing
Wang, Jianqiang
He, Lei
Li, Keqiang
Computer Vision and Pattern Recognition
Perception is essential for autonomous driving system. Recent approaches based on Bird's-eye-view (BEV) and deep learning have made significant progress. However, there exists challenging issues including lengthy development cycles, poor reusability, and complex sensor setups in perception algorithm development process. To tackle the above challenges, this paper proposes a novel hierarchical BEV perception paradigm, aiming to provide a library of fundamental perception modules and user-friendly graphical interface, enabling swift construction of customized models. We conduct the Pretrain-Finetune strategy to effectively utilize large scale public datasets and streamline development processes. Moreover, we present a Multi-Module Learning (MML) approach, enhancing performance through synergistic and iterative training of multiple models. Extensive experimental results on the Nuscenes dataset demonstrate that our approach renders significant improvement over the traditional training scheme.
title Hierarchical and Decoupled BEV Perception Learning Framework for Autonomous Driving
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2407.12491