To New Beginnings: A Survey of Unified Perception in Autonomous Vehicle Software

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Stratil, Loïc, Fent, Felix, Rivera, Esteban, Lienkamp, Markus
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911127887151104
author Stratil, Loïc
Fent, Felix
Rivera, Esteban
Lienkamp, Markus
author_facet Stratil, Loïc
Fent, Felix
Rivera, Esteban
Lienkamp, Markus
contents Autonomous vehicle perception typically relies on modular pipelines that decompose the task into detection, tracking, and prediction. While interpretable, these pipelines suffer from error accumulation and limited inter-task synergy. Unified perception has emerged as a promising paradigm that integrates these sub-tasks within a shared architecture, potentially improving robustness, contextual reasoning, and efficiency while retaining interpretable outputs. In this survey, we provide a comprehensive overview of unified perception, introducing a holistic and systemic taxonomy that categorizes methods along task integration, tracking formulation, and representation flow. We define three paradigms -Early, Late, and Full Unified Perception- and systematically review existing methods, their architectures, training strategies, datasets used, and open-source availability, while highlighting future research directions. This work establishes the first comprehensive framework for understanding and advancing unified perception, consolidates fragmented efforts, and guides future research toward more robust, generalizable, and interpretable perception.
format Preprint
id arxiv_https___arxiv_org_abs_2508_20892
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle To New Beginnings: A Survey of Unified Perception in Autonomous Vehicle Software
Stratil, Loïc
Fent, Felix
Rivera, Esteban
Lienkamp, Markus
Computer Vision and Pattern Recognition
Robotics
Autonomous vehicle perception typically relies on modular pipelines that decompose the task into detection, tracking, and prediction. While interpretable, these pipelines suffer from error accumulation and limited inter-task synergy. Unified perception has emerged as a promising paradigm that integrates these sub-tasks within a shared architecture, potentially improving robustness, contextual reasoning, and efficiency while retaining interpretable outputs. In this survey, we provide a comprehensive overview of unified perception, introducing a holistic and systemic taxonomy that categorizes methods along task integration, tracking formulation, and representation flow. We define three paradigms -Early, Late, and Full Unified Perception- and systematically review existing methods, their architectures, training strategies, datasets used, and open-source availability, while highlighting future research directions. This work establishes the first comprehensive framework for understanding and advancing unified perception, consolidates fragmented efforts, and guides future research toward more robust, generalizable, and interpretable perception.
title To New Beginnings: A Survey of Unified Perception in Autonomous Vehicle Software
topic Computer Vision and Pattern Recognition
Robotics
url https://arxiv.org/abs/2508.20892