Saved in:
Bibliographic Details
Main Authors: Nebot, Eduardo, Perez, Julie Stephany Berrio
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2603.16050
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914400069222400
author Nebot, Eduardo
Perez, Julie Stephany Berrio
author_facet Nebot, Eduardo
Perez, Julie Stephany Berrio
contents Autonomous driving is undergoing a shift from modular rule based pipelines toward end to end (E2E) learning systems. This paper examines this transition by tracing the evolution from classical sense perceive plan control architectures to large driving models (LDMs) capable of mapping raw sensor input directly to driving actions. We analyze recent developments including Tesla's Full Self Driving (FSD) V12 V14, Rivian's Unified Intelligence platform, NVIDIA Cosmos, and emerging commercial robotaxi deployments, focusing on architectural design, deployment strategies, safety considerations and industry implications. A key emerging product category is supervised E2E driving, often referred to as FSD (Supervised) or L2 plus plus, which several manufacturers plan to deploy from 2026 onwards. These systems can perform most of the Dynamic Driving Task (DDT) in complex environments while requiring human supervision, shifting the driver's role to safety oversight. Early operational evidence suggests E2E learning handles the long tail distribution of real world driving scenarios and is becoming a dominant commercial strategy. We also discuss how similar architectural advances may extend beyond autonomous vehicles (AV) to other embodied AI systems, including humanoid robotics.
format Preprint
id arxiv_https___arxiv_org_abs_2603_16050
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle The Era of End-to-End Autonomy: Transitioning from Rule-Based Driving to Large Driving Models
Nebot, Eduardo
Perez, Julie Stephany Berrio
Robotics
Computer Vision and Pattern Recognition
Image and Video Processing
Autonomous driving is undergoing a shift from modular rule based pipelines toward end to end (E2E) learning systems. This paper examines this transition by tracing the evolution from classical sense perceive plan control architectures to large driving models (LDMs) capable of mapping raw sensor input directly to driving actions. We analyze recent developments including Tesla's Full Self Driving (FSD) V12 V14, Rivian's Unified Intelligence platform, NVIDIA Cosmos, and emerging commercial robotaxi deployments, focusing on architectural design, deployment strategies, safety considerations and industry implications. A key emerging product category is supervised E2E driving, often referred to as FSD (Supervised) or L2 plus plus, which several manufacturers plan to deploy from 2026 onwards. These systems can perform most of the Dynamic Driving Task (DDT) in complex environments while requiring human supervision, shifting the driver's role to safety oversight. Early operational evidence suggests E2E learning handles the long tail distribution of real world driving scenarios and is becoming a dominant commercial strategy. We also discuss how similar architectural advances may extend beyond autonomous vehicles (AV) to other embodied AI systems, including humanoid robotics.
title The Era of End-to-End Autonomy: Transitioning from Rule-Based Driving to Large Driving Models
topic Robotics
Computer Vision and Pattern Recognition
Image and Video Processing
url https://arxiv.org/abs/2603.16050