Surprise Potential as a Measure of Interactivity in Driving Scenarios

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Ding, Wenhao, Veer, Sushant, Leung, Karen, Cao, Yulong, Pavone, Marco
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913684590166016
author Ding, Wenhao
Veer, Sushant
Leung, Karen
Cao, Yulong
Pavone, Marco
author_facet Ding, Wenhao
Veer, Sushant
Leung, Karen
Cao, Yulong
Pavone, Marco
contents Validating the safety and performance of an autonomous vehicle (AV) requires benchmarking on real-world driving logs. However, typical driving logs contain mostly uneventful scenarios with minimal interactions between road users. Identifying interactive scenarios in real-world driving logs enables the curation of datasets that amplify critical signals and provide a more accurate assessment of an AV's performance. In this paper, we present a novel metric that identifies interactive scenarios by measuring an AV's surprise potential on others. First, we identify three dimensions of the design space to describe a family of surprise potential measures. Second, we exhaustively evaluate and compare different instantiations of the surprise potential measure within this design space on the nuScenes dataset. To determine how well a surprise potential measure correctly identifies an interactive scenario, we use a reward model learned from human preferences to assess alignment with human intuition. Our proposed surprise potential, arising from this exhaustive comparative study, achieves a correlation of more than 0.82 with the human-aligned reward function, outperforming existing approaches. Lastly, we validate motion planners on curated interactive scenarios to demonstrate downstream applications.
format Preprint
id arxiv_https___arxiv_org_abs_2502_05677
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Surprise Potential as a Measure of Interactivity in Driving Scenarios
Ding, Wenhao
Veer, Sushant
Leung, Karen
Cao, Yulong
Pavone, Marco
Robotics
Machine Learning
Validating the safety and performance of an autonomous vehicle (AV) requires benchmarking on real-world driving logs. However, typical driving logs contain mostly uneventful scenarios with minimal interactions between road users. Identifying interactive scenarios in real-world driving logs enables the curation of datasets that amplify critical signals and provide a more accurate assessment of an AV's performance. In this paper, we present a novel metric that identifies interactive scenarios by measuring an AV's surprise potential on others. First, we identify three dimensions of the design space to describe a family of surprise potential measures. Second, we exhaustively evaluate and compare different instantiations of the surprise potential measure within this design space on the nuScenes dataset. To determine how well a surprise potential measure correctly identifies an interactive scenario, we use a reward model learned from human preferences to assess alignment with human intuition. Our proposed surprise potential, arising from this exhaustive comparative study, achieves a correlation of more than 0.82 with the human-aligned reward function, outperforming existing approaches. Lastly, we validate motion planners on curated interactive scenarios to demonstrate downstream applications.
title Surprise Potential as a Measure of Interactivity in Driving Scenarios
topic Robotics
Machine Learning
url https://arxiv.org/abs/2502.05677