Trustworthy Automated Driving through Qualitative Scene Understanding and Explanations

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Belmecheri, Nassim, Gotlieb, Arnaud, Lazaar, Nadjib, Spieker, Helge
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914715309965312
author Belmecheri, Nassim
Gotlieb, Arnaud
Lazaar, Nadjib
Spieker, Helge
author_facet Belmecheri, Nassim
Gotlieb, Arnaud
Lazaar, Nadjib
Spieker, Helge
contents We present the Qualitative Explainable Graph (QXG): a unified symbolic and qualitative representation for scene understanding in urban mobility. QXG enables the interpretation of an automated vehicle's environment using sensor data and machine learning models. It leverages spatio-temporal graphs and qualitative constraints to extract scene semantics from raw sensor inputs, such as LiDAR and camera data, offering an intelligible scene model. Crucially, QXG can be incrementally constructed in real-time, making it a versatile tool for in-vehicle explanations and real-time decision-making across various sensor types. Our research showcases the transformative potential of QXG, particularly in the context of automated driving, where it elucidates decision rationales by linking the graph with vehicle actions. These explanations serve diverse purposes, from informing passengers and alerting vulnerable road users (VRUs) to enabling post-analysis of prior behaviours.
format Preprint
id arxiv_https___arxiv_org_abs_2403_09668
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Trustworthy Automated Driving through Qualitative Scene Understanding and Explanations
Belmecheri, Nassim
Gotlieb, Arnaud
Lazaar, Nadjib
Spieker, Helge
Computer Vision and Pattern Recognition
Artificial Intelligence
We present the Qualitative Explainable Graph (QXG): a unified symbolic and qualitative representation for scene understanding in urban mobility. QXG enables the interpretation of an automated vehicle's environment using sensor data and machine learning models. It leverages spatio-temporal graphs and qualitative constraints to extract scene semantics from raw sensor inputs, such as LiDAR and camera data, offering an intelligible scene model. Crucially, QXG can be incrementally constructed in real-time, making it a versatile tool for in-vehicle explanations and real-time decision-making across various sensor types. Our research showcases the transformative potential of QXG, particularly in the context of automated driving, where it elucidates decision rationales by linking the graph with vehicle actions. These explanations serve diverse purposes, from informing passengers and alerting vulnerable road users (VRUs) to enabling post-analysis of prior behaviours.
title Trustworthy Automated Driving through Qualitative Scene Understanding and Explanations
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2403.09668