CC-SGG: Corner Case Scenario Generation using Learned Scene Graphs
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2023
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866917583251308544 |
|---|---|
| author | Drayson, George Panagiotaki, Efimia Omeiza, Daniel Kunze, Lars |
| author_facet | Drayson, George Panagiotaki, Efimia Omeiza, Daniel Kunze, Lars |
| contents | Corner case scenarios are an essential tool for testing and validating the safety of autonomous vehicles (AVs). As these scenarios are often insufficiently present in naturalistic driving datasets, augmenting the data with synthetic corner cases greatly enhances the safe operation of AVs in unique situations. However, the generation of synthetic, yet realistic, corner cases poses a significant challenge. In this work, we introduce a novel approach based on Heterogeneous Graph Neural Networks (HGNNs) to transform regular driving scenarios into corner cases. To achieve this, we first generate concise representations of regular driving scenes as scene graphs, minimally manipulating their structure and properties. Our model then learns to perturb those graphs to generate corner cases using attention and triple embeddings. The input and perturbed graphs are then imported back into the simulation to generate corner case scenarios. Our model successfully learned to produce corner cases from input scene graphs, achieving 89.9% prediction accuracy on our testing dataset. We further validate the generated scenarios on baseline autonomous driving methods, demonstrating our model's ability to effectively create critical situations for the baselines. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2309_09844 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | CC-SGG: Corner Case Scenario Generation using Learned Scene Graphs Drayson, George Panagiotaki, Efimia Omeiza, Daniel Kunze, Lars Robotics Artificial Intelligence Computer Vision and Pattern Recognition Machine Learning I.2.4; I.2.6; I.2.9; I.2.10; I.6.3; I.6.4; I.4.8 Corner case scenarios are an essential tool for testing and validating the safety of autonomous vehicles (AVs). As these scenarios are often insufficiently present in naturalistic driving datasets, augmenting the data with synthetic corner cases greatly enhances the safe operation of AVs in unique situations. However, the generation of synthetic, yet realistic, corner cases poses a significant challenge. In this work, we introduce a novel approach based on Heterogeneous Graph Neural Networks (HGNNs) to transform regular driving scenarios into corner cases. To achieve this, we first generate concise representations of regular driving scenes as scene graphs, minimally manipulating their structure and properties. Our model then learns to perturb those graphs to generate corner cases using attention and triple embeddings. The input and perturbed graphs are then imported back into the simulation to generate corner case scenarios. Our model successfully learned to produce corner cases from input scene graphs, achieving 89.9% prediction accuracy on our testing dataset. We further validate the generated scenarios on baseline autonomous driving methods, demonstrating our model's ability to effectively create critical situations for the baselines. |
| title | CC-SGG: Corner Case Scenario Generation using Learned Scene Graphs |
| topic | Robotics Artificial Intelligence Computer Vision and Pattern Recognition Machine Learning I.2.4; I.2.6; I.2.9; I.2.10; I.6.3; I.6.4; I.4.8 |
| url | https://arxiv.org/abs/2309.09844 |