nuScenes Knowledge Graph -- A comprehensive semantic representation of traffic scenes for trajectory prediction
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2023
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866913188192190464 |
|---|---|
| author | Mlodzian, Leon Sun, Zhigang Berkemeyer, Hendrik Monka, Sebastian Wang, Zixu Dietze, Stefan Halilaj, Lavdim Luettin, Juergen |
| author_facet | Mlodzian, Leon Sun, Zhigang Berkemeyer, Hendrik Monka, Sebastian Wang, Zixu Dietze, Stefan Halilaj, Lavdim Luettin, Juergen |
| contents | Trajectory prediction in traffic scenes involves accurately forecasting the behaviour of surrounding vehicles. To achieve this objective it is crucial to consider contextual information, including the driving path of vehicles, road topology, lane dividers, and traffic rules. Although studies demonstrated the potential of leveraging heterogeneous context for improving trajectory prediction, state-of-the-art deep learning approaches still rely on a limited subset of this information. This is mainly due to the limited availability of comprehensive representations. This paper presents an approach that utilizes knowledge graphs to model the diverse entities and their semantic connections within traffic scenes. Further, we present nuScenes Knowledge Graph (nSKG), a knowledge graph for the nuScenes dataset, that models explicitly all scene participants and road elements, as well as their semantic and spatial relationships. To facilitate the usage of the nSKG via graph neural networks for trajectory prediction, we provide the data in a format, ready-to-use by the PyG library. All artefacts can be found here: https://github.com/boschresearch/nuScenes_Knowledge_Graph |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2312_09676 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | nuScenes Knowledge Graph -- A comprehensive semantic representation of traffic scenes for trajectory prediction Mlodzian, Leon Sun, Zhigang Berkemeyer, Hendrik Monka, Sebastian Wang, Zixu Dietze, Stefan Halilaj, Lavdim Luettin, Juergen Computer Vision and Pattern Recognition Artificial Intelligence Robotics I.2.4; I.2.6; I.2.10 Trajectory prediction in traffic scenes involves accurately forecasting the behaviour of surrounding vehicles. To achieve this objective it is crucial to consider contextual information, including the driving path of vehicles, road topology, lane dividers, and traffic rules. Although studies demonstrated the potential of leveraging heterogeneous context for improving trajectory prediction, state-of-the-art deep learning approaches still rely on a limited subset of this information. This is mainly due to the limited availability of comprehensive representations. This paper presents an approach that utilizes knowledge graphs to model the diverse entities and their semantic connections within traffic scenes. Further, we present nuScenes Knowledge Graph (nSKG), a knowledge graph for the nuScenes dataset, that models explicitly all scene participants and road elements, as well as their semantic and spatial relationships. To facilitate the usage of the nSKG via graph neural networks for trajectory prediction, we provide the data in a format, ready-to-use by the PyG library. All artefacts can be found here: https://github.com/boschresearch/nuScenes_Knowledge_Graph |
| title | nuScenes Knowledge Graph -- A comprehensive semantic representation of traffic scenes for trajectory prediction |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence Robotics I.2.4; I.2.6; I.2.10 |
| url | https://arxiv.org/abs/2312.09676 |