Event-Grounding Graph: Unified Spatio-Temporal Scene Graph from Robotic Observations

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Nguyen, Phuoc, Verdoja, Francesco, Kyrki, Ville
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911450511966208
author Nguyen, Phuoc
Verdoja, Francesco
Kyrki, Ville
author_facet Nguyen, Phuoc
Verdoja, Francesco
Kyrki, Ville
contents A fundamental aspect for building intelligent autonomous robots that can assist humans in their daily lives is the construction of rich environmental representations. While advances in semantic scene representations have enriched robotic scene understanding, current approaches lack a connection between spatial features and dynamic events; e.g., connecting the blue mug to the event washing a mug. In this work, we introduce the event-grounding graph (EGG), a framework grounding event interactions to spatial features of a scene. This representation allows robots to perceive, reason, and respond to complex spatio-temporal queries. Experiments using real robotic data demonstrate EGG's capability to retrieve relevant information and respond accurately to human inquiries concerning the environment and events within. Furthermore, the EGG framework's source code and evaluation dataset are released as open-source at: https://github.com/aalto-intelligent-robotics/EGG.
format Preprint
id arxiv_https___arxiv_org_abs_2510_18697
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Event-Grounding Graph: Unified Spatio-Temporal Scene Graph from Robotic Observations
Nguyen, Phuoc
Verdoja, Francesco
Kyrki, Ville
Robotics
A fundamental aspect for building intelligent autonomous robots that can assist humans in their daily lives is the construction of rich environmental representations. While advances in semantic scene representations have enriched robotic scene understanding, current approaches lack a connection between spatial features and dynamic events; e.g., connecting the blue mug to the event washing a mug. In this work, we introduce the event-grounding graph (EGG), a framework grounding event interactions to spatial features of a scene. This representation allows robots to perceive, reason, and respond to complex spatio-temporal queries. Experiments using real robotic data demonstrate EGG's capability to retrieve relevant information and respond accurately to human inquiries concerning the environment and events within. Furthermore, the EGG framework's source code and evaluation dataset are released as open-source at: https://github.com/aalto-intelligent-robotics/EGG.
title Event-Grounding Graph: Unified Spatio-Temporal Scene Graph from Robotic Observations
topic Robotics
url https://arxiv.org/abs/2510.18697