Leveraging Computation of Expectation Models for Commonsense Affordance Estimation on 3D Scene Graphs

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Saucedo, Mario A. V., Stathoulopoulos, Nikolaos, Patel, Akash, Kanellakis, Christoforos, Nikolakopoulos, George
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913821676797952
author Saucedo, Mario A. V.
Stathoulopoulos, Nikolaos
Patel, Akash
Kanellakis, Christoforos
Nikolakopoulos, George
author_facet Saucedo, Mario A. V.
Stathoulopoulos, Nikolaos
Patel, Akash
Kanellakis, Christoforos
Nikolakopoulos, George
contents This article studies the commonsense object affordance concept for enabling close-to-human task planning and task optimization of embodied robotic agents in urban environments. The focus of the object affordance is on reasoning how to effectively identify object's inherent utility during the task execution, which in this work is enabled through the analysis of contextual relations of sparse information of 3D scene graphs. The proposed framework develops a Correlation Information (CECI) model to learn probability distributions using a Graph Convolutional Network, allowing to extract the commonsense affordance for individual members of a semantic class. The overall framework was experimentally validated in a real-world indoor environment, showcasing the ability of the method to level with human commonsense. For a video of the article, showcasing the experimental demonstration, please refer to the following link: https://youtu.be/BDCMVx2GiQE
format Preprint
id arxiv_https___arxiv_org_abs_2409_05392
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Leveraging Computation of Expectation Models for Commonsense Affordance Estimation on 3D Scene Graphs
Saucedo, Mario A. V.
Stathoulopoulos, Nikolaos
Patel, Akash
Kanellakis, Christoforos
Nikolakopoulos, George
Robotics
This article studies the commonsense object affordance concept for enabling close-to-human task planning and task optimization of embodied robotic agents in urban environments. The focus of the object affordance is on reasoning how to effectively identify object's inherent utility during the task execution, which in this work is enabled through the analysis of contextual relations of sparse information of 3D scene graphs. The proposed framework develops a Correlation Information (CECI) model to learn probability distributions using a Graph Convolutional Network, allowing to extract the commonsense affordance for individual members of a semantic class. The overall framework was experimentally validated in a real-world indoor environment, showcasing the ability of the method to level with human commonsense. For a video of the article, showcasing the experimental demonstration, please refer to the following link: https://youtu.be/BDCMVx2GiQE
title Leveraging Computation of Expectation Models for Commonsense Affordance Estimation on 3D Scene Graphs
topic Robotics
url https://arxiv.org/abs/2409.05392