Discovering Conceptual Knowledge with Analytic Ontology Templates for Articulated Objects

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Sun, Jianhua, Li, Yuxuan, Xu, Longfei, Wei, Jiude, Chai, Liang, Lu, Cewu
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909319039025152
author Sun, Jianhua
Li, Yuxuan
Xu, Longfei
Wei, Jiude
Chai, Liang
Lu, Cewu
author_facet Sun, Jianhua
Li, Yuxuan
Xu, Longfei
Wei, Jiude
Chai, Liang
Lu, Cewu
contents Human cognition can leverage fundamental conceptual knowledge, like geometric and kinematic ones, to appropriately perceive, comprehend and interact with novel objects. Motivated by this finding, we aim to endow machine intelligence with an analogous capability through performing at the conceptual level, in order to understand and then interact with articulated objects, especially for those in novel categories, which is challenging due to the intricate geometric structures and diverse joint types of articulated objects. To achieve this goal, we propose Analytic Ontology Template (AOT), a parameterized and differentiable program description of generalized conceptual ontologies. A baseline approach called AOTNet driven by AOTs is designed accordingly to equip intelligent agents with these generalized concepts, and then empower the agents to effectively discover the conceptual knowledge on the structure and affordance of articulated objects. The AOT-driven approach yields benefits in three key perspectives: i) enabling concept-level understanding of articulated objects without relying on any real training data, ii) providing analytic structure information, and iii) introducing rich affordance information indicating proper ways of interaction. We conduct exhaustive experiments and the results demonstrate the superiority of our approach in understanding and then interacting with articulated objects.
format Preprint
id arxiv_https___arxiv_org_abs_2409_11702
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Discovering Conceptual Knowledge with Analytic Ontology Templates for Articulated Objects
Sun, Jianhua
Li, Yuxuan
Xu, Longfei
Wei, Jiude
Chai, Liang
Lu, Cewu
Robotics
Computer Vision and Pattern Recognition
Human cognition can leverage fundamental conceptual knowledge, like geometric and kinematic ones, to appropriately perceive, comprehend and interact with novel objects. Motivated by this finding, we aim to endow machine intelligence with an analogous capability through performing at the conceptual level, in order to understand and then interact with articulated objects, especially for those in novel categories, which is challenging due to the intricate geometric structures and diverse joint types of articulated objects. To achieve this goal, we propose Analytic Ontology Template (AOT), a parameterized and differentiable program description of generalized conceptual ontologies. A baseline approach called AOTNet driven by AOTs is designed accordingly to equip intelligent agents with these generalized concepts, and then empower the agents to effectively discover the conceptual knowledge on the structure and affordance of articulated objects. The AOT-driven approach yields benefits in three key perspectives: i) enabling concept-level understanding of articulated objects without relying on any real training data, ii) providing analytic structure information, and iii) introducing rich affordance information indicating proper ways of interaction. We conduct exhaustive experiments and the results demonstrate the superiority of our approach in understanding and then interacting with articulated objects.
title Discovering Conceptual Knowledge with Analytic Ontology Templates for Articulated Objects
topic Robotics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2409.11702