Saved in:
Bibliographic Details
Main Authors: Aryan, FNU, Stepputtis, Simon, Bhagat, Sarthak, Campbell, Joseph, Lee, Kwonjoon, Mahjoub, Hossein Nourkhiz, Sycara, Katia
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2410.22626
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • Scene understanding is a fundamental capability needed in many domains, ranging from question-answering to robotics. Unlike recent end-to-end approaches that must explicitly learn varying compositions of the same scene, our method reasons over their constituent objects and analyzes their arrangement to infer a scene's meaning. We propose a novel approach that reasons over a scene's scene- and knowledge-graph, capturing spatial information while being able to utilize general domain knowledge in a joint graph search. Empirically, we demonstrate the feasibility of our method on the ADE20K dataset and compare it to current scene understanding approaches.