DDS: Decoupled Dynamic Scene-Graph Generation Network

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Iftekhar, A S M, Ruschel, Raphael, Kumar, Satish, You, Suya, Manjunath, B. S.
Format: Preprint
Veröffentlicht: 2023
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909461493317632
author Iftekhar, A S M
Ruschel, Raphael
Kumar, Satish
You, Suya
Manjunath, B. S.
author_facet Iftekhar, A S M
Ruschel, Raphael
Kumar, Satish
You, Suya
Manjunath, B. S.
contents Scene-graph generation involves creating a structural representation of the relationships between objects in a scene by predicting subject-object-relation triplets from input data. Existing methods show poor performance in detecting triplets outside of a predefined set, primarily due to their reliance on dependent feature learning. To address this issue, we propose DDS -- a decoupled dynamic scene-graph generation network -- that consists of two independent branches that can disentangle extracted features. The key innovation of the current paper is the decoupling of the features representing the relationships from those of the objects, which enables the detection of novel object-relationship combinations. The DDS model is evaluated on three datasets and outperforms previous methods by a significant margin, especially in detecting previously unseen triplets.
format Preprint
id arxiv_https___arxiv_org_abs_2301_07666
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle DDS: Decoupled Dynamic Scene-Graph Generation Network
Iftekhar, A S M
Ruschel, Raphael
Kumar, Satish
You, Suya
Manjunath, B. S.
Computer Vision and Pattern Recognition
Scene-graph generation involves creating a structural representation of the relationships between objects in a scene by predicting subject-object-relation triplets from input data. Existing methods show poor performance in detecting triplets outside of a predefined set, primarily due to their reliance on dependent feature learning. To address this issue, we propose DDS -- a decoupled dynamic scene-graph generation network -- that consists of two independent branches that can disentangle extracted features. The key innovation of the current paper is the decoupling of the features representing the relationships from those of the objects, which enables the detection of novel object-relationship combinations. The DDS model is evaluated on three datasets and outperforms previous methods by a significant margin, especially in detecting previously unseen triplets.
title DDS: Decoupled Dynamic Scene-Graph Generation Network
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2301.07666