ReLaGS: Relational Language Gaussian Splatting

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Xie, Yaxu, Arafa, Abdalla, Javanmardi, Alireza, Millerdurai, Christen, Hu, Jia Cheng, Wang, Shaoxiang, Pagani, Alain, Stricker, Didier
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914405782913024
author Xie, Yaxu
Arafa, Abdalla
Javanmardi, Alireza
Millerdurai, Christen
Hu, Jia Cheng
Wang, Shaoxiang
Pagani, Alain
Stricker, Didier
author_facet Xie, Yaxu
Arafa, Abdalla
Javanmardi, Alireza
Millerdurai, Christen
Hu, Jia Cheng
Wang, Shaoxiang
Pagani, Alain
Stricker, Didier
contents Achieving unified 3D perception and reasoning across tasks such as segmentation, retrieval, and relation understanding remains challenging, as existing methods are either object-centric or rely on costly training for inter-object reasoning. We present a novel framework that constructs a hierarchical language-distilled Gaussian scene and its 3D semantic scene graph without scene-specific training. A Gaussian pruning mechanism refines scene geometry, while a robust multi-view language alignment strategy aggregates noisy 2D features into accurate 3D object embeddings. On top of this hierarchy, we build an open-vocabulary 3D scene graph with Vision Language derived annotations and Graph Neural Network-based relational reasoning. Our approach enables efficient and scalable open-vocabulary 3D reasoning by jointly modeling hierarchical semantics and inter/intra-object relationships, validated across tasks including open-vocabulary segmentation, scene graph generation, and relation-guided retrieval. Project page: https://dfki-av.github.io/ReLaGS/
format Preprint
id arxiv_https___arxiv_org_abs_2603_17605
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle ReLaGS: Relational Language Gaussian Splatting
Xie, Yaxu
Arafa, Abdalla
Javanmardi, Alireza
Millerdurai, Christen
Hu, Jia Cheng
Wang, Shaoxiang
Pagani, Alain
Stricker, Didier
Computer Vision and Pattern Recognition
Achieving unified 3D perception and reasoning across tasks such as segmentation, retrieval, and relation understanding remains challenging, as existing methods are either object-centric or rely on costly training for inter-object reasoning. We present a novel framework that constructs a hierarchical language-distilled Gaussian scene and its 3D semantic scene graph without scene-specific training. A Gaussian pruning mechanism refines scene geometry, while a robust multi-view language alignment strategy aggregates noisy 2D features into accurate 3D object embeddings. On top of this hierarchy, we build an open-vocabulary 3D scene graph with Vision Language derived annotations and Graph Neural Network-based relational reasoning. Our approach enables efficient and scalable open-vocabulary 3D reasoning by jointly modeling hierarchical semantics and inter/intra-object relationships, validated across tasks including open-vocabulary segmentation, scene graph generation, and relation-guided retrieval. Project page: https://dfki-av.github.io/ReLaGS/
title ReLaGS: Relational Language Gaussian Splatting
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2603.17605