Automated Label Unification for Multi-Dataset Semantic Segmentation with GNNs

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Ma, Rong, Chen, Jie, Xue, Xiangyang, Pu, Jian
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912148927545344
author Ma, Rong
Chen, Jie
Xue, Xiangyang
Pu, Jian
author_facet Ma, Rong
Chen, Jie
Xue, Xiangyang
Pu, Jian
contents Deep supervised models possess significant capability to assimilate extensive training data, thereby presenting an opportunity to enhance model performance through training on multiple datasets. However, conflicts arising from different label spaces among datasets may adversely affect model performance. In this paper, we propose a novel approach to automatically construct a unified label space across multiple datasets using graph neural networks. This enables semantic segmentation models to be trained simultaneously on multiple datasets, resulting in performance improvements. Unlike existing methods, our approach facilitates seamless training without the need for additional manual reannotation or taxonomy reconciliation. This significantly enhances the efficiency and effectiveness of multi-dataset segmentation model training. The results demonstrate that our method significantly outperforms other multi-dataset training methods when trained on seven datasets simultaneously, and achieves state-of-the-art performance on the WildDash 2 benchmark.
format Preprint
id arxiv_https___arxiv_org_abs_2407_10534
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Automated Label Unification for Multi-Dataset Semantic Segmentation with GNNs
Ma, Rong
Chen, Jie
Xue, Xiangyang
Pu, Jian
Computer Vision and Pattern Recognition
Deep supervised models possess significant capability to assimilate extensive training data, thereby presenting an opportunity to enhance model performance through training on multiple datasets. However, conflicts arising from different label spaces among datasets may adversely affect model performance. In this paper, we propose a novel approach to automatically construct a unified label space across multiple datasets using graph neural networks. This enables semantic segmentation models to be trained simultaneously on multiple datasets, resulting in performance improvements. Unlike existing methods, our approach facilitates seamless training without the need for additional manual reannotation or taxonomy reconciliation. This significantly enhances the efficiency and effectiveness of multi-dataset segmentation model training. The results demonstrate that our method significantly outperforms other multi-dataset training methods when trained on seven datasets simultaneously, and achieves state-of-the-art performance on the WildDash 2 benchmark.
title Automated Label Unification for Multi-Dataset Semantic Segmentation with GNNs
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2407.10534