Heterogeneous-Modal Unsupervised Domain Adaptation via Latent Space Bridging

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Yang, Jiawen, Chen, Shuhao, Duan, Yucong, Tang, Ke, Zhang, Yu
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912439874879488
author Yang, Jiawen
Chen, Shuhao
Duan, Yucong
Tang, Ke
Zhang, Yu
author_facet Yang, Jiawen
Chen, Shuhao
Duan, Yucong
Tang, Ke
Zhang, Yu
contents Unsupervised domain adaptation (UDA) methods effectively bridge domain gaps but become struggled when the source and target domains belong to entirely distinct modalities. To address this limitation, we propose a novel setting called Heterogeneous-Modal Unsupervised Domain Adaptation (HMUDA), which enables knowledge transfer between completely different modalities by leveraging a bridge domain containing unlabeled samples from both modalities. To learn under the HMUDA setting, we propose Latent Space Bridging (LSB), a specialized framework designed for the semantic segmentation task. Specifically, LSB utilizes a dual-branch architecture, incorporating a feature consistency loss to align representations across modalities and a domain alignment loss to reduce discrepancies between class centroids across domains. Extensive experiments conducted on six benchmark datasets demonstrate that LSB achieves state-of-the-art performance.
format Preprint
id arxiv_https___arxiv_org_abs_2506_15971
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Heterogeneous-Modal Unsupervised Domain Adaptation via Latent Space Bridging
Yang, Jiawen
Chen, Shuhao
Duan, Yucong
Tang, Ke
Zhang, Yu
Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
Unsupervised domain adaptation (UDA) methods effectively bridge domain gaps but become struggled when the source and target domains belong to entirely distinct modalities. To address this limitation, we propose a novel setting called Heterogeneous-Modal Unsupervised Domain Adaptation (HMUDA), which enables knowledge transfer between completely different modalities by leveraging a bridge domain containing unlabeled samples from both modalities. To learn under the HMUDA setting, we propose Latent Space Bridging (LSB), a specialized framework designed for the semantic segmentation task. Specifically, LSB utilizes a dual-branch architecture, incorporating a feature consistency loss to align representations across modalities and a domain alignment loss to reduce discrepancies between class centroids across domains. Extensive experiments conducted on six benchmark datasets demonstrate that LSB achieves state-of-the-art performance.
title Heterogeneous-Modal Unsupervised Domain Adaptation via Latent Space Bridging
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2506.15971