Saved in:
Bibliographic Details
Main Authors: Zou, Longkun, Liu, Kangjun, Chen, Ke, Guo, Kailing, Jia, Kui, Wang, Yaowei
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2506.21165
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916811550752768
author Zou, Longkun
Liu, Kangjun
Chen, Ke
Guo, Kailing
Jia, Kui
Wang, Yaowei
author_facet Zou, Longkun
Liu, Kangjun
Chen, Ke
Guo, Kailing
Jia, Kui
Wang, Yaowei
contents Learning semantic representations from point sets of 3D object shapes is often challenged by significant geometric variations, primarily due to differences in data acquisition methods. Typically, training data is generated using point simulators, while testing data is collected with distinct 3D sensors, leading to a simulation-to-reality (Sim2Real) domain gap that limits the generalization ability of point classifiers. Current unsupervised domain adaptation (UDA) techniques struggle with this gap, as they often lack robust, domain-insensitive descriptors capable of capturing global topological information, resulting in overfitting to the limited semantic patterns of the source domain. To address this issue, we introduce a novel Topology-Aware Modeling (TAM) framework for Sim2Real UDA on object point clouds. Our approach mitigates the domain gap by leveraging global spatial topology, characterized by low-level, high-frequency 3D structures, and by modeling the topological relations of local geometric features through a novel self-supervised learning task. Additionally, we propose an advanced self-training strategy that combines cross-domain contrastive learning with self-training, effectively reducing the impact of noisy pseudo-labels and enhancing the robustness of the adaptation process. Experimental results on three public Sim2Real benchmarks validate the effectiveness of our TAM framework, showing consistent improvements over state-of-the-art methods across all evaluated tasks. The source code of this work will be available at https://github.com/zou-longkun/TAG.git.
format Preprint
id arxiv_https___arxiv_org_abs_2506_21165
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Topology-Aware Modeling for Unsupervised Simulation-to-Reality Point Cloud Recognition
Zou, Longkun
Liu, Kangjun
Chen, Ke
Guo, Kailing
Jia, Kui
Wang, Yaowei
Computer Vision and Pattern Recognition
Learning semantic representations from point sets of 3D object shapes is often challenged by significant geometric variations, primarily due to differences in data acquisition methods. Typically, training data is generated using point simulators, while testing data is collected with distinct 3D sensors, leading to a simulation-to-reality (Sim2Real) domain gap that limits the generalization ability of point classifiers. Current unsupervised domain adaptation (UDA) techniques struggle with this gap, as they often lack robust, domain-insensitive descriptors capable of capturing global topological information, resulting in overfitting to the limited semantic patterns of the source domain. To address this issue, we introduce a novel Topology-Aware Modeling (TAM) framework for Sim2Real UDA on object point clouds. Our approach mitigates the domain gap by leveraging global spatial topology, characterized by low-level, high-frequency 3D structures, and by modeling the topological relations of local geometric features through a novel self-supervised learning task. Additionally, we propose an advanced self-training strategy that combines cross-domain contrastive learning with self-training, effectively reducing the impact of noisy pseudo-labels and enhancing the robustness of the adaptation process. Experimental results on three public Sim2Real benchmarks validate the effectiveness of our TAM framework, showing consistent improvements over state-of-the-art methods across all evaluated tasks. The source code of this work will be available at https://github.com/zou-longkun/TAG.git.
title Topology-Aware Modeling for Unsupervised Simulation-to-Reality Point Cloud Recognition
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.21165