RI-Mamba: Rotation-Invariant Mamba for Robust Text-to-Shape Retrieval

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Nguyen, Khanh, Edirimuni, Dasith de Silva, Hassan, Ghulam Mubashar, Mian, Ajmal
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866910020069752832
author Nguyen, Khanh
Edirimuni, Dasith de Silva
Hassan, Ghulam Mubashar
Mian, Ajmal
author_facet Nguyen, Khanh
Edirimuni, Dasith de Silva
Hassan, Ghulam Mubashar
Mian, Ajmal
contents 3D assets have rapidly expanded in quantity and diversity due to the growing popularity of virtual reality and gaming. As a result, text-to-shape retrieval has become essential in facilitating intuitive search within large repositories. However, existing methods require canonical poses and support few object categories, limiting their real-world applicability where objects can belong to diverse classes and appear in random orientations. To address this challenge, we propose RI-Mamba, the first rotation-invariant state-space model for point clouds. RI-Mamba defines global and local reference frames to disentangle pose from geometry and uses Hilbert sorting to construct token sequences with meaningful geometric structure while maintaining rotation invariance. We further introduce a novel strategy to compute orientational embeddings and reintegrate them via feature-wise linear modulation, effectively recovering spatial context and enhancing model expressiveness. Our strategy is inherently compatible with state-space models and operates in linear time. To scale up retrieval, we adopt cross-modal contrastive learning with automated triplet generation, allowing training on diverse datasets without manual annotation. Extensive experiments demonstrate RI-Mamba's superior representational capacity and robustness, achieving state-of-the-art performance on the OmniObject3D benchmark across more than 200 object categories under arbitrary orientations. Our code will be made available at https://github.com/ndkhanh360/RI-Mamba.git.
format Preprint
id arxiv_https___arxiv_org_abs_2602_11673
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle RI-Mamba: Rotation-Invariant Mamba for Robust Text-to-Shape Retrieval
Nguyen, Khanh
Edirimuni, Dasith de Silva
Hassan, Ghulam Mubashar
Mian, Ajmal
Computer Vision and Pattern Recognition
3D assets have rapidly expanded in quantity and diversity due to the growing popularity of virtual reality and gaming. As a result, text-to-shape retrieval has become essential in facilitating intuitive search within large repositories. However, existing methods require canonical poses and support few object categories, limiting their real-world applicability where objects can belong to diverse classes and appear in random orientations. To address this challenge, we propose RI-Mamba, the first rotation-invariant state-space model for point clouds. RI-Mamba defines global and local reference frames to disentangle pose from geometry and uses Hilbert sorting to construct token sequences with meaningful geometric structure while maintaining rotation invariance. We further introduce a novel strategy to compute orientational embeddings and reintegrate them via feature-wise linear modulation, effectively recovering spatial context and enhancing model expressiveness. Our strategy is inherently compatible with state-space models and operates in linear time. To scale up retrieval, we adopt cross-modal contrastive learning with automated triplet generation, allowing training on diverse datasets without manual annotation. Extensive experiments demonstrate RI-Mamba's superior representational capacity and robustness, achieving state-of-the-art performance on the OmniObject3D benchmark across more than 200 object categories under arbitrary orientations. Our code will be made available at https://github.com/ndkhanh360/RI-Mamba.git.
title RI-Mamba: Rotation-Invariant Mamba for Robust Text-to-Shape Retrieval
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2602.11673