DM3D: Deformable Mamba via Offset-Guided Differentiable Scanning for Point Cloud Understanding

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Liu, Bin, Wang, Chunyang, Liu, Xuelian, Zhang, Ge
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914441408282624
author Liu, Bin
Wang, Chunyang
Liu, Xuelian
Zhang, Ge
author_facet Liu, Bin
Wang, Chunyang
Liu, Xuelian
Zhang, Ge
contents State Space Models (SSMs) show significant potential for long-sequence modeling, but their reliance on input order conflicts with the irregular nature of point clouds. Existing approaches often rely on predefined serialization schemes whose fixed scanning patterns cannot adapt to diverse geometric structures. To address this limitation, we propose DM3D, a deformable Mamba architecture for point cloud understanding. Specifically, DM3D introduces an offset-guided differentiable scanning mechanism that jointly performs resampling and reordering. Deformable Spatial Resampling (DSR) enhances structural awareness by adaptively resampling local features, while the Gaussian-based Differentiable Reordering (GDR) enables end-to-end optimization of the serialization order. We further introduce a Continuity-Aware State Update (CASU) mechanism that modulates the state update based on local geometric continuity. In addition, a Tri-Path Fusion module facilitates complementary interactions among different SSM branches. Together, these designs enable structure-adaptive serialization for point clouds. Extensive experiments on benchmark datasets show that DM3D achieves state-of-the-art or highly competitive results on classification, few-shot learning, and part segmentation tasks, validating the effectiveness of adaptive serialization for point cloud understanding.
format Preprint
id arxiv_https___arxiv_org_abs_2512_03424
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle DM3D: Deformable Mamba via Offset-Guided Differentiable Scanning for Point Cloud Understanding
Liu, Bin
Wang, Chunyang
Liu, Xuelian
Zhang, Ge
Computer Vision and Pattern Recognition
State Space Models (SSMs) show significant potential for long-sequence modeling, but their reliance on input order conflicts with the irregular nature of point clouds. Existing approaches often rely on predefined serialization schemes whose fixed scanning patterns cannot adapt to diverse geometric structures. To address this limitation, we propose DM3D, a deformable Mamba architecture for point cloud understanding. Specifically, DM3D introduces an offset-guided differentiable scanning mechanism that jointly performs resampling and reordering. Deformable Spatial Resampling (DSR) enhances structural awareness by adaptively resampling local features, while the Gaussian-based Differentiable Reordering (GDR) enables end-to-end optimization of the serialization order. We further introduce a Continuity-Aware State Update (CASU) mechanism that modulates the state update based on local geometric continuity. In addition, a Tri-Path Fusion module facilitates complementary interactions among different SSM branches. Together, these designs enable structure-adaptive serialization for point clouds. Extensive experiments on benchmark datasets show that DM3D achieves state-of-the-art or highly competitive results on classification, few-shot learning, and part segmentation tasks, validating the effectiveness of adaptive serialization for point cloud understanding.
title DM3D: Deformable Mamba via Offset-Guided Differentiable Scanning for Point Cloud Understanding
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2512.03424