PMA: Towards Parameter-Efficient Point Cloud Understanding via Point Mamba Adapter
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866918036393426944 |
|---|---|
| author | Zha, Yaohua Wang, Yanzi Guo, Hang Wang, Jinpeng Dai, Tao Chen, Bin Ouyang, Zhihao Yuerong, Xue Chen, Ke Xia, Shu-Tao |
| author_facet | Zha, Yaohua Wang, Yanzi Guo, Hang Wang, Jinpeng Dai, Tao Chen, Bin Ouyang, Zhihao Yuerong, Xue Chen, Ke Xia, Shu-Tao |
| contents | Applying pre-trained models to assist point cloud understanding has recently become a mainstream paradigm in 3D perception. However, existing application strategies are straightforward, utilizing only the final output of the pre-trained model for various task heads. It neglects the rich complementary information in the intermediate layer, thereby failing to fully unlock the potential of pre-trained models. To overcome this limitation, we propose an orthogonal solution: Point Mamba Adapter (PMA), which constructs an ordered feature sequence from all layers of the pre-trained model and leverages Mamba to fuse all complementary semantics, thereby promoting comprehensive point cloud understanding. Constructing this ordered sequence is non-trivial due to the inherent isotropy of 3D space. Therefore, we further propose a geometry-constrained gate prompt generator (G2PG) shared across different layers, which applies shared geometric constraints to the output gates of the Mamba and dynamically optimizes the spatial order, thus enabling more effective integration of multi-layer information. Extensive experiments conducted on challenging point cloud datasets across various tasks demonstrate that our PMA elevates the capability for point cloud understanding to a new level by fusing diverse complementary intermediate features. Code is available at https://github.com/zyh16143998882/PMA. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_20941 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | PMA: Towards Parameter-Efficient Point Cloud Understanding via Point Mamba Adapter Zha, Yaohua Wang, Yanzi Guo, Hang Wang, Jinpeng Dai, Tao Chen, Bin Ouyang, Zhihao Yuerong, Xue Chen, Ke Xia, Shu-Tao Computer Vision and Pattern Recognition Applying pre-trained models to assist point cloud understanding has recently become a mainstream paradigm in 3D perception. However, existing application strategies are straightforward, utilizing only the final output of the pre-trained model for various task heads. It neglects the rich complementary information in the intermediate layer, thereby failing to fully unlock the potential of pre-trained models. To overcome this limitation, we propose an orthogonal solution: Point Mamba Adapter (PMA), which constructs an ordered feature sequence from all layers of the pre-trained model and leverages Mamba to fuse all complementary semantics, thereby promoting comprehensive point cloud understanding. Constructing this ordered sequence is non-trivial due to the inherent isotropy of 3D space. Therefore, we further propose a geometry-constrained gate prompt generator (G2PG) shared across different layers, which applies shared geometric constraints to the output gates of the Mamba and dynamically optimizes the spatial order, thus enabling more effective integration of multi-layer information. Extensive experiments conducted on challenging point cloud datasets across various tasks demonstrate that our PMA elevates the capability for point cloud understanding to a new level by fusing diverse complementary intermediate features. Code is available at https://github.com/zyh16143998882/PMA. |
| title | PMA: Towards Parameter-Efficient Point Cloud Understanding via Point Mamba Adapter |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2505.20941 |