WinMamba: Multi-Scale Shifted Windows in State Space Model for 3D Object Detection

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zheng, Longhui, Xia, Qiming, Chen, Xiaolu, Liu, Zhaoliang, Wen, Chenglu
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918205600038912
author Zheng, Longhui
Xia, Qiming
Chen, Xiaolu
Liu, Zhaoliang
Wen, Chenglu
author_facet Zheng, Longhui
Xia, Qiming
Chen, Xiaolu
Liu, Zhaoliang
Wen, Chenglu
contents 3D object detection is critical for autonomous driving, yet it remains fundamentally challenging to simultaneously maximize computational efficiency and capture long-range spatial dependencies. We observed that Mamba-based models, with their linear state-space design, capture long-range dependencies at lower cost, offering a promising balance between efficiency and accuracy. However, existing methods rely on axis-aligned scanning within a fixed window, inevitably discarding spatial information. To address this problem, we propose WinMamba, a novel Mamba-based 3D feature-encoding backbone composed of stacked WinMamba blocks. To enhance the backbone with robust multi-scale representation, the WinMamba block incorporates a window-scale-adaptive module that compensates voxel features across varying resolutions during sampling. Meanwhile, to obtain rich contextual cues within the linear state space, we equip the WinMamba layer with a learnable positional encoding and a window-shift strategy. Extensive experiments on the KITTI and Waymo datasets demonstrate that WinMamba significantly outperforms the baseline. Ablation studies further validate the individual contributions of the WSF and AWF modules in improving detection accuracy. The code will be made publicly available.
format Preprint
id arxiv_https___arxiv_org_abs_2511_13138
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle WinMamba: Multi-Scale Shifted Windows in State Space Model for 3D Object Detection
Zheng, Longhui
Xia, Qiming
Chen, Xiaolu
Liu, Zhaoliang
Wen, Chenglu
Computer Vision and Pattern Recognition
3D object detection is critical for autonomous driving, yet it remains fundamentally challenging to simultaneously maximize computational efficiency and capture long-range spatial dependencies. We observed that Mamba-based models, with their linear state-space design, capture long-range dependencies at lower cost, offering a promising balance between efficiency and accuracy. However, existing methods rely on axis-aligned scanning within a fixed window, inevitably discarding spatial information. To address this problem, we propose WinMamba, a novel Mamba-based 3D feature-encoding backbone composed of stacked WinMamba blocks. To enhance the backbone with robust multi-scale representation, the WinMamba block incorporates a window-scale-adaptive module that compensates voxel features across varying resolutions during sampling. Meanwhile, to obtain rich contextual cues within the linear state space, we equip the WinMamba layer with a learnable positional encoding and a window-shift strategy. Extensive experiments on the KITTI and Waymo datasets demonstrate that WinMamba significantly outperforms the baseline. Ablation studies further validate the individual contributions of the WSF and AWF modules in improving detection accuracy. The code will be made publicly available.
title WinMamba: Multi-Scale Shifted Windows in State Space Model for 3D Object Detection
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2511.13138