Fore-Mamba3D: Mamba-based Foreground-Enhanced Encoding for 3D Object Detection

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ning, Zhiwei, Gao, Xuanang, Cao, Jiaxi, Yang, Runze, Xu, Huiying, Zhu, Xinzhong, Yang, Jie, Liu, Wei
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912919997906944
author Ning, Zhiwei
Gao, Xuanang
Cao, Jiaxi
Yang, Runze
Xu, Huiying
Zhu, Xinzhong
Yang, Jie
Liu, Wei
author_facet Ning, Zhiwei
Gao, Xuanang
Cao, Jiaxi
Yang, Runze
Xu, Huiying
Zhu, Xinzhong
Yang, Jie
Liu, Wei
contents Linear modeling methods like Mamba have been merged as the effective backbone for the 3D object detection task. However, previous Mamba-based methods utilize the bidirectional encoding for the whole non-empty voxel sequence, which contains abundant useless background information in the scenes. Though directly encoding foreground voxels appears to be a plausible solution, it tends to degrade detection performance. We attribute this to the response attenuation and restricted context representation in the linear modeling for fore-only sequences. To address this problem, we propose a novel backbone, termed Fore-Mamba3D, to focus on the foreground enhancement by modifying Mamba-based encoder. The foreground voxels are first sampled according to the predicted scores. Considering the response attenuation existing in the interaction of foreground voxels across different instances, we design a regional-to-global slide window (RGSW) to propagate the information from regional split to the entire sequence. Furthermore, a semantic-assisted and state spatial fusion module (SASFMamba) is proposed to enrich contextual representation by enhancing semantic and geometric awareness within the Mamba model. Our method emphasizes foreground-only encoding and alleviates the distance-based and causal dependencies in the linear autoregression model. The superior performance across various benchmarks demonstrates the effectiveness of Fore-Mamba3D in the 3D object detection task.
format Preprint
id arxiv_https___arxiv_org_abs_2602_19536
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Fore-Mamba3D: Mamba-based Foreground-Enhanced Encoding for 3D Object Detection
Ning, Zhiwei
Gao, Xuanang
Cao, Jiaxi
Yang, Runze
Xu, Huiying
Zhu, Xinzhong
Yang, Jie
Liu, Wei
Computer Vision and Pattern Recognition
Artificial Intelligence
Linear modeling methods like Mamba have been merged as the effective backbone for the 3D object detection task. However, previous Mamba-based methods utilize the bidirectional encoding for the whole non-empty voxel sequence, which contains abundant useless background information in the scenes. Though directly encoding foreground voxels appears to be a plausible solution, it tends to degrade detection performance. We attribute this to the response attenuation and restricted context representation in the linear modeling for fore-only sequences. To address this problem, we propose a novel backbone, termed Fore-Mamba3D, to focus on the foreground enhancement by modifying Mamba-based encoder. The foreground voxels are first sampled according to the predicted scores. Considering the response attenuation existing in the interaction of foreground voxels across different instances, we design a regional-to-global slide window (RGSW) to propagate the information from regional split to the entire sequence. Furthermore, a semantic-assisted and state spatial fusion module (SASFMamba) is proposed to enrich contextual representation by enhancing semantic and geometric awareness within the Mamba model. Our method emphasizes foreground-only encoding and alleviates the distance-based and causal dependencies in the linear autoregression model. The superior performance across various benchmarks demonstrates the effectiveness of Fore-Mamba3D in the 3D object detection task.
title Fore-Mamba3D: Mamba-based Foreground-Enhanced Encoding for 3D Object Detection
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2602.19536