InceptionMamba: An Efficient Hybrid Network with Large Band Convolution and Bottleneck Mamba

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Wang, Yuhang, Li, Jun, Wu, Zhijian, Shen, Jifeng, Xu, Jianhua, Yang, Wankou
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911071730663424
author Wang, Yuhang
Li, Jun
Wu, Zhijian
Shen, Jifeng
Xu, Jianhua
Yang, Wankou
author_facet Wang, Yuhang
Li, Jun
Wu, Zhijian
Shen, Jifeng
Xu, Jianhua
Yang, Wankou
contents Within the family of convolutional neural networks, InceptionNeXt has shown excellent competitiveness in image classification and a number of downstream tasks. Built on parallel one-dimensional strip convolutions, however, it suffers from limited ability of capturing spatial dependencies along different dimensions and fails to fully explore spatial modeling in local neighborhood. Besides, inherent locality constraints of convolution operations are detrimental to effective global context modeling. To overcome these limitations, we propose a novel backbone architecture termed InceptionMamba in this study. More specifically, the traditional one-dimensional strip convolutions are replaced by orthogonal band convolutions in our InceptionMamba to achieve cohesive spatial modeling. Furthermore, global contextual modeling can be achieved via a bottleneck Mamba module, facilitating enhanced cross-channel information fusion and enlarged receptive field. Extensive evaluations on classification and various downstream tasks demonstrate that the proposed InceptionMamba achieves state-of-the-art performance with superior parameter and computational efficiency. The source code will be available at https://github.com/Wake1021/InceptionMamba.
format Preprint
id arxiv_https___arxiv_org_abs_2506_08735
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle InceptionMamba: An Efficient Hybrid Network with Large Band Convolution and Bottleneck Mamba
Wang, Yuhang
Li, Jun
Wu, Zhijian
Shen, Jifeng
Xu, Jianhua
Yang, Wankou
Computer Vision and Pattern Recognition
Within the family of convolutional neural networks, InceptionNeXt has shown excellent competitiveness in image classification and a number of downstream tasks. Built on parallel one-dimensional strip convolutions, however, it suffers from limited ability of capturing spatial dependencies along different dimensions and fails to fully explore spatial modeling in local neighborhood. Besides, inherent locality constraints of convolution operations are detrimental to effective global context modeling. To overcome these limitations, we propose a novel backbone architecture termed InceptionMamba in this study. More specifically, the traditional one-dimensional strip convolutions are replaced by orthogonal band convolutions in our InceptionMamba to achieve cohesive spatial modeling. Furthermore, global contextual modeling can be achieved via a bottleneck Mamba module, facilitating enhanced cross-channel information fusion and enlarged receptive field. Extensive evaluations on classification and various downstream tasks demonstrate that the proposed InceptionMamba achieves state-of-the-art performance with superior parameter and computational efficiency. The source code will be available at https://github.com/Wake1021/InceptionMamba.
title InceptionMamba: An Efficient Hybrid Network with Large Band Convolution and Bottleneck Mamba
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.08735