MambaGlue: Fast and Robust Local Feature Matching With Mamba

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Ryoo, Kihwan, Lim, Hyungtae, Myung, Hyun
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929693634068480
author Ryoo, Kihwan
Lim, Hyungtae
Myung, Hyun
author_facet Ryoo, Kihwan
Lim, Hyungtae
Myung, Hyun
contents In recent years, robust matching methods using deep learning-based approaches have been actively studied and improved in computer vision tasks. However, there remains a persistent demand for both robust and fast matching techniques. To address this, we propose a novel Mamba-based local feature matching approach, called MambaGlue, where Mamba is an emerging state-of-the-art architecture rapidly gaining recognition for its superior speed in both training and inference, and promising performance compared with Transformer architectures. In particular, we propose two modules: a) MambaAttention mixer to simultaneously and selectively understand the local and global context through the Mamba-based self-attention structure and b) deep confidence score regressor, which is a multi-layer perceptron (MLP)-based architecture that evaluates a score indicating how confidently matching predictions correspond to the ground-truth correspondences. Consequently, our MambaGlue achieves a balance between robustness and efficiency in real-world applications. As verified on various public datasets, we demonstrate that our MambaGlue yields a substantial performance improvement over baseline approaches while maintaining fast inference speed. Our code will be available on https://github.com/url-kaist/MambaGlue
format Preprint
id arxiv_https___arxiv_org_abs_2502_00462
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MambaGlue: Fast and Robust Local Feature Matching With Mamba
Ryoo, Kihwan
Lim, Hyungtae
Myung, Hyun
Computer Vision and Pattern Recognition
Robotics
In recent years, robust matching methods using deep learning-based approaches have been actively studied and improved in computer vision tasks. However, there remains a persistent demand for both robust and fast matching techniques. To address this, we propose a novel Mamba-based local feature matching approach, called MambaGlue, where Mamba is an emerging state-of-the-art architecture rapidly gaining recognition for its superior speed in both training and inference, and promising performance compared with Transformer architectures. In particular, we propose two modules: a) MambaAttention mixer to simultaneously and selectively understand the local and global context through the Mamba-based self-attention structure and b) deep confidence score regressor, which is a multi-layer perceptron (MLP)-based architecture that evaluates a score indicating how confidently matching predictions correspond to the ground-truth correspondences. Consequently, our MambaGlue achieves a balance between robustness and efficiency in real-world applications. As verified on various public datasets, we demonstrate that our MambaGlue yields a substantial performance improvement over baseline approaches while maintaining fast inference speed. Our code will be available on https://github.com/url-kaist/MambaGlue
title MambaGlue: Fast and Robust Local Feature Matching With Mamba
topic Computer Vision and Pattern Recognition
Robotics
url https://arxiv.org/abs/2502.00462