MLMA: Towards Multilingual ASR With Mamba-based Architectures

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Ali, Mohamed Nabih, Falavigna, Daniele, Brutti, Alessio
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908606644879360
author Ali, Mohamed Nabih
Falavigna, Daniele
Brutti, Alessio
author_facet Ali, Mohamed Nabih
Falavigna, Daniele
Brutti, Alessio
contents Multilingual automatic speech recognition (ASR) remains a challenging task, especially when balancing performance across high- and low-resource languages. Recent advances in sequence modeling suggest that architectures beyond Transformers may offer better scalability and efficiency. In this work, we introduce MLMA (Multilingual Language Modeling with Mamba for ASR), a new approach that leverages the Mamba architecture -- an efficient state-space model optimized for long-context sequence processing -- for multilingual ASR. Using Mamba, MLMA implicitly incorporates language-aware conditioning and shared representations to support robust recognition across diverse languages. Experiments on standard multilingual benchmarks show that MLMA achieves competitive performance compared to Transformer-based architectures. These results highlight Mamba's potential as a strong backbone for scalable, efficient, and accurate multilingual speech recognition.
format Preprint
id arxiv_https___arxiv_org_abs_2510_18684
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MLMA: Towards Multilingual ASR With Mamba-based Architectures
Ali, Mohamed Nabih
Falavigna, Daniele
Brutti, Alessio
Computation and Language
Sound
Multilingual automatic speech recognition (ASR) remains a challenging task, especially when balancing performance across high- and low-resource languages. Recent advances in sequence modeling suggest that architectures beyond Transformers may offer better scalability and efficiency. In this work, we introduce MLMA (Multilingual Language Modeling with Mamba for ASR), a new approach that leverages the Mamba architecture -- an efficient state-space model optimized for long-context sequence processing -- for multilingual ASR. Using Mamba, MLMA implicitly incorporates language-aware conditioning and shared representations to support robust recognition across diverse languages. Experiments on standard multilingual benchmarks show that MLMA achieves competitive performance compared to Transformer-based architectures. These results highlight Mamba's potential as a strong backbone for scalable, efficient, and accurate multilingual speech recognition.
title MLMA: Towards Multilingual ASR With Mamba-based Architectures
topic Computation and Language
Sound
url https://arxiv.org/abs/2510.18684