Cover Image

Rethinking the long-range dependency in Mamba/SSM and transformer models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ma, Cong, Najarian, Kayvan
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Supervised Coupled Matrix-Tensor Factorization (SCMTF) for Computational Phenotyping of Patient Reported Outcomes in Ulcerative Colitis
by: Minoccheri, Cristian, et al.
Published: (2025)

A Causal Machine Learning Framework for Treatment Personalization in Clinical Trials: Application to Ulcerative Colitis
by: Minoccheri, Cristian, et al.
Published: (2026)

Biomedical Signal and Image Processing
by: Najarian, Kayvan, et al.
Published: (2020)

Biomedical Signal and Image Processing
by: Najarian, Kayvan, et al.
Published: (2020)

Decision MetaMamba: Enhancing Selective SSM in Offline RL with Heterogeneous Sequence Mixing
by: Kim, Wall, et al.
Published: (2026)

Decision MetaMamba: Enhancing Selective SSM in Offline RL with Heterogeneous Sequence Mixing
by: Kim, Wall, et al.
Published: (2024)

Learning long range dependencies through time reversal symmetry breaking
by: Pourcel, Guillaume, et al.
Published: (2025)

Rethinking Efficiency in Neural Combinatorial Optimization: Batched Preference Optimization with Mamba
by: Xu, Zhenxing, et al.
Published: (2026)

Rotate to Scan: UNet-like Mamba with Triplet SSM Module for Medical Image Segmentation
by: Tang, Hao, et al.
Published: (2024)

On the design-dependent suboptimality of the Lasso
by: Pathak, Reese, et al.
Published: (2024)

Representation geometry shapes task performance in vision-language modeling for CT enterography
by: Minoccheri, Cristian, et al.
Published: (2026)

A SSM is Polymerized from Multivariate Time Series
by: Wu, Haixiang
Published: (2024)

Boosting classification reliability of NLP transformer models in the long run
by: Kmetty, Zoltán, et al.
Published: (2023)

ASecond-Order SpikingSSM for Wearables
by: Agrawal, Kartikay, et al.
Published: (2025)

Retrieval-Aware Distillation for Transformer-SSM Hybrids
by: Bick, Aviv, et al.
Published: (2026)

U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentation
by: Ma, Jun, et al.
Published: (2024)

ECGMamba: Towards Efficient ECG Classification with BiSSM
by: Qiang, Yupeng, et al.
Published: (2024)

Innovative tokenisation of structured data for LLM training
by: Karim, Kayvan, et al.
Published: (2025)

MemMamba: Rethinking Memory Patterns in State Space Model
by: Wang, Youjin, et al.
Published: (2025)

Geometric SSM: LTI State Space Models for Selective Tasks
by: Casti, Umberto, et al.
Published: (2025)

Learning interpretable positional encodings in transformers depends on initialization
by: Ito, Takuya, et al.
Published: (2024)

MS-SSM: A Multi-Scale State Space Model for Efficient Sequence Modeling
by: Karami, Mahdi, et al.
Published: (2025)

PDE-SSM: A Spectral State Space Approach to Spatial Mixing in Diffusion Transformers
by: Gal, Eshed, et al.
Published: (2026)

WaveSSM: Multiscale State-Space Models for Non-stationary Signal Attention
by: Solozabal, Ruben, et al.
Published: (2026)

SparseSSM: Efficient Selective Structured State Space Models Can Be Pruned in One-Shot
by: Tuo, Kaiwen, et al.
Published: (2025)

Mamba Meets Scheduling: Learning to Solve Flexible Job Shop Scheduling with Efficient Sequence Modeling
by: Cao, Zhi, et al.
Published: (2026)

SSM-CGM: Interpretable State-Space Forecasting Model of Continuous Glucose Monitoring for Personalized Diabetes Management
by: Isaac, Shakson, et al.
Published: (2025)

Flash PD-SSM: Memory-Optimized Structured Sparse State-Space Models
by: Terzić, Aleksandar, et al.
Published: (2026)

Time-SSM: Simplifying and Unifying State Space Models for Time Series Forecasting
by: Hu, Jiaxi, et al.
Published: (2024)

Zamba: A Compact 7B SSM Hybrid Model
by: Glorioso, Paolo, et al.
Published: (2024)

Bi-Mamba+: Bidirectional Mamba for Time Series Forecasting
by: Liang, Aobo, et al.
Published: (2024)

Boundary-enhanced time series data imputation with long-term dependency diffusion models
by: Xiao, Chunjing, et al.
Published: (2025)

SepMamba: State-space models for speaker separation using Mamba
by: Avenstrup, Thor Højhus, et al.
Published: (2024)

Global Lyapunov functions: a long-standing open problem in mathematics, with symbolic transformers
by: Alfarano, Alberto, et al.
Published: (2024)

Kinetic-Mamba: Mamba-Assisted Predictions of Stiff Chemical Kinetics
by: Pandey, Additi, et al.
Published: (2025)

MCST-Mamba: Multivariate Mamba-Based Model for Traffic Prediction
by: Hamad, Mohamed, et al.
Published: (2025)

EEG-SSM: Leveraging State-Space Model for Dementia Detection
by: Tran, Xuan-The, et al.
Published: (2024)

PackMamba: Efficient Processing of Variable-Length Sequences in Mamba training
by: Xu, Haoran, et al.
Published: (2024)

Assessing the importance of long-range correlations for deep-learning-based sleep staging
by: Wang, Tiezhi, et al.
Published: (2024)

Mamba Modulation: On the Length Generalization of Mamba
by: Lu, Peng, et al.
Published: (2025)