Image de couverture de livre

Rethinking the long-range dependency in Mamba/SSM and transformer models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Ma, Cong, Najarian, Kayvan
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Supervised Coupled Matrix-Tensor Factorization (SCMTF) for Computational Phenotyping of Patient Reported Outcomes in Ulcerative Colitis
par: Minoccheri, Cristian, et autres
Publié: (2025)

A Causal Machine Learning Framework for Treatment Personalization in Clinical Trials: Application to Ulcerative Colitis
par: Minoccheri, Cristian, et autres
Publié: (2026)

Biomedical Signal and Image Processing
par: Najarian, Kayvan, et autres
Publié: (2020)

Biomedical Signal and Image Processing
par: Najarian, Kayvan, et autres
Publié: (2020)

Decision MetaMamba: Enhancing Selective SSM in Offline RL with Heterogeneous Sequence Mixing
par: Kim, Wall, et autres
Publié: (2026)

Decision MetaMamba: Enhancing Selective SSM in Offline RL with Heterogeneous Sequence Mixing
par: Kim, Wall, et autres
Publié: (2024)

Learning long range dependencies through time reversal symmetry breaking
par: Pourcel, Guillaume, et autres
Publié: (2025)

Rethinking Efficiency in Neural Combinatorial Optimization: Batched Preference Optimization with Mamba
par: Xu, Zhenxing, et autres
Publié: (2026)

Rotate to Scan: UNet-like Mamba with Triplet SSM Module for Medical Image Segmentation
par: Tang, Hao, et autres
Publié: (2024)

On the design-dependent suboptimality of the Lasso
par: Pathak, Reese, et autres
Publié: (2024)

Representation geometry shapes task performance in vision-language modeling for CT enterography
par: Minoccheri, Cristian, et autres
Publié: (2026)

A SSM is Polymerized from Multivariate Time Series
par: Wu, Haixiang
Publié: (2024)

Boosting classification reliability of NLP transformer models in the long run
par: Kmetty, Zoltán, et autres
Publié: (2023)

ASecond-Order SpikingSSM for Wearables
par: Agrawal, Kartikay, et autres
Publié: (2025)

Retrieval-Aware Distillation for Transformer-SSM Hybrids
par: Bick, Aviv, et autres
Publié: (2026)

U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentation
par: Ma, Jun, et autres
Publié: (2024)

ECGMamba: Towards Efficient ECG Classification with BiSSM
par: Qiang, Yupeng, et autres
Publié: (2024)

Innovative tokenisation of structured data for LLM training
par: Karim, Kayvan, et autres
Publié: (2025)

MemMamba: Rethinking Memory Patterns in State Space Model
par: Wang, Youjin, et autres
Publié: (2025)

Geometric SSM: LTI State Space Models for Selective Tasks
par: Casti, Umberto, et autres
Publié: (2025)

Learning interpretable positional encodings in transformers depends on initialization
par: Ito, Takuya, et autres
Publié: (2024)

MS-SSM: A Multi-Scale State Space Model for Efficient Sequence Modeling
par: Karami, Mahdi, et autres
Publié: (2025)

PDE-SSM: A Spectral State Space Approach to Spatial Mixing in Diffusion Transformers
par: Gal, Eshed, et autres
Publié: (2026)

WaveSSM: Multiscale State-Space Models for Non-stationary Signal Attention
par: Solozabal, Ruben, et autres
Publié: (2026)

SparseSSM: Efficient Selective Structured State Space Models Can Be Pruned in One-Shot
par: Tuo, Kaiwen, et autres
Publié: (2025)

Mamba Meets Scheduling: Learning to Solve Flexible Job Shop Scheduling with Efficient Sequence Modeling
par: Cao, Zhi, et autres
Publié: (2026)

SSM-CGM: Interpretable State-Space Forecasting Model of Continuous Glucose Monitoring for Personalized Diabetes Management
par: Isaac, Shakson, et autres
Publié: (2025)

Flash PD-SSM: Memory-Optimized Structured Sparse State-Space Models
par: Terzić, Aleksandar, et autres
Publié: (2026)

Time-SSM: Simplifying and Unifying State Space Models for Time Series Forecasting
par: Hu, Jiaxi, et autres
Publié: (2024)

Zamba: A Compact 7B SSM Hybrid Model
par: Glorioso, Paolo, et autres
Publié: (2024)

Bi-Mamba+: Bidirectional Mamba for Time Series Forecasting
par: Liang, Aobo, et autres
Publié: (2024)

Boundary-enhanced time series data imputation with long-term dependency diffusion models
par: Xiao, Chunjing, et autres
Publié: (2025)

SepMamba: State-space models for speaker separation using Mamba
par: Avenstrup, Thor Højhus, et autres
Publié: (2024)

Global Lyapunov functions: a long-standing open problem in mathematics, with symbolic transformers
par: Alfarano, Alberto, et autres
Publié: (2024)

Kinetic-Mamba: Mamba-Assisted Predictions of Stiff Chemical Kinetics
par: Pandey, Additi, et autres
Publié: (2025)

MCST-Mamba: Multivariate Mamba-Based Model for Traffic Prediction
par: Hamad, Mohamed, et autres
Publié: (2025)

EEG-SSM: Leveraging State-Space Model for Dementia Detection
par: Tran, Xuan-The, et autres
Publié: (2024)

PackMamba: Efficient Processing of Variable-Length Sequences in Mamba training
par: Xu, Haoran, et autres
Publié: (2024)

Assessing the importance of long-range correlations for deep-learning-based sleep staging
par: Wang, Tiezhi, et autres
Publié: (2024)

Mamba Modulation: On the Length Generalization of Mamba
par: Lu, Peng, et autres
Publié: (2025)