Cover Image

State-Space Modeling in Long Sequence Processing: A Survey on Recurrence in the Transformer Era

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Tiezzi, Matteo, Casoni, Michele, Betti, Alessandro, Gori, Marco, Melacci, Stefano
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

On the Resurgence of Recurrent Models for Long Sequences -- Survey and Research Opportunities in the Transformer Era
by: Tiezzi, Matteo, et al.
Published: (2024)

A Unified Framework for Neural Computation and Learning Over Time
by: Melacci, Stefano, et al.
Published: (2024)

Generative System Dynamics in Recurrent Neural Networks
by: Casoni, Michele, et al.
Published: (2025)

Continual Learning of Conjugated Visual Representations through Higher-order Motion Flows
by: Marullo, Simone, et al.
Published: (2024)

Dynamic Decoupling of Placid Terminal Attractor-based Gradient Descent Algorithm
by: Zhao, Jinwei, et al.
Published: (2024)

Nature-Inspired Local Propagation
by: Betti, Alessandro, et al.
Published: (2024)

The KANDY Benchmark: Incremental Neuro-Symbolic Learning and Reasoning with Kandinsky Patterns
by: Lorello, Luca Salvatore, et al.
Published: (2024)

Book your room in the Turing Hotel! A symmetric and distributed Turing Test with multiple AIs and humans
by: Di Maio, Christian, et al.
Published: (2026)

Sliding Window Recurrences for Sequence Models
by: Secrieru, Dragos, et al.
Published: (2025)

Modeling Long Sequences in Bladder Cancer Recurrence: A Comparative Evaluation of LSTM,Transformer,and Mamba
by: Zhang, Runquan, et al.
Published: (2024)

Poolformer: Recurrent Networks with Pooling for Long-Sequence Modeling
by: Fernández, Daniel Gallo
Published: (2025)

Mamba-360: Survey of State Space Models as Transformer Alternative for Long Sequence Modelling: Methods, Applications, and Challenges
by: Patro, Badri Narayana, et al.
Published: (2024)

KOSS: Kalman-Optimal Selective State Spaces for Long-Term Sequence Modeling
by: Wang, Lei, et al.
Published: (2025)

Graph Hierarchical Recurrence for Long-Range Generalization
by: Carotti, Stefano, et al.
Published: (2026)

Compute-in-Memory Implementation of State Space Models for Event Sequence Processing
by: Zhang, Xiaoyu, et al.
Published: (2025)

Graph-Mamba: Towards Long-Range Graph Sequence Modeling with Selective State Spaces
by: Wang, Chloe, et al.
Published: (2024)

FovEx: Human-Inspired Explanations for Vision Transformers and Convolutional Neural Networks
by: Panda, Mahadev Prasad, et al.
Published: (2024)

SMR: State Memory Replay for Long Sequence Modeling
by: Qi, Biqing, et al.
Published: (2024)

Hierarchical State Space Models for Continuous Sequence-to-Sequence Modeling
by: Bhirangi, Raunaq, et al.
Published: (2024)

Efficient Time Series Processing for Transformers and State-Space Models through Token Merging
by: Götz, Leon, et al.
Published: (2024)

Chimera: State Space Models Beyond Sequences
by: Lahoti, Aakash, et al.
Published: (2025)

Long-range Modeling and Processing of Multimodal Event Sequences
by: Li, Jichu, et al.
Published: (2026)

Mini-Sequence Transformer: Optimizing Intermediate Memory for Long Sequences Training
by: Luo, Cheng, et al.
Published: (2024)

MS-SSM: A Multi-Scale State Space Model for Efficient Sequence Modeling
by: Karami, Mahdi, et al.
Published: (2025)

Deep Continuous-Time State-Space Models for Marked Event Sequences
by: Chang, Yuxin, et al.
Published: (2024)

Mamba-3: Improved Sequence Modeling using State Space Principles
by: Lahoti, Aakash, et al.
Published: (2026)

SpikingSSMs: Learning Long Sequences with Sparse and Parallel Spiking State Space Models
by: Shen, Shuaijie, et al.
Published: (2024)

State-Free Inference of State-Space Models: The Transfer Function Approach
by: Parnichkun, Rom N., et al.
Published: (2024)

Priming: Hybrid State Space Models From Pre-trained Transformers
by: Chattopadhyay, Aditya, et al.
Published: (2026)

Bidirectional Linear Recurrent Models for Sequence-Level Multisource Fusion
by: Liu, Qisai, et al.
Published: (2025)

MambaLRP: Explaining Selective State Space Sequence Models
by: Jafari, Farnoush Rezaei, et al.
Published: (2024)

Mamba: Linear-Time Sequence Modeling with Selective State Spaces
by: Gu, Albert, et al.
Published: (2023)

State Stream Transformer (SST) V2: Parallel Training of Nonlinear Recurrence for Latent Space Reasoning
by: Aviss, Thea
Published: (2026)

IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs
by: Mao, Yuzhen, et al.
Published: (2024)

Deep State Space Recurrent Neural Networks for Time Series Forecasting
by: Inzirillo, Hugo
Published: (2024)

Introduction to Sequence Modeling with Transformers
by: Kämäräinen, Joni-Kristian
Published: (2025)

Preconditioned DeltaNet: Curvature-aware Sequence Modeling for Linear Recurrences
by: Tumma, Neehal, et al.
Published: (2026)

PICASO: Permutation-Invariant Context Composition with State Space Models
by: Liu, Tian Yu, et al.
Published: (2025)

Learning Deterministic Policies with Policy Gradients in Constrained Markov Decision Processes
by: Montenegro, Alessandro, et al.
Published: (2025)

A Diagonal Structured State Space Model on Loihi 2 for Efficient Streaming Sequence Processing
by: Meyer, Svea Marie, et al.
Published: (2024)