Cover Image

Structured Sparse Transition Matrices to Enable State Tracking in State-Space Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Terzić, Aleksandar, Menet, Nicolas, Hersche, Michael, Hofmann, Thomas, Rahimi, Abbas
Format:	Preprint
Published:	2025
Subjects:	Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Flash PD-SSM: Memory-Optimized Structured Sparse State-Space Models
by: Terzić, Aleksandar, et al.
Published: (2026)

Thompson Sampling via Fine-Tuning of LLMs
by: Menet, Nicolas, et al.
Published: (2025)

On the Expressiveness and Length Generalization of Selective State-Space Models on Regular Languages
by: Terzić, Aleksandar, et al.
Published: (2024)

Locally Coherent Parallel Decoding in Diffusion Language Models
by: Hersche, Michael, et al.
Published: (2026)

A Theoretical Analysis of Test-Driven Code Generation
by: Menet, Nicolas, et al.
Published: (2026)

Limits of Transformer Language Models on Learning to Compose Algorithms
by: Thomm, Jonathan, et al.
Published: (2024)

Towards Learning Abductive Reasoning using VSA Distributed Representations
by: Camposampiero, Giacomo, et al.
Published: (2024)

Terminating Differentiable Tree Experts
by: Thomm, Jonathan, et al.
Published: (2024)

POETS: Uncertainty-Aware LLM Optimization via Compute-Efficient Policy Ensembles
by: Menet, Nicolas, et al.
Published: (2026)

Soft-Masked Diffusion Language Models
by: Hersche, Michael, et al.
Published: (2025)

Probabilistic Abduction for Visual Abstract Reasoning via Learning Rules in Vector-symbolic Architectures
by: Hersche, Michael, et al.
Published: (2024)

On the Role of Noise in Factorizers for Disentangling Distributed Representations
by: Karunaratne, Geethan, et al.
Published: (2024)

Scalable Evaluation and Neural Models for Compositional Generalization
by: Camposampiero, Giacomo, et al.
Published: (2025)

Can Large Reasoning Models do Analogical Reasoning under Perceptual Uncertainty?
by: Camposampiero, Giacomo, et al.
Published: (2025)

I-RAVEN-X: Benchmarking Generalization and Robustness of Analogical and Mathematical Reasoning in Large Language and Reasoning Models
by: Camposampiero, Giacomo, et al.
Published: (2025)

A foundation model with multi-variate parallel attention to generate neuronal activity
by: Carzaniga, Francesco, et al.
Published: (2025)

The Case for Cleaner Biosignals: High-fidelity Neural Compressor Enables Transfer from Cleaner iEEG to Noisier EEG
by: Carzaniga, Francesco Stefano, et al.
Published: (2025)

Towards Learning to Reason: Comparing LLMs with Neuro-Symbolic on Arithmetic Relations in Abstract Reasoning
by: Hersche, Michael, et al.
Published: (2024)

Factorizers for Distributed Sparse Block Codes
by: Hersche, Michael, et al.
Published: (2023)

Steering Large Language Model Activations in Sparse Spaces
by: Bayat, Reza, et al.
Published: (2025)

XAMBA: Enabling Efficient State Space Models on Resource-Constrained Neural Processing Units
by: Das, Arghadip, et al.
Published: (2025)

Smaller Abstract State Spaces Enable Cross-Scale Generalization in Reinforcement Learning
by: Mustakim, Nasehatul, et al.
Published: (2026)

Auto-Discovery-Bench: Diagnosing Structured State Tracking in Oracle-Guided Discovery
by: Chen, Tingting, et al.
Published: (2025)

Chimera: State Space Models Beyond Sequences
by: Lahoti, Aakash, et al.
Published: (2025)

State Space Models over Directed Graphs
by: She, Junzhi, et al.
Published: (2025)

Priming: Hybrid State Space Models From Pre-trained Transformers
by: Chattopadhyay, Aditya, et al.
Published: (2026)

A Composable Channel-Adaptive Architecture for Seizure Classification
by: Carzaniga, Francesco, et al.
Published: (2025)

Enabling Unstructured Sparse Acceleration on Structured Sparse Accelerators
by: Jeong, Geonhwa, et al.
Published: (2024)

Uncovering the Spectral Bias in Diagonal State Space Models
by: Solozabal, Ruben, et al.
Published: (2025)

Exploring Adversarial Robustness of Deep State Space Models
by: Qi, Biqing, et al.
Published: (2024)

Mamba State-Space Models Are Lyapunov-Stable Learners
by: Halloran, John T., et al.
Published: (2024)

Imagine Beyond! Distributionally Robust Auto-Encoding for State Space Coverage in Online Reinforcement Learning
by: Castanet, Nicolas, et al.
Published: (2025)

Spatial-Temporal Attention Model for Traffic State Estimation with Sparse Internet of Vehicles
by: Xue, Jianzhe, et al.
Published: (2024)

(How) Do Language Models Track State?
by: Li, Belinda Z., et al.
Published: (2025)

Provable Benefits of Complex Parameterizations for Structured State Space Models
by: Ran-Milo, Yuval, et al.
Published: (2024)

STree: Speculative Tree Decoding for Hybrid State-Space Models
by: Wu, Yangchao, et al.
Published: (2025)

ss-Mamba: Semantic-Spline Selective State-Space Model
by: Ye, Zuochen
Published: (2025)

Recognizing Dementia from Neuropsychological Tests with State Space Models
by: Wang, Liming, et al.
Published: (2025)

Mamba: Linear-Time Sequence Modeling with Selective State Spaces
by: Gu, Albert, et al.
Published: (2023)

FACTS: A Factored State-Space Framework For World Modelling
by: Nanbo, Li, et al.
Published: (2024)