The Expressive Limits of Diagonal SSMs for State-Tracking
Fuente:
arXiv
Saved in:
| Main Authors: | Shakerinava, Mehran, Khavari, Behnoush, Ravanbakhsh, Siamak, Chandar, Sarath |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Parity Requires Unified Input Dependence and Negative Eigenvalues in SSMs
by: Khavari, Behnoush, et al.
Published: (2025)
by: Khavari, Behnoush, et al.
Published: (2025)
Beyond Scalar Rewards: An Axiomatic Framework for Lexicographic MDPs
by: Shakerinava, Mehran, et al.
Published: (2025)
by: Shakerinava, Mehran, et al.
Published: (2025)
Weight-Sharing Regularization
by: Shakerinava, Mehran, et al.
Published: (2023)
by: Shakerinava, Mehran, et al.
Published: (2023)
The Role of Symmetry in Optimizing Overparameterized Networks
by: Sareen, Kusha, et al.
Published: (2026)
by: Sareen, Kusha, et al.
Published: (2026)
On the Expressive Power and Limitations of Multi-Layer SSMs
by: Zubić, Nikola, et al.
Published: (2026)
by: Zubić, Nikola, et al.
Published: (2026)
Learning to Reach Goals via Diffusion
by: Jain, Vineet, et al.
Published: (2023)
by: Jain, Vineet, et al.
Published: (2023)
Multi-Armed Sampling Problem and the End of Exploration
by: Pedramfar, Mohammad, et al.
Published: (2025)
by: Pedramfar, Mohammad, et al.
Published: (2025)
Symmetry Breaking and Equivariant Neural Networks
by: Kaba, Sékou-Oumar, et al.
Published: (2023)
by: Kaba, Sékou-Oumar, et al.
Published: (2023)
Scaling Laws and Symmetry, Evidence from Neural Force Fields
by: Ngo, Khang, et al.
Published: (2025)
by: Ngo, Khang, et al.
Published: (2025)
On the Identifiability of Causal Abstractions
by: Li, Xiusi, et al.
Published: (2025)
by: Li, Xiusi, et al.
Published: (2025)
Sampling from Energy-based Policies using Diffusion
by: Jain, Vineet, et al.
Published: (2024)
by: Jain, Vineet, et al.
Published: (2024)
Faithfulness Measurable Masked Language Models
by: Madsen, Andreas, et al.
Published: (2023)
by: Madsen, Andreas, et al.
Published: (2023)
On Diffusion Modeling for Anomaly Detection
by: Livernoche, Victor, et al.
Published: (2023)
by: Livernoche, Victor, et al.
Published: (2023)
Diffusion Tree Sampling: Scalable inference-time alignment of diffusion models
by: Jain, Vineet, et al.
Published: (2025)
by: Jain, Vineet, et al.
Published: (2025)
Are self-explanations from Large Language Models faithful?
by: Madsen, Andreas, et al.
Published: (2024)
by: Madsen, Andreas, et al.
Published: (2024)
Exploring Quantization for Efficient Pre-Training of Transformer Language Models
by: Chitsaz, Kamran, et al.
Published: (2024)
by: Chitsaz, Kamran, et al.
Published: (2024)
GG-SSMs: Graph-Generating State Space Models
by: Zubić, Nikola, et al.
Published: (2024)
by: Zubić, Nikola, et al.
Published: (2024)
Mastering Memory Tasks with World Models
by: Samsami, Mohammad Reza, et al.
Published: (2024)
by: Samsami, Mohammad Reza, et al.
Published: (2024)
Neural Coherence : Find higher performance to out-of-distribution tasks from few samples
by: Guiroy, Simon, et al.
Published: (2025)
by: Guiroy, Simon, et al.
Published: (2025)
Intelligent Switching for Reset-Free RL
by: Patil, Darshan, et al.
Published: (2024)
by: Patil, Darshan, et al.
Published: (2024)
Context-Aware Assistant Selection for Improved Inference Acceleration with Large Language Models
by: Huang, Jerry, et al.
Published: (2024)
by: Huang, Jerry, et al.
Published: (2024)
Lookbehind-SAM: k steps back, 1 step forward
by: Mordido, Gonçalo, et al.
Published: (2023)
by: Mordido, Gonçalo, et al.
Published: (2023)
Energy Loss Functions for Physical Systems
by: Kaba, Sékou-Oumar, et al.
Published: (2025)
by: Kaba, Sékou-Oumar, et al.
Published: (2025)
Reconstruction or Semantics? What Makes a Latent Space Useful for Robotic World Models
by: Nilaksh, et al.
Published: (2026)
by: Nilaksh, et al.
Published: (2026)
CoPeP: Benchmarking Continual Pretraining for Protein Language Models
by: Patil, Darshan, et al.
Published: (2026)
by: Patil, Darshan, et al.
Published: (2026)
Sub-goal Distillation: A Method to Improve Small Language Agents
by: Hashemzadeh, Maryam, et al.
Published: (2024)
by: Hashemzadeh, Maryam, et al.
Published: (2024)
Manifold Metric: A Loss Landscape Approach for Predicting Model Performance
by: Malviya, Pranshu, et al.
Published: (2024)
by: Malviya, Pranshu, et al.
Published: (2024)
Squeezing More from the Stream : Learning Representation Online for Streaming Reinforcement Learning
by: Nilaksh, et al.
Published: (2026)
by: Nilaksh, et al.
Published: (2026)
Effect of Document Packing on the Latent Multi-Hop Reasoning Capabilities of Large Language Models
by: Prato, Gabriele, et al.
Published: (2025)
by: Prato, Gabriele, et al.
Published: (2025)
Towards Practical Tool Usage for Continually Learning LLMs
by: Huang, Jerry, et al.
Published: (2024)
by: Huang, Jerry, et al.
Published: (2024)
Inverting Data Transformations via Diffusion Sampling
by: Kim, Jinwoo, et al.
Published: (2026)
by: Kim, Jinwoo, et al.
Published: (2026)
Lag Operator SSMs: A Geometric Framework for Structured State Space Modeling
by: Tomonaga, Sutashu, et al.
Published: (2025)
by: Tomonaga, Sutashu, et al.
Published: (2025)
Dialectics of Alignment: Harnessing Unsafe Knowledge for Dynamic Safety Routing
by: Hashemzadeh, Maryam, et al.
Published: (2026)
by: Hashemzadeh, Maryam, et al.
Published: (2026)
NovoMolGen: Rethinking Molecular Language Model Pretraining
by: Chitsaz, Kamran, et al.
Published: (2025)
by: Chitsaz, Kamran, et al.
Published: (2025)
Long-Horizon Model-Based Offline Reinforcement Learning Without Explicit Conservatism
by: Ni, Tianwei, et al.
Published: (2025)
by: Ni, Tianwei, et al.
Published: (2025)
Interpretability Needs a New Paradigm
by: Madsen, Andreas, et al.
Published: (2024)
by: Madsen, Andreas, et al.
Published: (2024)
Why Don't Prompt-Based Fairness Metrics Correlate?
by: Zayed, Abdelrahman, et al.
Published: (2024)
by: Zayed, Abdelrahman, et al.
Published: (2024)
Should We Attend More or Less? Modulating Attention for Fairness
by: Zayed, Abdelrahman, et al.
Published: (2023)
by: Zayed, Abdelrahman, et al.
Published: (2023)
GRPO-$λ$: Credit Assignment improves LLM Reasoning
by: Parthasarathi, Prasanna, et al.
Published: (2025)
by: Parthasarathi, Prasanna, et al.
Published: (2025)
Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality
by: Dao, Tri, et al.
Published: (2024)
by: Dao, Tri, et al.
Published: (2024)
Similar Items
-
Parity Requires Unified Input Dependence and Negative Eigenvalues in SSMs
by: Khavari, Behnoush, et al.
Published: (2025) -
Beyond Scalar Rewards: An Axiomatic Framework for Lexicographic MDPs
by: Shakerinava, Mehran, et al.
Published: (2025) -
Weight-Sharing Regularization
by: Shakerinava, Mehran, et al.
Published: (2023) -
The Role of Symmetry in Optimizing Overparameterized Networks
by: Sareen, Kusha, et al.
Published: (2026) -
On the Expressive Power and Limitations of Multi-Layer SSMs
by: Zubić, Nikola, et al.
Published: (2026)