Uncovering the Spectral Bias in Diagonal State Space Models
Fuente:
arXiv
Saved in:
| Main Authors: | Solozabal, Ruben, Bojkovic, Velibor, AlQuabeh, Hilal, Inui, Kentaro, Takáč, Martin |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
WaveSSM: Multiscale State-Space Models for Non-stationary Signal Attention
by: Solozabal, Ruben, et al.
Published: (2026)
by: Solozabal, Ruben, et al.
Published: (2026)
Mechanistic Insights into Grokking from the Embedding Layer
by: AlquBoj, H. V., et al.
Published: (2025)
by: AlquBoj, H. V., et al.
Published: (2025)
RECALL: Library-Like Behavior In Language Models is Enhanced by Self-Referencing Causal Cycles
by: Nwadike, Munachiso, et al.
Published: (2025)
by: Nwadike, Munachiso, et al.
Published: (2025)
Limited Memory Online Gradient Descent for Kernelized Pairwise Learning with Dynamic Averaging
by: AlQuabeh, Hilal, et al.
Published: (2024)
by: AlQuabeh, Hilal, et al.
Published: (2024)
Temporal Misalignment in ANN-SNN Conversion and Its Mitigation via Probabilistic Spiking Neurons
by: Bojković, Velibor, et al.
Published: (2025)
by: Bojković, Velibor, et al.
Published: (2025)
Number Representations in LLMs: A Computational Parallel to Human Perception
by: AlquBoj, H. V., et al.
Published: (2025)
by: AlquBoj, H. V., et al.
Published: (2025)
Enhance Hyperbolic Representation Learning via Second-order Pooling
by: Song, Kun, et al.
Published: (2024)
by: Song, Kun, et al.
Published: (2024)
Emergence of Primacy and Recency Effect in Mamba: A Mechanistic Point of View
by: Airlangga, Muhammad Cendekia, et al.
Published: (2025)
by: Airlangga, Muhammad Cendekia, et al.
Published: (2025)
Reinforcement Learning for Solving Stochastic Vehicle Routing Problem with Time Windows
by: Iklassov, Zangir, et al.
Published: (2024)
by: Iklassov, Zangir, et al.
Published: (2024)
Constrained Adversarial Perturbation
by: Nishad, Virendra, et al.
Published: (2025)
by: Nishad, Virendra, et al.
Published: (2025)
The Geometry of Numerical Reasoning: Language Models Compare Numeric Properties in Linear Subspaces
by: El-Shangiti, Ahmed Oumar, et al.
Published: (2024)
by: El-Shangiti, Ahmed Oumar, et al.
Published: (2024)
Efficient State Space Model via Fast Tensor Convolution and Block Diagonalization
by: Liang, Tongyi, et al.
Published: (2024)
by: Liang, Tongyi, et al.
Published: (2024)
T2IBias: Uncovering Societal Bias Encoded in the Latent Space of Text-to-Image Generative Models
by: Sufian, Abu, et al.
Published: (2025)
by: Sufian, Abu, et al.
Published: (2025)
FTBC: Forward Temporal Bias Correction for Optimizing ANN-SNN Conversion
by: Wu, Xiaofeng, et al.
Published: (2024)
by: Wu, Xiaofeng, et al.
Published: (2024)
A Decade of Deep Learning: A Survey on The Magnificent Seven
by: Azizov, Dilshod, et al.
Published: (2024)
by: Azizov, Dilshod, et al.
Published: (2024)
Uncovering the Structure of Explanation Quality with Spectral Analysis
by: Maeß, Johannes, et al.
Published: (2025)
by: Maeß, Johannes, et al.
Published: (2025)
Uncovering Bias in Foundation Models: Impact, Testing, Harm, and Mitigation
by: Sun, Shuzhou, et al.
Published: (2025)
by: Sun, Shuzhou, et al.
Published: (2025)
Thinking like a CHEMIST: Combined Heterogeneous Embedding Model Integrating Structure and Tokens
by: Rekut, Nikolai, et al.
Published: (2025)
by: Rekut, Nikolai, et al.
Published: (2025)
SPACT18: Spiking Human Action Recognition Benchmark Dataset with Complementary RGB and Thermal Modalities
by: Ashraf, Yasser, et al.
Published: (2025)
by: Ashraf, Yasser, et al.
Published: (2025)
Aperiodic and Low-Frequency Spectral Bias in Reconstruction based EEG Foundation Models
by: Kommineni, Aditya, et al.
Published: (2026)
by: Kommineni, Aditya, et al.
Published: (2026)
Spectral Adapter: Fine-Tuning in Spectral Space
by: Zhang, Fangzhao, et al.
Published: (2024)
by: Zhang, Fangzhao, et al.
Published: (2024)
EchoMamba4Rec: Harmonizing Bidirectional State Space Models with Spectral Filtering for Advanced Sequential Recommendation
by: Wang, Yuda, et al.
Published: (2024)
by: Wang, Yuda, et al.
Published: (2024)
A Diagonal Structured State Space Model on Loihi 2 for Efficient Streaming Sequence Processing
by: Meyer, Svea Marie, et al.
Published: (2024)
by: Meyer, Svea Marie, et al.
Published: (2024)
Autocorrelation Reintroduces Spectral Bias in KANs for Time Series Forecasting
by: Zeng, Chen, et al.
Published: (2026)
by: Zeng, Chen, et al.
Published: (2026)
Latent Reasoning in TRMs is Secretly a Policy Improvement Operator
by: Asadulaev, Arip, et al.
Published: (2025)
by: Asadulaev, Arip, et al.
Published: (2025)
Flow-Induced Diagonal Gaussian Processes
by: Lin, Moule, et al.
Published: (2025)
by: Lin, Moule, et al.
Published: (2025)
Y-Shaped Generative Flows
by: Asadulaev, Arip, et al.
Published: (2025)
by: Asadulaev, Arip, et al.
Published: (2025)
Zero-Shot Off-Policy Learning
by: Asadulaev, Arip, et al.
Published: (2026)
by: Asadulaev, Arip, et al.
Published: (2026)
The Spectral Bias of Shallow Neural Network Learning is Shaped by the Choice of Non-linearity
by: Sahs, Justin, et al.
Published: (2025)
by: Sahs, Justin, et al.
Published: (2025)
Addressing Spectral Bias of Deep Neural Networks by Multi-Grade Deep Learning
by: Fang, Ronglong, et al.
Published: (2024)
by: Fang, Ronglong, et al.
Published: (2024)
The AI Data Scientist
by: Akimov, Farkhad, et al.
Published: (2025)
by: Akimov, Farkhad, et al.
Published: (2025)
Chimera: State Space Models Beyond Sequences
by: Lahoti, Aakash, et al.
Published: (2025)
by: Lahoti, Aakash, et al.
Published: (2025)
State Space Models over Directed Graphs
by: She, Junzhi, et al.
Published: (2025)
by: She, Junzhi, et al.
Published: (2025)
Uncovering Capabilities of Model Pruning in Graph Contrastive Learning
by: Wu, Junran, et al.
Published: (2024)
by: Wu, Junran, et al.
Published: (2024)
Structured Sparse Transition Matrices to Enable State Tracking in State-Space Models
by: Terzić, Aleksandar, et al.
Published: (2025)
by: Terzić, Aleksandar, et al.
Published: (2025)
Exploring Adversarial Robustness of Deep State Space Models
by: Qi, Biqing, et al.
Published: (2024)
by: Qi, Biqing, et al.
Published: (2024)
Mamba State-Space Models Are Lyapunov-Stable Learners
by: Halloran, John T., et al.
Published: (2024)
by: Halloran, John T., et al.
Published: (2024)
Learning Implicit Bias in Generative Spaces for Accelerating Protein Dynamics Emulation
by: Cheng, Kaihui, et al.
Published: (2026)
by: Cheng, Kaihui, et al.
Published: (2026)
SBS: Enhancing Parameter-Efficiency of Neural Representations for Neural Networks via Spectral Bias Suppression
by: Xie, Qihu, et al.
Published: (2025)
by: Xie, Qihu, et al.
Published: (2025)
Bias Fitting to Mitigate Length Bias of Reward Model in RLHF
by: Zhao, Kangwen, et al.
Published: (2025)
by: Zhao, Kangwen, et al.
Published: (2025)
Similar Items
-
WaveSSM: Multiscale State-Space Models for Non-stationary Signal Attention
by: Solozabal, Ruben, et al.
Published: (2026) -
Mechanistic Insights into Grokking from the Embedding Layer
by: AlquBoj, H. V., et al.
Published: (2025) -
RECALL: Library-Like Behavior In Language Models is Enhanced by Self-Referencing Causal Cycles
by: Nwadike, Munachiso, et al.
Published: (2025) -
Limited Memory Online Gradient Descent for Kernelized Pairwise Learning with Dynamic Averaging
by: AlQuabeh, Hilal, et al.
Published: (2024) -
Temporal Misalignment in ANN-SNN Conversion and Its Mitigation via Probabilistic Spiking Neurons
by: Bojković, Velibor, et al.
Published: (2025)