Cover Image

Model Compression Method for S4 with Diagonal State Space Layers using Balanced Truncation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ezoe, Haruka, Sato, Kazuhiro
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Compression Method for Deep Diagonal State Space Model Based on $H^2$ Optimal Reduction
by: Sakamoto, Hiroki, et al.
Published: (2025)

A Deep State-Space Model Compression Method using Upper Bound on Output Error
by: Sakamoto, Hiroki, et al.
Published: (2025)

Multiscale Euclidean Network Trajectories: Second-Moment Geometry, Attribution, and Change Points
by: Ezoe, Haruka, et al.
Published: (2026)

Unfolded Laplacian Spectral Embedding: A Theoretically Grounded Approach to Dynamic Network Representation
by: Ezoe, Haruka, et al.
Published: (2025)

Uncovering the Spectral Bias in Diagonal State Space Models
by: Solozabal, Ruben, et al.
Published: (2025)

Truncated Neural Likelihood Estimation for Simulation-Based Inference in State-Space Models
by: Tsampourakis, Kostas, et al.
Published: (2026)

Efficient State Space Model via Fast Tensor Convolution and Block Diagonalization
by: Liang, Tongyi, et al.
Published: (2024)

NOMADS: Non-Markovian Optimization-based Modeling for Approximate Dynamics with Spatially-homogeneous Memory
by: Anzaki, Ryoji, et al.
Published: (2024)

Layer-Adaptive State Pruning for Deep State Space Models
by: Gwak, Minseon, et al.
Published: (2024)

The Expressive Limits of Diagonal SSMs for State-Tracking
by: Shakerinava, Mehran, et al.
Published: (2026)

DiBA: Diagonal and Binary Matrix Approximation for Neural Network Weight Compression
by: Ono, Nobutaka
Published: (2026)

SVD-LLM: Truncation-aware Singular Value Decomposition for Large Language Model Compression
by: Wang, Xin, et al.
Published: (2024)

Diagonal Over-parameterization in Reproducing Kernel Hilbert Spaces as an Adaptive Feature Model: Generalization and Adaptivity
by: Li, Yicheng, et al.
Published: (2025)

Efficient Pre-Training of LLMs through Truncated SVD Layers
by: Kamali, Kaivan, et al.
Published: (2026)

Hankel Singular Value Regularization for Highly Compressible State Space Models
by: Schwerdtner, Paul, et al.
Published: (2025)

A Diagonal Structured State Space Model on Loihi 2 for Efficient Streaming Sequence Processing
by: Meyer, Svea Marie, et al.
Published: (2024)

Mathematical Formalism for Memory Compression in Selective State Space Models
by: Bhat, Siddhanth
Published: (2024)

Exploring Weight Balancing on Long-Tailed Recognition Problem
by: Hasegawa, Naoya, et al.
Published: (2023)

TVineSynth: A Truncated C-Vine Copula Generator of Synthetic Tabular Data to Balance Privacy and Utility
by: Griesbauer, Elisabeth, et al.
Published: (2025)

ROCKET: Rapid Optimization via Calibration-guided Knapsack Enhanced Truncation for Efficient Model Compression
by: Ali, Ammar, et al.
Published: (2026)

AutoCompress: Critical Layer Isolation for Efficient Transformer Compression
by: Thorat, Archit
Published: (2026)

S7: Selective and Simplified State Space Layers for Sequence Modeling
by: Soydan, Taylan, et al.
Published: (2024)

Diagonalization without Diagonalization: A Direct Optimization Approach for Solid-State Density Functional Theory
by: Li, Tianbo, et al.
Published: (2024)

From Layers to States: A State Space Model Perspective to Deep Neural Network Layer Dynamics
by: Liu, Qinshuo, et al.
Published: (2025)

End-to-End Training Induces Information Bottleneck through Layer-Role Differentiation: A Comparative Analysis with Layer-wise Training
by: Sakamoto, Keitaro, et al.
Published: (2024)

The Curious Case of In-Training Compression of State Space Models
by: Chahine, Makram, et al.
Published: (2025)

Mamba-3: Improved Sequence Modeling using State Space Principles
by: Lahoti, Aakash, et al.
Published: (2026)

StateSMix: Online Lossless Compression via Mamba State Space Models and Sparse N-gram Context Mixing
by: Tacconelli, Roberto
Published: (2026)

Improving Probabilistic Diffusion Models With Optimal Diagonal Covariance Matching
by: Ou, Zijing, et al.
Published: (2024)

DARK: Diagonal-Anchored Repulsive Knowledge Distillation for Vision-Language Models under Extreme Compression
by: Saeed, Numan, et al.
Published: (2026)

Polynomial Context-Truncation Sensitivity in Autoregressive Language Models: Sequential Wyner-Ziv Bounds for KV Cache Compression
by: Kim, Munsik
Published: (2026)

Spectral State Space Models
by: Agarwal, Naman, et al.
Published: (2023)

Adaptive Pruning with Module Robustness Sensitivity: Balancing Compression and Robustness
by: Bai, Lincen, et al.
Published: (2024)

The Effect of Balancing Methods on Model Behavior in Imbalanced Classification Problems
by: Stando, Adrian, et al.
Published: (2023)

Truncated Consistency Models
by: Lee, Sangyun, et al.
Published: (2024)

SambaMixer: State of Health Prediction of Li-ion Batteries using Mamba State Space Models
by: Olalde-Verano, José Ignacio, et al.
Published: (2024)

Sequential Compression Layers for Efficient Federated Learning in Foundational Models
by: Mahla, Navyansh, et al.
Published: (2024)

Alternative Methods to SHAP Derived from Properties of Kernels: A Note on Theoretical Analysis
by: Hiraki, Kazuhiro, et al.
Published: (2024)

Communication Dynamics Neural Networks: FFT-Diagonalized Layers for Improved Hessian Conditioning at Reduced Parameter Count
by: Pan, Lurong
Published: (2026)

Neural Stochastic Differential Equations on Compact State Spaces: Theory, Methods, and Application to Suicide Risk Modeling
by: Lu, Malinda, et al.
Published: (2025)