:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Authors:	Ruiz, Ricardo Buitrago, Gu, Albert
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	https://arxiv.org/abs/2507.02782
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

On the Benefits of Memory for Modeling Time-Dependent PDEs
by: Ruiz, Ricardo Buitrago, et al.
Published: (2024)

Understanding the Skill Gap in Recurrent Language Models: The Role of the Gather-and-Aggregate Mechanism
by: Bick, Aviv, et al.
Published: (2025)

Understanding and Improving Length Generalization in Hierarchical Sparse Attention Models
by: Leng, Jiaqi, et al.
Published: (2025)

Length Generalization with Log-Depth Recurrent Units
by: Pert, Charles, et al.
Published: (2026)

Llamba: Scaling Distilled Recurrent Models for Efficient Language Processing
by: Bick, Aviv, et al.
Published: (2025)

Improving Variable-Length Generation in Diffusion Language Models via Length Regularization
by: Cheng, Zicong, et al.
Published: (2026)

Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality
by: Dao, Tri, et al.
Published: (2024)

A Formal Framework for Understanding Length Generalization in Transformers
by: Huang, Xinting, et al.
Published: (2024)

Understanding and Mitigating Memorization in Generative Models via Sharpness of Probability Landscapes
by: Jeon, Dongjae, et al.
Published: (2024)

Delayed Attention Training Improves Length Generalization in Transformer--RNN Hybrids
by: Phan, Buu, et al.
Published: (2025)

Channel-Wise MLPs Improve the Generalization of Recurrent Convolutional Networks
by: Breslow, Nathan
Published: (2025)

Self-Improving Transformers Overcome Easy-to-Hard and Length Generalization Challenges
by: Lee, Nayoung, et al.
Published: (2025)

Predicting the Stay Length of Patients in Hospitals using Convolutional Gated Recurrent Deep Learning Model
by: Neshat, Mehdi, et al.
Published: (2024)

Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers
by: Hwang, Sukjun, et al.
Published: (2024)

Mamba: Linear-Time Sequence Modeling with Selective State Spaces
by: Gu, Albert, et al.
Published: (2023)

Adaptive Length Image Tokenization via Recurrent Allocation
by: Duggal, Shivam, et al.
Published: (2024)

Dynamic Chunking for End-to-End Hierarchical Sequence Modeling
by: Hwang, Sukjun, et al.
Published: (2025)

Non-Asymptotic Length Generalization
by: Chen, Thomas, et al.
Published: (2025)

Looped Transformers for Length Generalization
by: Fan, Ying, et al.
Published: (2024)

Mamba-3: Improved Sequence Modeling using State Space Principles
by: Lahoti, Aakash, et al.
Published: (2026)

Interpreting Affine Recurrence Learning in GPT-style Transformers
by: Bhargav, Samarth, et al.
Published: (2024)

Quantitative Bounds for Length Generalization in Transformers
by: Izzo, Zachary, et al.
Published: (2025)

Universal Length Generalization with Turing Programs
by: Hou, Kaiying, et al.
Published: (2024)

ARC-AGI Without Pretraining
by: Liao, Isaac, et al.
Published: (2025)

Position Coupling: Improving Length Generalization of Arithmetic Transformers Using Task Structure
by: Cho, Hanseul, et al.
Published: (2024)

Arithmetic Transformers Can Length-Generalize in Both Operand Length and Count
by: Cho, Hanseul, et al.
Published: (2024)

On Provable Length and Compositional Generalization
by: Ahuja, Kartik, et al.
Published: (2024)

To Infinity and Beyond: Tool-Use Unlocks Length Generalization in State Space Models
by: Malach, Eran, et al.
Published: (2025)

Understanding Dynamic Compute Allocation in Recurrent Transformers
by: Moosa, Ibraheem Muhammad, et al.
Published: (2026)

Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models
by: De, Soham, et al.
Published: (2024)

Learning Variable-Length Tokenization for Generative Recommendation
by: Wang, Minhao, et al.
Published: (2026)

Fragility-aware Classification for Understanding Risk and Improving Generalization
by: Yang, Chen, et al.
Published: (2025)

Understanding the differences in Foundation Models: Attention, State Space Models, and Recurrent Neural Networks
by: Sieber, Jerome, et al.
Published: (2024)

A Theory of Machine Understanding via the Minimum Description Length Principle
by: Zhang, Canlin, et al.
Published: (2025)

Generalization and Risk Bounds for Recurrent Neural Networks
by: Cheng, Xuewei, et al.
Published: (2024)

On Vanishing Variance in Transformer Length Generalization
by: Li, Ruining, et al.
Published: (2025)

Mamba Modulation: On the Length Generalization of Mamba
by: Lu, Peng, et al.
Published: (2025)

Low-Dimension-to-High-Dimension Generalization And Its Implications for Length Generalization
by: Chen, Yang, et al.
Published: (2024)

Probing Length Generalization in Mamba via Image Reconstruction
by: Rathjens, Jan, et al.
Published: (2026)

Uncertainty-Gated Generative Modeling
by: Gu, Xingrui, et al.
Published: (2026)