Cover Image

Length Generalization with Log-Depth Recurrent Units

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Pert, Charles, Alrajeh, Dalal, Russo, Alessandra
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

RNN Generalization to Omega-Regular Languages
by: Pert, Charles, et al.
Published: (2025)

$ω$-regular Expression Synthesis from Transition-Based Büchi Automata
by: Pert, Charles, et al.
Published: (2024)

Beyond Fixed Tasks: Unsupervised Environment Design for Task-Level Pairs
by: Furelos-Blanco, Daniel, et al.
Published: (2025)

Understanding and Improving Length Generalization in Recurrent Models
by: Ruiz, Ricardo Buitrago, et al.
Published: (2025)

Enhancing Binary Encoded Crime Linkage Analysis Using Siamese Network
by: Zhan, Yicheng, et al.
Published: (2025)

Grounding Generated Videos in Feasible Plans via World Models
by: Ziakas, Christos, et al.
Published: (2026)

The Recurrent Transformer: Greater Effective Depth and Efficient Decoding
by: Oncescu, Costin-Andrei, et al.
Published: (2026)

Two-Scale Latent Dynamics for Recurrent-Depth Transformers
by: Pappone, Francesco, et al.
Published: (2025)

Cryptocurrency Price Prediction Using Parallel Gated Recurrent Units
by: Asadpour, Milad, et al.
Published: (2025)

Minion Gated Recurrent Unit for Continual Learning
by: Zyarah, Abdullah M., et al.
Published: (2025)

Thinking Deeper, Not Longer: Depth-Recurrent Transformers for Compositional Generalization
by: Chen, Hung-Hsuan
Published: (2026)

Loop, Think, & Generalize: Implicit Reasoning in Recurrent-Depth Transformers
by: Kohli, Harsh, et al.
Published: (2026)

Predictive Representations for Skill Transfer in Reinforcement Learning
by: Vereecken, Ruben, et al.
Published: (2026)

A Little Depth Goes a Long Way: The Expressive Power of Log-Depth Transformers
by: Merrill, William, et al.
Published: (2025)

Gate Recurrent Unit for Efficient Industrial Gas Identification
by: Wang, Ding
Published: (2024)

Aligning Flow Map Policies with Optimal Q-Guidance
by: Ziakas, Christos, et al.
Published: (2026)

Bridging Graph and State-Space Modeling for Intensive Care Unit Length of Stay Prediction
by: Zi, Shuqi, et al.
Published: (2025)

SCORE: Replacing Layer Stacking with Contractive Recurrent Depth
by: Godin, Guillaume
Published: (2026)

LengthLogD: A Length-Stratified Ensemble Framework for Enhanced Peptide Lipophilicity Prediction via Multi-Scale Feature Integration
by: Wu, Shuang, et al.
Published: (2025)

FastLogAD: Log Anomaly Detection with Mask-Guided Pseudo Anomaly Generation and Discrimination
by: Lin, Yifei, et al.
Published: (2024)

Real-Time Recurrent Learning using Trace Units in Reinforcement Learning
by: Elelimy, Esraa, et al.
Published: (2024)

Depth-Structured Music Recurrence: Budgeted Recurrent Attention for Full-Piece Symbolic Music Modeling
by: Yi, Yungang, et al.
Published: (2026)

Non-Asymptotic Length Generalization
by: Chen, Thomas, et al.
Published: (2025)

Looped Transformers for Length Generalization
by: Fan, Ying, et al.
Published: (2024)

Unlocking Generalization for Robotics via Modularity and Scale
by: Dalal, Murtaza
Published: (2025)

Pedestrian Volume Prediction Using a Diffusion Convolutional Gated Recurrent Unit Model
by: Dong, Yiwei, et al.
Published: (2024)

Driving Assistance System for Ambulances to Minimise the Vibrations in Patient Cabin
by: Aldegheishem, Abdulaziz, et al.
Published: (2026)

Looped SSMs: Depth-Recurrence and Input Reshaping for Time Series Classification
by: Farsang, Mónika, et al.
Published: (2026)

Latent Chain-of-Thought? Decoding the Depth-Recurrent Transformer
by: Lu, Wenquan, et al.
Published: (2025)

Predicting Liquidity Coverage Ratio with Gated Recurrent Units: A Deep Learning Model for Risk Management
by: Xu, Zhen, et al.
Published: (2024)

KoopAGRU: A Koopman-based Anomaly Detection in Time-Series using Gated Recurrent Units
by: Yahia, Issam Ait, et al.
Published: (2025)

Quantitative Bounds for Length Generalization in Transformers
by: Izzo, Zachary, et al.
Published: (2025)

Universal Length Generalization with Turing Programs
by: Hou, Kaiying, et al.
Published: (2024)

Adaptive Length Image Tokenization via Recurrent Allocation
by: Duggal, Shivam, et al.
Published: (2024)

$\texttt{SEM-CTRL}$: Semantically Controlled Decoding
by: Albinhassan, Mohammad, et al.
Published: (2025)

Efficient Parallel Samplers for Recurrent-Depth Models and Their Connection to Diffusion Language Models
by: Geiping, Jonas, et al.
Published: (2025)

Text Sentiment Analysis and Classification Based on Bidirectional Gated Recurrent Units (GRUs) Model
by: Xu, Wei, et al.
Published: (2024)

LogSyn: A Few-Shot LLM Framework for Structured Insight Extraction from Unstructured General Aviation Maintenance Logs
by: Agarwal, Devansh, et al.
Published: (2025)

Learning Variable-Length Tokenization for Generative Recommendation
by: Wang, Minhao, et al.
Published: (2026)

The Role of Foundation Models in Neuro-Symbolic Learning and Reasoning
by: Cunnington, Daniel, et al.
Published: (2024)