Cover Image

Were RNNs All We Needed?

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Feng, Leo, Tung, Frederick, Ahmed, Mohamed Osama, Bengio, Yoshua, Hajimirsadeghi, Hossein
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Tree Cross Attention
by: Feng, Leo, et al.
Published: (2023)

Memory Efficient Neural Processes via Constant Memory Attention Block
by: Feng, Leo, et al.
Published: (2023)

Attention as an RNN
by: Feng, Leo, et al.
Published: (2024)

You Need Reasoning to Learn Reasoning: The Limitations of Label-Free RL in Weak Base Models
by: Roy, Shuvendu, et al.
Published: (2025)

In-Context Parametric Inference: Point or Distribution Estimators?
by: Mittal, Sarthak, et al.
Published: (2025)

GFlowNet Foundations
by: Bengio, Yoshua, et al.
Published: (2021)

We're Different, We're the Same: Creative Homogeneity Across LLMs
by: Wenger, Emily, et al.
Published: (2025)

X-Node: Self-Explanation is All We Need
by: Sengupta, Prajit, et al.
Published: (2025)

Monte Carlo Tree Diffusion for System 2 Planning
by: Yoon, Jaesik, et al.
Published: (2025)

Shaping Inductive Bias in Diffusion Models through Frequency-Based Noise Control
by: Jiralerspong, Thomas, et al.
Published: (2025)

In-Context Reinforcement Learning through Bayesian Fusion of Context and Value Prior
by: Berkes, Anaïs, et al.
Published: (2026)

A Complexity-Based Theory of Compositionality
by: Elmoznino, Eric, et al.
Published: (2024)

FALCON: Few-step Accurate Likelihoods for Continuous Flows
by: Rehman, Danyal, et al.
Published: (2025)

Efficient Causal Graph Discovery Using Large Language Models
by: Jiralerspong, Thomas, et al.
Published: (2024)

How Far Are We From AGI: Are LLMs All We Need?
by: Feng, Tao, et al.
Published: (2024)

Expert-Guided LLM Reasoning for Battery Discovery: From AI-Driven Hypothesis to Synthesis and Characterization
by: Liu, Shengchao, et al.
Published: (2025)

Active Attacks: Red-teaming LLMs via Adaptive Environments
by: Yun, Taeyoung, et al.
Published: (2025)

Find A Winning Sign: Sign Is All We Need to Win the Lottery
by: Oh, Junghun, et al.
Published: (2025)

Logits are All We Need to Adapt Closed Models
by: Hiranandani, Gaurush, et al.
Published: (2025)

Forget Sharpness: Perturbed Forgetting of Model Biases Within SAM Dynamics
by: Vani, Ankit, et al.
Published: (2024)

Distributional GFlowNets with Quantile Flows
by: Zhang, Dinghuai, et al.
Published: (2023)

Element-wise Attention Is All You Need
by: Feng, Guoxin
Published: (2025)

Discrete, compositional, and symbolic representations through attractor dynamics
by: Nam, Andrew, et al.
Published: (2023)

Consciousness-Inspired Spatio-Temporal Abstractions for Better Generalization in Reinforcement Learning
by: Zhao, Mingde, et al.
Published: (2023)

Radar: Fast Long-Context Decoding for Any Transformer
by: Hao, Yongchang, et al.
Published: (2025)

Action abstractions for amortized sampling
by: Boussif, Oussama, et al.
Published: (2024)

Memory Caching: RNNs with Growing Memory
by: Behrouz, Ali, et al.
Published: (2026)

Trajectory Flow Matching with Applications to Clinical Time Series Modeling
by: Zhang, Xi, et al.
Published: (2024)

Structure-Aligned Protein Language Model
by: Chen, Can, et al.
Published: (2025)

Pessimistic Iterative Planning with RNNs for Robust POMDPs
by: Galesloot, Maris F. L., et al.
Published: (2024)

$\texttt{lrnnx}$: A library for Linear RNNs
by: Bania, Karan, et al.
Published: (2026)

Diffusion Generative Flow Samplers: Improving learning signals through partial trajectory optimization
by: Zhang, Dinghuai, et al.
Published: (2023)

Learning What Matters: Steering Diffusion via Spectrally Anisotropic Forward Noise
by: Scimeca, Luca, et al.
Published: (2025)

Adaptive Inference-Time Scaling via Cyclic Diffusion Search
by: Lee, Gyubin, et al.
Published: (2025)

Unlearning via Sparse Representations
by: Shah, Vedant, et al.
Published: (2023)

Balancing Sparse RNNs with Hyperparameterization Benefiting Meta-Learning
by: Hershey, Quincy, et al.
Published: (2025)

Implicit Language Models are RNNs: Balancing Parallelization and Expressivity
by: Schöne, Mark, et al.
Published: (2025)

HadamRNN: Binary and Sparse Ternary Orthogonal RNNs
by: Foucault, Armand, et al.
Published: (2025)

Cooperation Is All You Need
by: Adeel, Ahsan, et al.
Published: (2023)

Efficient Regression-Based Training of Normalizing Flows for Boltzmann Generators
by: Rehman, Danyal, et al.
Published: (2025)