Cover Image

Attention as an RNN

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Feng, Leo, Tung, Frederick, Hajimirsadeghi, Hossein, Ahmed, Mohamed Osama, Bengio, Yoshua, Mori, Greg
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Tree Cross Attention
by: Feng, Leo, et al.
Published: (2023)

Memory Efficient Neural Processes via Constant Memory Attention Block
by: Feng, Leo, et al.
Published: (2023)

Were RNNs All We Needed?
by: Feng, Leo, et al.
Published: (2024)

Radar: Fast Long-Context Decoding for Any Transformer
by: Hao, Yongchang, et al.
Published: (2025)

TabReason: A Reinforcement Learning-Enhanced Reasoning LLM for Explainable Tabular Data Prediction
by: Xu, Tommy, et al.
Published: (2025)

Baking Symmetry into GFlowNets
by: Ma, George, et al.
Published: (2024)

Noticing the Watcher: LLM Agents Can Infer CoT Monitoring from Blocking Feedback
by: Jiralerspong, Thomas, et al.
Published: (2026)

Pretext Training Algorithms for Event Sequence Data
by: Wang, Yimu, et al.
Published: (2024)

You Need Reasoning to Learn Reasoning: The Limitations of Label-Free RL in Weak Base Models
by: Roy, Shuvendu, et al.
Published: (2025)

On Generalization for Generative Flow Networks
by: Krichel, Anas, et al.
Published: (2024)

Interventional Causal Representation Learning
by: Ahuja, Kartik, et al.
Published: (2022)

Relative Trajectory Balance is equivalent to Trust-PCL
by: Deleu, Tristan, et al.
Published: (2025)

Adaptive teachers for amortized samplers
by: Kim, Minsu, et al.
Published: (2024)

Do LLMs Benefit from User and Item Embeddings in Recommendation Tasks?
by: Hossain, Mir Rayat Imtiaz, et al.
Published: (2026)

RL, but don't do anything I wouldn't do
by: Cohen, Michael K., et al.
Published: (2024)

Local Search GFlowNets
by: Kim, Minsu, et al.
Published: (2023)

In-Context Parametric Inference: Point or Distribution Estimators?
by: Mittal, Sarthak, et al.
Published: (2025)

GFlowNet Foundations
by: Bengio, Yoshua, et al.
Published: (2021)

Discrete Probabilistic Inference as Control in Multi-path Environments
by: Deleu, Tristan, et al.
Published: (2024)

Prompting-based Temporal Domain Generalization
by: Hosseini, Sepidehsadat, et al.
Published: (2023)

A Complexity-Based Theory of Compositionality
by: Elmoznino, Eric, et al.
Published: (2024)

Bayesian learning of Causal Structure and Mechanisms with GFlowNets and Variational Bayes
by: Nishikawa-Toomey, Mizu, et al.
Published: (2022)

Meta Flow Matching: Integrating Vector Fields on the Wasserstein Manifold
by: Atanackovic, Lazar, et al.
Published: (2024)

Local Inconsistency Resolution: The Interplay between Attention and Control in Probabilistic Models
by: Richardson, Oliver E., et al.
Published: (2026)

Monte Carlo Tree Diffusion for System 2 Planning
by: Yoon, Jaesik, et al.
Published: (2025)

Shaping Inductive Bias in Diffusion Models through Frequency-Based Noise Control
by: Jiralerspong, Thomas, et al.
Published: (2025)

In-Context Reinforcement Learning through Bayesian Fusion of Context and Value Prior
by: Berkes, Anaïs, et al.
Published: (2026)

Torsional-GFN: a conditional conformation generator for small molecules
by: Volokhova, Alexandra, et al.
Published: (2025)

Learning to Scale Logits for Temperature-Conditional GFlowNets
by: Kim, Minsu, et al.
Published: (2023)

Sliding Window Recurrences for Sequence Models
by: Secrieru, Dragos, et al.
Published: (2025)

Efficient Causal Graph Discovery Using Large Language Models
by: Jiralerspong, Thomas, et al.
Published: (2024)

Delayed Attention Training Improves Length Generalization in Transformer--RNN Hybrids
by: Phan, Buu, et al.
Published: (2025)

Attention Augmented GNN RNN-Attention Models for Advanced Cybersecurity Intrusion Detection
by: Biradar, Jayant, et al.
Published: (2025)

FALCON: Few-step Accurate Likelihoods for Continuous Flows
by: Rehman, Danyal, et al.
Published: (2025)

Multi-Fidelity Active Learning with GFlowNets
by: Hernandez-Garcia, Alex, et al.
Published: (2023)

Distributional GFlowNets with Quantile Flows
by: Zhang, Dinghuai, et al.
Published: (2023)

Expert-Guided LLM Reasoning for Battery Discovery: From AI-Driven Hypothesis to Synthesis and Characterization
by: Liu, Shengchao, et al.
Published: (2025)

Active Attacks: Red-teaming LLMs via Adaptive Environments
by: Yun, Taeyoung, et al.
Published: (2025)

Offline Model-Based Optimization: Comprehensive Review
by: Kim, Minsu, et al.
Published: (2025)

torchgfn: A PyTorch GFlowNet library
by: Viviano, Joseph D., et al.
Published: (2023)