Copertina

Exploring the Promise and Limits of Real-Time Recurrent Learning

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Irie, Kazuki, Gopalakrishnan, Anand, Schmidhuber, Jürgen
Natura:	Preprint
Pubblicazione:	2023
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Metalearning Continual Learning Algorithms
di: Irie, Kazuki, et al.
Pubblicazione: (2023)

Self-Organising Neural Discrete Representation Learning à la Kohonen
di: Irie, Kazuki, et al.
Pubblicazione: (2023)

Recurrent Complex-Weighted Autoencoders for Unsupervised Object Discovery
di: Gopalakrishnan, Anand, et al.
Pubblicazione: (2024)

SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention
di: Csordás, Róbert, et al.
Pubblicazione: (2023)

Decoupling the "What" and "Where" With Polar Coordinate Positional Embeddings
di: Gopalakrishnan, Anand, et al.
Pubblicazione: (2025)

MoEUT: Mixture-of-Experts Universal Transformers
di: Csordás, Róbert, et al.
Pubblicazione: (2024)

Why Are Positional Encodings Nonessential for Deep Autoregressive Transformers? Revisiting a Petroglyph
di: Irie, Kazuki
Pubblicazione: (2024)

Learning Useful Representations of Recurrent Neural Network Weight Matrices
di: Herrmann, Vincent, et al.
Pubblicazione: (2024)

Overcoming classic challenges for artificial neural networks by providing incentives and practice
di: Irie, Kazuki, et al.
Pubblicazione: (2024)

Fast weight programming and linear transformers: from machine learning to neurobiology
di: Irie, Kazuki, et al.
Pubblicazione: (2025)

Blending Complementary Memory Systems in Hybrid Quadratic-Linear Transformers
di: Irie, Kazuki, et al.
Pubblicazione: (2025)

Learning to Forget: Continual Learning with Adaptive Weight Decay
di: Ramesh, Aditya A., et al.
Pubblicazione: (2026)

Real-Time Recurrent Reinforcement Learning
di: Lemmel, Julian, et al.
Pubblicazione: (2023)

Key-value memory in the brain
di: Gershman, Samuel J., et al.
Pubblicazione: (2025)

Streaming Reinforcement Learning under Partial Observability with Real-Time Recurrent Learning
di: Farr, Noah, et al.
Pubblicazione: (2026)

Enhancing JEPAs with Spatial Conditioning: Robust and Efficient Representation Learning
di: Littwin, Etai, et al.
Pubblicazione: (2024)

Interestingness as an Inductive Heuristic for Future Compression Progress
di: Herrmann, Vincent, et al.
Pubblicazione: (2026)

Real-Time Recurrent Learning using Trace Units in Reinforcement Learning
di: Elelimy, Esraa, et al.
Pubblicazione: (2024)

Mixture of Sparse Attention: Content-Based Learnable Sparse Attention via Expert-Choice Routing
di: Piękos, Piotr, et al.
Pubblicazione: (2025)

Why Depth Matters in Parallelizable Sequence Models: A Lie Algebraic View
di: Heo, Gyuryang, et al.
Pubblicazione: (2026)

Who invented deep residual learning?
di: Schmidhuber, Juergen
Pubblicazione: (2025)

Sequence Compression Speeds Up Credit Assignment in Reinforcement Learning
di: Ramesh, Aditya A., et al.
Pubblicazione: (2024)

Fairness Overfitting in Machine Learning: An Information-Theoretic Perspective
di: Laakom, Firas, et al.
Pubblicazione: (2025)

Measuring In-Context Computation Complexity via Hidden State Prediction
di: Herrmann, Vincent, et al.
Pubblicazione: (2025)

PULSE: Practical Evaluation Scenarios for Large Multimodal Model Unlearning
di: Kawakami, Tatsuki, et al.
Pubblicazione: (2025)

Sequential-Parallel Duality in Prefix Scannable Models
di: Yau, Morris, et al.
Pubblicazione: (2025)

Dissecting the Interplay of Attention Paths in a Statistical Mechanics Theory of Transformers
di: Tiberi, Lorenzo, et al.
Pubblicazione: (2024)

Splats under Pressure: Exploring Performance-Energy Trade-offs in Real-Time 3D Gaussian Splatting under Constrained GPU Budgets
di: Tajwar, Muhammad Fahim, et al.
Pubblicazione: (2026)

Exploring the limits of Hierarchical World Models in Reinforcement Learning
di: Schiewer, Robin, et al.
Pubblicazione: (2024)

Impact of Recurrent Neural Networks and Deep Learning Frameworks on Real-time Lightweight Time Series Anomaly Detection
di: Lee, Ming-Chang, et al.
Pubblicazione: (2024)

Time-Warping Recurrent Neural Networks for Transfer Learning
di: Hirschi, Jonathon
Pubblicazione: (2026)

Multiple Token Divergence: Measuring and Steering In-Context Computation Density
di: Herrmann, Vincent, et al.
Pubblicazione: (2025)

Efficient Neural Architectures for Real-Time ECG Interpretation on Limited Hardware
di: Mbilinyi, Ashery, et al.
Pubblicazione: (2026)

Autonomous AI-based Cybersecurity Framework for Critical Infrastructure: Real-Time Threat Mitigation
di: Paulraj, Jenifer, et al.
Pubblicazione: (2025)

FACTS: A Factored State-Space Framework For World Modelling
di: Nanbo, Li, et al.
Pubblicazione: (2024)

Highway Value Iteration Networks
di: Wang, Yuhui, et al.
Pubblicazione: (2024)

Highway Reinforcement Learning
di: Wang, Yuhui, et al.
Pubblicazione: (2024)

Curious Causality-Seeking Agents Learn Meta Causal World
di: Zhao, Zhiyu, et al.
Pubblicazione: (2025)

Fast and scalable retrosynthetic planning with a transformer neural network and speculative beam search
di: Andronov, Mikhail, et al.
Pubblicazione: (2025)

Directly Forecasting Belief for Reinforcement Learning with Delays
di: Wu, Qingyuan, et al.
Pubblicazione: (2025)