Universality of Linear Recurrences Followed by Non-linear Projections: Finite-Width Guarantees and Benefits of Complex Eigenvalues
Fuente:
arXiv
Saved in:
| Main Authors: | Orvieto, Antonio, De, Soham, Gulcehre, Caglar, Pascanu, Razvan, Smith, Samuel L. |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Recurrent Distance Filtering for Graph Representation Learning
by: Ding, Yuhui, et al.
Published: (2023)
by: Ding, Yuhui, et al.
Published: (2023)
AlphaGrad: Non-Linear Gradient Normalization Optimizer
by: Sane, Soham
Published: (2025)
by: Sane, Soham
Published: (2025)
SQUAT: Stateful Quantization-Aware Training in Recurrent Spiking Neural Networks
by: Venkatesh, Sreyes, et al.
Published: (2024)
by: Venkatesh, Sreyes, et al.
Published: (2024)
When can transformers compositionally generalize in-context?
by: Kobayashi, Seijin, et al.
Published: (2024)
by: Kobayashi, Seijin, et al.
Published: (2024)
Energy-Efficient Implementation of Spiking Recurrent Cells on FPGA
by: Harmeling, Pascal, et al.
Published: (2026)
by: Harmeling, Pascal, et al.
Published: (2026)
The First Theoretical Approximation Guarantees for the Non-Dominated Sorting Genetic Algorithm III (NSGA-III)
by: Deng, Renzhong, et al.
Published: (2025)
by: Deng, Renzhong, et al.
Published: (2025)
Discovering modular solutions that generalize compositionally
by: Schug, Simon, et al.
Published: (2023)
by: Schug, Simon, et al.
Published: (2023)
Fleet of Agents: Coordinated Problem Solving with Large Language Models
by: Klein, Lars, et al.
Published: (2024)
by: Klein, Lars, et al.
Published: (2024)
Accelerating Linear Recurrent Neural Networks for the Edge with Unstructured Sparsity
by: Pierro, Alessandro, et al.
Published: (2025)
by: Pierro, Alessandro, et al.
Published: (2025)
Recurrent Complex-Weighted Autoencoders for Unsupervised Object Discovery
by: Gopalakrishnan, Anand, et al.
Published: (2024)
by: Gopalakrishnan, Anand, et al.
Published: (2024)
Composing Recurrent Spiking Neural Networks using Locally-Recurrent Motifs and Risk-Mitigating Architectural Optimization
by: Zhang, Wenrui, et al.
Published: (2021)
by: Zhang, Wenrui, et al.
Published: (2021)
Near-Tight Runtime Guarantees for Many-Objective Evolutionary Algorithms
by: Wietheger, Simon, et al.
Published: (2024)
by: Wietheger, Simon, et al.
Published: (2024)
Improved Runtime Guarantees for the SPEA2 Multi-Objective Optimizer
by: Doerr, Benjamin, et al.
Published: (2025)
by: Doerr, Benjamin, et al.
Published: (2025)
Recurrent Neural Networks Learn to Store and Generate Sequences using Non-Linear Representations
by: Csordás, Róbert, et al.
Published: (2024)
by: Csordás, Róbert, et al.
Published: (2024)
Approximation Guarantees for the Non-Dominated Sorting Genetic Algorithm II (NSGA-II)
by: Zheng, Weijie, et al.
Published: (2022)
by: Zheng, Weijie, et al.
Published: (2022)
Proven Approximation Guarantees in Multi-Objective Optimization: SPEA2 Beats NSGA-II
by: Alghouass, Yasser, et al.
Published: (2025)
by: Alghouass, Yasser, et al.
Published: (2025)
Not Just for Archiving: Provable Benefits of Reusing the Archive in Evolutionary Multi-objective Optimization
by: Ren, Shengjie, et al.
Published: (2025)
by: Ren, Shengjie, et al.
Published: (2025)
A Quantifier-Reversal Approximation Paradigm for Recurrent Neural Networks
by: Hutter, Clemens, et al.
Published: (2025)
by: Hutter, Clemens, et al.
Published: (2025)
Combining Convolution and Delay Learning in Recurrent Spiking Neural Networks
by: Zebendo, Lúcio Folly Sanches, et al.
Published: (2026)
by: Zebendo, Lúcio Folly Sanches, et al.
Published: (2026)
Proven Runtime Guarantees for How the MOEA/D Computes the Pareto Front From the Subproblem Solutions
by: Doerr, Benjamin, et al.
Published: (2024)
by: Doerr, Benjamin, et al.
Published: (2024)
Random-Key Optimizer and Linearization for the Quadratic Multiple Constraints Variable-Sized Bin Packing Problem
by: Santos, Natalia A., et al.
Published: (2025)
by: Santos, Natalia A., et al.
Published: (2025)
ASRC-SNN: Adaptive Skip Recurrent Connection Spiking Neural Network
by: Xu, Shang, et al.
Published: (2025)
by: Xu, Shang, et al.
Published: (2025)
Complex-valued universal linear transformations and image encryption using spatially incoherent diffractive networks
by: Yang, Xilin, et al.
Published: (2023)
by: Yang, Xilin, et al.
Published: (2023)
Colony-Enhanced Recurrent Neural Architecture Search: Collaborative Ant-Based Optimization
by: Elsaid, Abdelrahman
Published: (2024)
by: Elsaid, Abdelrahman
Published: (2024)
Hidden Traveling Waves bind Working Memory Variables in Recurrent Neural Networks
by: Karuvally, Arjun, et al.
Published: (2024)
by: Karuvally, Arjun, et al.
Published: (2024)
Enhancing Adaptive History Reserving by Spiking Convolutional Block Attention Module in Recurrent Neural Networks
by: Xu, Qi, et al.
Published: (2024)
by: Xu, Qi, et al.
Published: (2024)
Vector Symbolic Finite State Machines in Attractor Neural Networks
by: Cotteret, Madison, et al.
Published: (2022)
by: Cotteret, Madison, et al.
Published: (2022)
Universality of Real Minimal Complexity Reservoir
by: Fong, Robert Simon, et al.
Published: (2024)
by: Fong, Robert Simon, et al.
Published: (2024)
Interpretable Non-linear Survival Analysis with Evolutionary Symbolic Regression
by: Rovito, Luigi, et al.
Published: (2025)
by: Rovito, Luigi, et al.
Published: (2025)
AM-PPO: (Advantage) Alpha-Modulation with Proximal Policy Optimization
by: Sane, Soham
Published: (2025)
by: Sane, Soham
Published: (2025)
Brain-inspired Computational Modeling of Action Recognition with Recurrent Spiking Neural Networks Equipped with Reinforcement Delay Learning
by: Nadafian, Alireza, et al.
Published: (2024)
by: Nadafian, Alireza, et al.
Published: (2024)
Physics-informed neural network for modeling dynamic linear elasticity
by: Kag, Vijay, et al.
Published: (2023)
by: Kag, Vijay, et al.
Published: (2023)
Optimal Synthesis of Finite State Machines with Universal Gates using Evolutionary Algorithm
by: Ullah, Noor, et al.
Published: (2024)
by: Ullah, Noor, et al.
Published: (2024)
Activity-Dependent Plasticity in Morphogenetically-Grown Recurrent Networks
by: Medvid, Sergii, et al.
Published: (2026)
by: Medvid, Sergii, et al.
Published: (2026)
Local Loss Optimization in the Infinite Width: Stable Parameterization of Predictive Coding Networks and Target Propagation
by: Ishikawa, Satoki, et al.
Published: (2024)
by: Ishikawa, Satoki, et al.
Published: (2024)
Transforming Datasets to Requested Complexity with Projection-based Many-Objective Genetic Algorithm
by: Komorniczak, Joanna
Published: (2025)
by: Komorniczak, Joanna
Published: (2025)
Recurrent Joint Embedding Predictive Architecture with Recurrent Forward Propagation Learning
by: Velarde, Osvaldo M, et al.
Published: (2024)
by: Velarde, Osvaldo M, et al.
Published: (2024)
Provable Benefits of Complex Parameterizations for Structured State Space Models
by: Ran-Milo, Yuval, et al.
Published: (2024)
by: Ran-Milo, Yuval, et al.
Published: (2024)
Non-linear PCA via Evolution Strategies: a Novel Objective Function
by: Uriot, Thomas, et al.
Published: (2026)
by: Uriot, Thomas, et al.
Published: (2026)
Analysing Rescaling, Discretization, and Linearization in RNNs for Neural System Modelling
by: Caruso, Mariano, et al.
Published: (2023)
by: Caruso, Mariano, et al.
Published: (2023)
Similar Items
-
Recurrent Distance Filtering for Graph Representation Learning
by: Ding, Yuhui, et al.
Published: (2023) -
AlphaGrad: Non-Linear Gradient Normalization Optimizer
by: Sane, Soham
Published: (2025) -
SQUAT: Stateful Quantization-Aware Training in Recurrent Spiking Neural Networks
by: Venkatesh, Sreyes, et al.
Published: (2024) -
When can transformers compositionally generalize in-context?
by: Kobayashi, Seijin, et al.
Published: (2024) -
Energy-Efficient Implementation of Spiking Recurrent Cells on FPGA
by: Harmeling, Pascal, et al.
Published: (2026)