Cover Image

Detecting Invariant Manifolds in ReLU-Based RNNs

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Eisenmann, Lukas, Brändle, Alena, Monfared, Zahra, Durstewitz, Daniel
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence Dynamical Systems
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Almost-Linear RNNs Yield Highly Interpretable Symbolic Codes in Dynamical Systems Reconstruction
by: Brenner, Manuel, et al.
Published: (2024)

Out-of-Domain Generalization in Dynamical Systems Reconstruction
by: Göring, Niclas, et al.
Published: (2024)

Position: Why a Dynamical Systems Perspective is Needed to Advance Time Series Modeling
by: Durstewitz, Daniel, et al.
Published: (2026)

A scalable generative model for dynamical system reconstruction from neuroimaging data
by: Volkmann, Eric, et al.
Published: (2024)

True Zero-Shot Inference of Dynamical Systems Preserving Long-Term Statistics
by: Hemmer, Christoph Jürgen, et al.
Published: (2025)

Optimal Recurrent Network Topologies for Dynamical Systems Reconstruction
by: Hemmer, Christoph Jürgen, et al.
Published: (2024)

Continuous-Time Piecewise-Linear Recurrent Neural Networks
by: Brändle, Alena, et al.
Published: (2026)

Learning Interpretable Hierarchical Dynamical Systems Models from Time Series Data
by: Brenner, Manuel, et al.
Published: (2024)

N-ReLU: Zero-Mean Stochastic Extension of ReLU
by: Manik, Md Motaleb Hossen, et al.
Published: (2025)

The Resurrection of the ReLU
by: Horuz, Coşku Can, et al.
Published: (2025)

Optimal Initialization in Depth: Lyapunov Initialization and Limit Theorems for Deep Leaky ReLU Networks
by: Kogler, Constantin, et al.
Published: (2026)

Nonlinear Dynamics In Optimization Landscape of Shallow Neural Networks with Tunable Leaky ReLU
by: Liu, Jingzhou
Published: (2025)

The Geometry of ReLU Networks through the ReLU Transition Graph
by: Dhayalkar, Sahil Rajesh
Published: (2025)

Manifold Trajectories in Next-Token Prediction: From Replicator Dynamics to Softmax Equilibrium
by: Lee-Jenkins, Christopher R.
Published: (2025)

Teacher Forcing as Generalized Bayes: Optimization Geometry Mismatch in Switching Surrogates for Chaotic Dynamics
by: Herz, Andre, et al.
Published: (2026)

Pathwise Explanation of ReLU Neural Networks
by: Lim, Seongwoo, et al.
Published: (2025)

RePO: Understanding Preference Learning Through ReLU-Based Optimization
by: Wu, Junkang, et al.
Published: (2025)

Equivariant Manifold Neural ODEs and Differential Invariants
by: Andersdotter, Emma, et al.
Published: (2024)

Integrating Multimodal Data for Joint Generative Modeling of Complex Dynamics
by: Brenner, Manuel, et al.
Published: (2022)

Is ReLU Adversarially Robust?
by: Sooksatra, Korn, et al.
Published: (2024)

Three Quantization Regimes for ReLU Networks
by: Ou, Weigutian, et al.
Published: (2024)

Activation-Descent Regularization for Input Optimization of ReLU Networks
by: Yu, Hongzhan, et al.
Published: (2024)

Planning Neural Dynamics with Lie Group Embedding through Supervised Projective Manifold Learning
by: Wang, Tianwei, et al.
Published: (2026)

Relating Piecewise Linear Kolmogorov Arnold Networks to ReLU Networks
by: Schoots, Nandi, et al.
Published: (2025)

Beyond ReLU: Chebyshev-DQN for Enhanced Deep Q-Networks
by: Yazdannik, Saman, et al.
Published: (2025)

Precise Verification of Transformers through ReLU-Catalyzed Abstraction Refinement
by: Liu, Hengjie, et al.
Published: (2026)

Benign Overfitting for Regression with Trained Two-Layer ReLU Networks
by: Park, Junhyung, et al.
Published: (2024)

Uncovering Layer-Dependent Activation Sparsity Patterns in ReLU Transformers
by: Wild, Cody, et al.
Published: (2024)

ReLU Networks for Exact Generation of Similar Graphs
by: Ghafoor, Mamoona, et al.
Published: (2026)

Stable Minima Cannot Overfit in Univariate ReLU Networks: Generalization by Large Step Sizes
by: Qiao, Dan, et al.
Published: (2024)

Unveiling the Training Dynamics of ReLU Networks through a Linear Lens
by: Ye, Longqing
Published: (2025)

Sufficient Conditions for Stability of Minimum-Norm Interpolating Deep ReLU Networks
by: Harzli, Ouns El, et al.
Published: (2026)

Expressive Power of ReLU and Step Networks under Floating-Point Operations
by: Park, Yeachan, et al.
Published: (2024)

ReLU$^2$ Wins: Discovering Efficient Activation Functions for Sparse LLMs
by: Zhang, Zhengyan, et al.
Published: (2024)

ReLU's Revival: On the Entropic Overload in Normalization-Free Large Language Models
by: Jha, Nandan Kumar, et al.
Published: (2024)

Convergence of Shallow ReLU Networks on Weakly Interacting Data
by: Dana, Léo, et al.
Published: (2025)

Hybrid Energy-Based Models for Physical AI: Provably Stable Identification of Port-Hamiltonian Dynamics
by: Betteti, Simone, et al.
Published: (2026)

The Cost of Robustness: Tighter Bounds on Parameter Complexity for Robust Memorization in ReLU Nets
by: Kim, Yujun, et al.
Published: (2025)

$λ$-GELU: Learning Gating Hardness for Controlled ReLU-ization in Deep Networks
by: Pérez-Corral, Cristian, et al.
Published: (2026)

On the algebra of Koopman eigenfunctions and on some of their infinities
by: Monfared, Zahra, et al.
Published: (2026)