Cover Image

The Resurrection of the ReLU

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Horuz, Coşku Can, Kasenbacher, Geoffrey, Higuchi, Saya, Kairat, Sebastian, Stoltz, Jendrik, Pesl, Moritz, Moser, Bernhard A., Linse, Christoph, Martinetz, Thomas, Otte, Sebastian
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Scalable Memristive-Friendly Reservoir Computing for Time Series Classification
by: Horuz, Coşku Can, et al.
Published: (2026)

Balanced Resonate-and-Fire Neurons
by: Higuchi, Saya, et al.
Published: (2024)

Inferring Underwater Topography with FINN
by: Horuz, Coşku Can, et al.
Published: (2024)

Minimal Convolutional RNNs Accelerate Spatiotemporal Learning
by: Horuz, Coşku Can, et al.
Published: (2025)

Leaky ReLUs That Differ in Forward and Backward Pass Facilitate Activation Maximization in Deep Neural Networks
by: Linse, Christoph, et al.
Published: (2024)

Rethinking generalization of classifiers in separable classes scenarios and over-parameterized regimes
by: Martinetz, Julius, et al.
Published: (2024)

N-ReLU: Zero-Mean Stochastic Extension of ReLU
by: Manik, Md Motaleb Hossen, et al.
Published: (2025)

On Space Folds of ReLU Neural Networks
by: Lewandowski, Michal, et al.
Published: (2025)

The Geometry of ReLU Networks through the ReLU Transition Graph
by: Dhayalkar, Sahil Rajesh
Published: (2025)

WARP-LCA: Efficient Convolutional Sparse Coding with Locally Competitive Algorithm
by: Kasenbacher, Geoffrey, et al.
Published: (2024)

Understanding the Convergence in Balanced Resonate-and-Fire Neurons
by: Higuchi, Saya, et al.
Published: (2024)

Is ReLU Adversarially Robust?
by: Sooksatra, Korn, et al.
Published: (2024)

Pathwise Explanation of ReLU Neural Networks
by: Lim, Seongwoo, et al.
Published: (2025)

Three Quantization Regimes for ReLU Networks
by: Ou, Weigutian, et al.
Published: (2024)

Convolutional Neural Networks Do Work with Pre-Defined Filters
by: Linse, Christoph, et al.
Published: (2024)

Enhancing Generalization in Convolutional Neural Networks through Regularization with Edge and Line Features
by: Linse, Christoph, et al.
Published: (2024)

ReLU Networks for Exact Generation of Similar Graphs
by: Ghafoor, Mamoona, et al.
Published: (2026)

Detecting Invariant Manifolds in ReLU-Based RNNs
by: Eisenmann, Lukas, et al.
Published: (2025)

Topological Expressivity of ReLU Neural Networks
by: Ergen, Ekin, et al.
Published: (2023)

On the existence of optimal shallow feedforward networks with ReLU activation
by: Dereich, Steffen, et al.
Published: (2023)

The Computational Complexity of Counting Linear Regions in ReLU Neural Networks
by: Stargalla, Moritz, et al.
Published: (2025)

Activation-Descent Regularization for Input Optimization of ReLU Networks
by: Yu, Hongzhan, et al.
Published: (2024)

An analysis of optimization problems involving ReLU neural networks
by: Plate, Christoph, et al.
Published: (2025)

RePO: Understanding Preference Learning Through ReLU-Based Optimization
by: Wu, Junkang, et al.
Published: (2025)

Convergence of Shallow ReLU Networks on Weakly Interacting Data
by: Dana, Léo, et al.
Published: (2025)

The Symmetries of Three-Layer ReLU Networks
by: Gegenfurtner, Johanna Marie, et al.
Published: (2026)

Precise Verification of Transformers through ReLU-Catalyzed Abstraction Refinement
by: Liu, Hengjie, et al.
Published: (2026)

Relating Piecewise Linear Kolmogorov Arnold Networks to ReLU Networks
by: Schoots, Nandi, et al.
Published: (2025)

Beyond ReLU: Chebyshev-DQN for Enhanced Deep Q-Networks
by: Yazdannik, Saman, et al.
Published: (2025)

Benign Overfitting for Regression with Trained Two-Layer ReLU Networks
by: Park, Junhyung, et al.
Published: (2024)

Uncovering Layer-Dependent Activation Sparsity Patterns in ReLU Transformers
by: Wild, Cody, et al.
Published: (2024)

Uncertainty Quantification with Bayesian Higher Order ReLU KANs
by: Giroux, James, et al.
Published: (2024)

Topological Signatures of ReLU Neural Network Activation Patterns
by: Bosca, Vicente, et al.
Published: (2025)

Deep ReLU Networks Have Surprisingly Simple Polytopes
by: Fan, Feng-Lei, et al.
Published: (2023)

Complete Identification of Deep ReLU Neural Networks by Many-Valued Logic
by: Zhang, Yani, et al.
Published: (2026)

Architecture independent generalization bounds for overparametrized deep ReLU networks
by: Bapu, Anandatheertha, et al.
Published: (2025)

Complexity of Injectivity and Verification of ReLU Neural Networks
by: Froese, Vincent, et al.
Published: (2024)

Geometry-induced Regularization in Deep ReLU Neural Networks
by: Bona-Pellissier, Joachim, et al.
Published: (2024)

On the Principles of ReLU Networks with One Hidden Layer
by: Huang, Changcun
Published: (2024)

Sufficient Conditions for Stability of Minimum-Norm Interpolating Deep ReLU Networks
by: Harzli, Ouns El, et al.
Published: (2026)