Copertina

Beyond ReLU: How Activations Affect Neural Kernels and Random Wide Networks

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Holzmüller, David, Schölpple, Max
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Deep Network Approximation: Beyond ReLU to Diverse Activation Functions
di: Zhang, Shijun, et al.
Pubblicazione: (2023)

How Does the ReLU Activation Affect the Implicit Bias of Gradient Descent on High-dimensional Neural Network Regression?
di: Lai, Kuo-Wei, et al.
Pubblicazione: (2026)

Random ReLU Neural Networks as Non-Gaussian Processes
di: Parhi, Rahul, et al.
Pubblicazione: (2024)

Neural Tangent Kernels and Fisher Information Matrices for Simple ReLU Networks with Random Hidden Weights
di: Takeuchi, Jun'ichi, et al.
Pubblicazione: (2025)

Neural Characteristic Activation Analysis and Geometric Parameterization for ReLU Networks
di: Chen, Wenlin, et al.
Pubblicazione: (2023)

Better NTK Conditioning: A Free Lunch from (ReLU) Nonlinear Activation in Wide Neural Networks
di: Liu, Chaoyue, et al.
Pubblicazione: (2023)

Topological Signatures of ReLU Neural Network Activation Patterns
di: Bosca, Vicente, et al.
Pubblicazione: (2025)

Discrete Functional Geometry of ReLU Networks via ReLU Transition Graphs
di: Dhayalkar, Sahil Rajesh
Pubblicazione: (2025)

Pathwise Explanation of ReLU Neural Networks
di: Lim, Seongwoo, et al.
Pubblicazione: (2025)

Convexity in ReLU Neural Networks: beyond ICNNs?
di: Gagneux, Anne, et al.
Pubblicazione: (2025)

On Space Folds of ReLU Neural Networks
di: Lewandowski, Michal, et al.
Pubblicazione: (2025)

Stochastic Bandits with ReLU Neural Networks
di: Xu, Kan, et al.
Pubblicazione: (2024)

ReLU Networks as Random Functions: Their Distribution in Probability Space
di: Chaudhari, Shreyas, et al.
Pubblicazione: (2025)

The Geometry of ReLU Networks through the ReLU Transition Graph
di: Dhayalkar, Sahil Rajesh
Pubblicazione: (2025)

Topological Expressivity of ReLU Neural Networks
di: Ergen, Ekin, et al.
Pubblicazione: (2023)

Activation-Descent Regularization for Input Optimization of ReLU Networks
di: Yu, Hongzhan, et al.
Pubblicazione: (2024)

Hamiltonian Monte Carlo on ReLU Neural Networks is Inefficient
di: Dinh, Vu C., et al.
Pubblicazione: (2024)

Brownian ReLU(Br-ReLU): A New Activation Function for a Long-Short Term Memory (LSTM) Network
di: Awiakye-Marfo, George, et al.
Pubblicazione: (2026)

N-ReLU: Zero-Mean Stochastic Extension of ReLU
di: Manik, Md Motaleb Hossen, et al.
Pubblicazione: (2025)

Expressivity and Approximation Properties of Deep Neural Networks with ReLU$^k$ Activation
di: He, Juncai, et al.
Pubblicazione: (2023)

ReCA: A Parametric ReLU Composite Activation Function
di: Chidiac, John, et al.
Pubblicazione: (2025)

The Resurrection of the ReLU
di: Horuz, Coşku Can, et al.
Pubblicazione: (2025)

Complexity of Injectivity and Verification of ReLU Neural Networks
di: Froese, Vincent, et al.
Pubblicazione: (2024)

On the Expressiveness of Rational ReLU Neural Networks With Bounded Depth
di: Averkov, Gennadiy, et al.
Pubblicazione: (2025)

Dense ReLU Neural Networks for Temporal-spatial Model
di: Padilla, Carlos Misael Madrid, et al.
Pubblicazione: (2024)

The Effects of Multi-Task Learning on ReLU Neural Network Functions
di: Nakhleh, Julia, et al.
Pubblicazione: (2024)

Beyond ReLU: Chebyshev-DQN for Enhanced Deep Q-Networks
di: Yazdannik, Saman, et al.
Pubblicazione: (2025)

Compelling ReLU Networks to Exhibit Exponentially Many Linear Regions at Initialization and During Training
di: Milkert, Max, et al.
Pubblicazione: (2023)

From Tempered to Benign Overfitting in ReLU Neural Networks
di: Kornowski, Guy, et al.
Pubblicazione: (2023)

On the Depth of Monotone ReLU Neural Networks and ICNNs
di: Bakaev, Egor, et al.
Pubblicazione: (2025)

Optimal Sets and Solution Paths of ReLU Networks
di: Mishkin, Aaron, et al.
Pubblicazione: (2023)

On Size-Independent Sample Complexity of ReLU Networks
di: Sellke, Mark
Pubblicazione: (2023)

Online Realizable Regression and Applications for ReLU Networks
di: Doron-Arad, Ilan, et al.
Pubblicazione: (2026)

SurvReLU: Inherently Interpretable Survival Analysis via Deep ReLU Networks
di: Sun, Xiaotong, et al.
Pubblicazione: (2024)

Optimized Weight Initialization on the Stiefel Manifold for Deep ReLU Neural Networks
di: Lee, Hyungu, et al.
Pubblicazione: (2025)

Some Super-approximation Rates of ReLU Neural Networks for Korobov Functions
di: Li, Yuwen, et al.
Pubblicazione: (2025)

Convex Formulations for Training Two-Layer ReLU Neural Networks
di: Prakhya, Karthik, et al.
Pubblicazione: (2024)

Causal Explanations from the Geometric Properties of ReLU Neural Networks
di: Woods, Hector, et al.
Pubblicazione: (2026)

ReLU-KAN: New Kolmogorov-Arnold Networks that Only Need Matrix Addition, Dot Multiplication, and ReLU
di: Qiu, Qi, et al.
Pubblicazione: (2024)

Large Deviations of Gaussian Neural Networks with ReLU activation
di: Vogel, Quirin
Pubblicazione: (2024)