Imagen de Portada

ReCA: A Parametric ReLU Composite Activation Function

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Chidiac, John, Azar, Danielle
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Discrete Functional Geometry of ReLU Networks via ReLU Transition Graphs
por: Dhayalkar, Sahil Rajesh
Publicado: (2025)

Zorro: A Flexible and Differentiable Parametric Family of Activation Functions That Extends ReLU and GELU
por: Roodschild, Matias, et al.
Publicado: (2024)

N-ReLU: Zero-Mean Stochastic Extension of ReLU
por: Manik, Md Motaleb Hossen, et al.
Publicado: (2025)

Brownian ReLU(Br-ReLU): A New Activation Function for a Long-Short Term Memory (LSTM) Network
por: Awiakye-Marfo, George, et al.
Publicado: (2026)

Deep Network Approximation: Beyond ReLU to Diverse Activation Functions
por: Zhang, Shijun, et al.
Publicado: (2023)

The Resurrection of the ReLU
por: Horuz, Coşku Can, et al.
Publicado: (2025)

The Geometry of ReLU Networks through the ReLU Transition Graph
por: Dhayalkar, Sahil Rajesh
Publicado: (2025)

ReLU$^2$ Wins: Discovering Efficient Activation Functions for Sparse LLMs
por: Zhang, Zhengyan, et al.
Publicado: (2024)

Activation-Descent Regularization for Input Optimization of ReLU Networks
por: Yu, Hongzhan, et al.
Publicado: (2024)

Neural Characteristic Activation Analysis and Geometric Parameterization for ReLU Networks
por: Chen, Wenlin, et al.
Publicado: (2023)

ReLU Networks as Random Functions: Their Distribution in Probability Space
por: Chaudhari, Shreyas, et al.
Publicado: (2025)

Complexity of One-Dimensional ReLU DNNs
por: Kogan, Jonathan, et al.
Publicado: (2025)

Symmetric Matrix Completion with ReLU Sampling
por: Liu, Huikang, et al.
Publicado: (2024)

Is ReLU Adversarially Robust?
por: Sooksatra, Korn, et al.
Publicado: (2024)

Uncovering Layer-Dependent Activation Sparsity Patterns in ReLU Transformers
por: Wild, Cody, et al.
Publicado: (2024)

SurvReLU: Inherently Interpretable Survival Analysis via Deep ReLU Networks
por: Sun, Xiaotong, et al.
Publicado: (2024)

The Effects of Multi-Task Learning on ReLU Neural Network Functions
por: Nakhleh, Julia, et al.
Publicado: (2024)

Topological Signatures of ReLU Neural Network Activation Patterns
por: Bosca, Vicente, et al.
Publicado: (2025)

Agnostic Learning of Arbitrary ReLU Activation under Gaussian Marginals
por: Guo, Anxin, et al.
Publicado: (2024)

Agnostic Learning of General ReLU Activation Using Gradient Descent
por: Awasthi, Pranjal, et al.
Publicado: (2022)

A Significantly Better Class of Activation Functions Than ReLU Like Activation Functions
por: Noel, Mathew Mithra, et al.
Publicado: (2024)

ReLU-KAN: New Kolmogorov-Arnold Networks that Only Need Matrix Addition, Dot Multiplication, and ReLU
por: Qiu, Qi, et al.
Publicado: (2024)

Constraining the outputs of ReLU neural networks
por: Alexandr, Yulia, et al.
Publicado: (2025)

Toric geometry of ReLU neural networks
por: Fu, Yaoying
Publicado: (2025)

Pathwise Explanation of ReLU Neural Networks
por: Lim, Seongwoo, et al.
Publicado: (2025)

Nearly Optimal Differentially Private ReLU Regression
por: Ding, Meng, et al.
Publicado: (2025)

Convexity in ReLU Neural Networks: beyond ICNNs?
por: Gagneux, Anne, et al.
Publicado: (2025)

Optimal Sets and Solution Paths of ReLU Networks
por: Mishkin, Aaron, et al.
Publicado: (2023)

On Size-Independent Sample Complexity of ReLU Networks
por: Sellke, Mark
Publicado: (2023)

Online Realizable Regression and Applications for ReLU Networks
por: Doron-Arad, Ilan, et al.
Publicado: (2026)

Injectivity capacity of ReLU gates
por: Stojnic, Mihailo
Publicado: (2024)

ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing
por: Wang, Ziteng, et al.
Publicado: (2024)

Beyond ReLU: How Activations Affect Neural Kernels and Random Wide Networks
por: Holzmüller, David, et al.
Publicado: (2025)

On Space Folds of ReLU Neural Networks
por: Lewandowski, Michal, et al.
Publicado: (2025)

Stochastic Bandits with ReLU Neural Networks
por: Xu, Kan, et al.
Publicado: (2024)

Some Super-approximation Rates of ReLU Neural Networks for Korobov Functions
por: Li, Yuwen, et al.
Publicado: (2025)

ReLU integral probability metric and its applications
por: Park, Yuha, et al.
Publicado: (2025)

Stably unactivated neurons in ReLU neural networks
por: Brownlowe, Natalie, et al.
Publicado: (2024)

Topological Expressivity of ReLU Neural Networks
por: Ergen, Ekin, et al.
Publicado: (2023)

Three Quantization Regimes for ReLU Networks
por: Ou, Weigutian, et al.
Publicado: (2024)