Deep Learning using Rectified Linear Units (ReLU)
Fuente:
arXiv
Guardado en:
| Autor principal: | Agarap, Abien Fred |
|---|---|
| Formato: | Preprint |
| Publicado: |
2018
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
Mixture of Experts with Soft Nearest Neighbor Loss: Resolving Expert Collapse via Representation Disentanglement
por: Agarap, Abien Fred, et al.
Publicado: (2026)
por: Agarap, Abien Fred, et al.
Publicado: (2026)
APTx: better activation function than MISH, SWISH, and ReLU's variants used in deep learning
por: Kumar, Ravin
Publicado: (2022)
por: Kumar, Ravin
Publicado: (2022)
k-Winners-Take-All Ensemble Neural Network
por: Agarap, Abien Fred, et al.
Publicado: (2024)
por: Agarap, Abien Fred, et al.
Publicado: (2024)
A Significantly Better Class of Activation Functions Than ReLU Like Activation Functions
por: Noel, Mathew Mithra, et al.
Publicado: (2024)
por: Noel, Mathew Mithra, et al.
Publicado: (2024)
ReLU-KAN: New Kolmogorov-Arnold Networks that Only Need Matrix Addition, Dot Multiplication, and ReLU
por: Qiu, Qi, et al.
Publicado: (2024)
por: Qiu, Qi, et al.
Publicado: (2024)
Apparent Age Estimation: Challenges and Outcomes
por: Go, Justin Rainier, et al.
Publicado: (2026)
por: Go, Justin Rainier, et al.
Publicado: (2026)
The Geometry of ReLU Networks through the ReLU Transition Graph
por: Dhayalkar, Sahil Rajesh
Publicado: (2025)
por: Dhayalkar, Sahil Rajesh
Publicado: (2025)
On Space Folds of ReLU Neural Networks
por: Lewandowski, Michal, et al.
Publicado: (2025)
por: Lewandowski, Michal, et al.
Publicado: (2025)
From Tempered to Benign Overfitting in ReLU Neural Networks
por: Kornowski, Guy, et al.
Publicado: (2023)
por: Kornowski, Guy, et al.
Publicado: (2023)
Causal Explanations from the Geometric Properties of ReLU Neural Networks
por: Woods, Hector, et al.
Publicado: (2026)
por: Woods, Hector, et al.
Publicado: (2026)
Stable and Robust Deep Learning By Hyperbolic Tangent Exponential Linear Unit (TeLU)
por: Fernandez, Alfredo, et al.
Publicado: (2024)
por: Fernandez, Alfredo, et al.
Publicado: (2024)
Expressivity and Approximation Properties of Deep Neural Networks with ReLU$^k$ Activation
por: He, Juncai, et al.
Publicado: (2023)
por: He, Juncai, et al.
Publicado: (2023)
Questioning Representational Optimism in Deep Learning: The Fractured Entangled Representation Hypothesis
por: Kumar, Akarsh, et al.
Publicado: (2025)
por: Kumar, Akarsh, et al.
Publicado: (2025)
Zorro: A Flexible and Differentiable Parametric Family of Activation Functions That Extends ReLU and GELU
por: Roodschild, Matias, et al.
Publicado: (2024)
por: Roodschild, Matias, et al.
Publicado: (2024)
Outlier-Aware Training for Low-Bit Quantization of Structural Re-Parameterized Networks
por: Niu, Muqun, et al.
Publicado: (2024)
por: Niu, Muqun, et al.
Publicado: (2024)
LTBs-KAN: Linear-Time B-splines Kolmogorov-Arnold Networks
por: Merin-Martinez, Eduardo Said, et al.
Publicado: (2026)
por: Merin-Martinez, Eduardo Said, et al.
Publicado: (2026)
Physics-Guided Deep Learning for Heat Pump Stress Detection: A Comprehensive Analysis on When2Heat Dataset
por: Alam, Md Shahabub, et al.
Publicado: (2025)
por: Alam, Md Shahabub, et al.
Publicado: (2025)
Sign Gradient Descent-based Neuronal Dynamics: ANN-to-SNN Conversion Beyond ReLU Network
por: Oh, Hyunseok, et al.
Publicado: (2024)
por: Oh, Hyunseok, et al.
Publicado: (2024)
The Computational Complexity of Counting Linear Regions in ReLU Neural Networks
por: Stargalla, Moritz, et al.
Publicado: (2025)
por: Stargalla, Moritz, et al.
Publicado: (2025)
How to Train Your Metamorphic Deep Neural Network
por: Sommariva, Thomas, et al.
Publicado: (2025)
por: Sommariva, Thomas, et al.
Publicado: (2025)
Towards Narrowing the Generalization Gap in Deep Boolean Networks
por: Kim, Youngsung
Publicado: (2024)
por: Kim, Youngsung
Publicado: (2024)
Predictive Coding-based Deep Neural Network Fine-tuning for Computationally Efficient Domain Adaptation
por: Cardoni, Matteo, et al.
Publicado: (2025)
por: Cardoni, Matteo, et al.
Publicado: (2025)
On the Depth of Monotone ReLU Neural Networks and ICNNs
por: Bakaev, Egor, et al.
Publicado: (2025)
por: Bakaev, Egor, et al.
Publicado: (2025)
Deep Neural Network Models Trained With A Fixed Random Classifier Transfer Better Across Domains
por: Ali, Hafiz Tiomoko, et al.
Publicado: (2024)
por: Ali, Hafiz Tiomoko, et al.
Publicado: (2024)
Evolutionary Generalized Zero-Shot Learning
por: Chen, Dubing, et al.
Publicado: (2022)
por: Chen, Dubing, et al.
Publicado: (2022)
Contrastive Learning and the Emergence of Attributes Associations
por: Nissani, Daniel N.
Publicado: (2023)
por: Nissani, Daniel N.
Publicado: (2023)
Learning Object Semantic Similarity with Self-Supervision
por: Aubret, Arthur, et al.
Publicado: (2024)
por: Aubret, Arthur, et al.
Publicado: (2024)
Projection-based Adversarial Attack using Physics-in-the-Loop Optimization for Monocular Depth Estimation
por: Kusakabe, Takeru, et al.
Publicado: (2025)
por: Kusakabe, Takeru, et al.
Publicado: (2025)
Scaling Supervised Local Learning with Augmented Auxiliary Networks
por: Ma, Chenxiang, et al.
Publicado: (2024)
por: Ma, Chenxiang, et al.
Publicado: (2024)
Efficient Learning With Sine-Activated Low-rank Matrices
por: Ji, Yiping, et al.
Publicado: (2024)
por: Ji, Yiping, et al.
Publicado: (2024)
Provable Unlearning with Gradient Ascent on Two-Layer ReLU Neural Networks
por: Melamed, Odelia, et al.
Publicado: (2025)
por: Melamed, Odelia, et al.
Publicado: (2025)
Competition-based Adaptive ReLU for Deep Neural Networks
por: Chen, Junjia, et al.
Publicado: (2024)
por: Chen, Junjia, et al.
Publicado: (2024)
BrainMAP: Multimodal Graph Learning For Efficient Brain Disease Localization
por: Le, Nguyen Linh Dan, et al.
Publicado: (2025)
por: Le, Nguyen Linh Dan, et al.
Publicado: (2025)
Towards Lower Bounds on the Depth of ReLU Neural Networks
por: Hertrich, Christoph, et al.
Publicado: (2021)
por: Hertrich, Christoph, et al.
Publicado: (2021)
Kuramoto Oscillatory Phase Encoding: Neuro-inspired Synchronization for Improved Learning Efficiency
por: Xiao, Mingqing, et al.
Publicado: (2026)
por: Xiao, Mingqing, et al.
Publicado: (2026)
Reset It and Forget It: Relearning Last-Layer Weights Improves Continual and Transfer Learning
por: Frati, Lapo, et al.
Publicado: (2023)
por: Frati, Lapo, et al.
Publicado: (2023)
Randomly Weighted Neuromodulation in Neural Networks Facilitates Learning of Manifolds Common Across Tasks
por: Hong, Jinyung, et al.
Publicado: (2023)
por: Hong, Jinyung, et al.
Publicado: (2023)
Online Continual Learning via Spiking Neural Networks with Sleep Enhanced Latent Replay
por: Lin, Erliang, et al.
Publicado: (2025)
por: Lin, Erliang, et al.
Publicado: (2025)
Spatio-Temporal Fuzzy-oriented Multi-Modal Meta-Learning for Fine-grained Emotion Recognition
por: Wang, Jingyao, et al.
Publicado: (2024)
por: Wang, Jingyao, et al.
Publicado: (2024)
Enhancing SNN-based Spatio-Temporal Learning: A Benchmark Dataset and Cross-Modality Attention Model
por: Zhou, Shibo, et al.
Publicado: (2024)
por: Zhou, Shibo, et al.
Publicado: (2024)
Ejemplares similares
-
Mixture of Experts with Soft Nearest Neighbor Loss: Resolving Expert Collapse via Representation Disentanglement
por: Agarap, Abien Fred, et al.
Publicado: (2026) -
APTx: better activation function than MISH, SWISH, and ReLU's variants used in deep learning
por: Kumar, Ravin
Publicado: (2022) -
k-Winners-Take-All Ensemble Neural Network
por: Agarap, Abien Fred, et al.
Publicado: (2024) -
A Significantly Better Class of Activation Functions Than ReLU Like Activation Functions
por: Noel, Mathew Mithra, et al.
Publicado: (2024) -
ReLU-KAN: New Kolmogorov-Arnold Networks that Only Need Matrix Addition, Dot Multiplication, and ReLU
por: Qiu, Qi, et al.
Publicado: (2024)