Competition-based Adaptive ReLU for Deep Neural Networks
Fuente:
arXiv
Saved in:
| Main Authors: | Chen, Junjia, Pan, Zhibin |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
On Space Folds of ReLU Neural Networks
by: Lewandowski, Michal, et al.
Published: (2025)
by: Lewandowski, Michal, et al.
Published: (2025)
The Geometry of ReLU Networks through the ReLU Transition Graph
by: Dhayalkar, Sahil Rajesh
Published: (2025)
by: Dhayalkar, Sahil Rajesh
Published: (2025)
From Tempered to Benign Overfitting in ReLU Neural Networks
by: Kornowski, Guy, et al.
Published: (2023)
by: Kornowski, Guy, et al.
Published: (2023)
ReLU-KAN: New Kolmogorov-Arnold Networks that Only Need Matrix Addition, Dot Multiplication, and ReLU
by: Qiu, Qi, et al.
Published: (2024)
by: Qiu, Qi, et al.
Published: (2024)
Causal Explanations from the Geometric Properties of ReLU Neural Networks
by: Woods, Hector, et al.
Published: (2026)
by: Woods, Hector, et al.
Published: (2026)
Expressivity and Approximation Properties of Deep Neural Networks with ReLU$^k$ Activation
by: He, Juncai, et al.
Published: (2023)
by: He, Juncai, et al.
Published: (2023)
On the Depth of Monotone ReLU Neural Networks and ICNNs
by: Bakaev, Egor, et al.
Published: (2025)
by: Bakaev, Egor, et al.
Published: (2025)
Towards Lower Bounds on the Depth of ReLU Neural Networks
by: Hertrich, Christoph, et al.
Published: (2021)
by: Hertrich, Christoph, et al.
Published: (2021)
Geometry-induced Regularization in Deep ReLU Neural Networks
by: Bona-Pellissier, Joachim, et al.
Published: (2024)
by: Bona-Pellissier, Joachim, et al.
Published: (2024)
Provable Unlearning with Gradient Ascent on Two-Layer ReLU Neural Networks
by: Melamed, Odelia, et al.
Published: (2025)
by: Melamed, Odelia, et al.
Published: (2025)
Sign Gradient Descent-based Neuronal Dynamics: ANN-to-SNN Conversion Beyond ReLU Network
by: Oh, Hyunseok, et al.
Published: (2024)
by: Oh, Hyunseok, et al.
Published: (2024)
The Computational Complexity of Counting Linear Regions in ReLU Neural Networks
by: Stargalla, Moritz, et al.
Published: (2025)
by: Stargalla, Moritz, et al.
Published: (2025)
Deep Learning using Rectified Linear Units (ReLU)
by: Agarap, Abien Fred
Published: (2018)
by: Agarap, Abien Fred
Published: (2018)
ReLU Neural Networks of Polynomial Size for Exact Maximum Flow Computation
by: Hertrich, Christoph, et al.
Published: (2021)
by: Hertrich, Christoph, et al.
Published: (2021)
Zorro: A Flexible and Differentiable Parametric Family of Activation Functions That Extends ReLU and GELU
by: Roodschild, Matias, et al.
Published: (2024)
by: Roodschild, Matias, et al.
Published: (2024)
Robustness of Deep ReLU Networks to Misclassification of High-Dimensional Data
by: Kůrková, Věra
Published: (2026)
by: Kůrková, Věra
Published: (2026)
Sharp Lower Bounds on Interpolation by Deep ReLU Neural Networks at Irregularly Spaced Data
by: Siegel, Jonathan W.
Published: (2023)
by: Siegel, Jonathan W.
Published: (2023)
Approximation Rates and VC-Dimension Bounds for (P)ReLU MLP Mixture of Experts
by: Kratsios, Anastasis, et al.
Published: (2024)
by: Kratsios, Anastasis, et al.
Published: (2024)
Efficient Approximation to Analytic and $L^p$ functions by Height-Augmented ReLU Networks
by: Li, ZeYu, et al.
Published: (2026)
by: Li, ZeYu, et al.
Published: (2026)
Enhancing Adaptive History Reserving by Spiking Convolutional Block Attention Module in Recurrent Neural Networks
by: Xu, Qi, et al.
Published: (2024)
by: Xu, Qi, et al.
Published: (2024)
Neural Architecture Search of Time-to-First-Spike-Coded Spiking Neural Networks for Efficient Eye-based Emotion Recognition
by: Liu, Qianhui, et al.
Published: (2025)
by: Liu, Qianhui, et al.
Published: (2025)
Towards Efficient Deep Spiking Neural Networks Construction with Spiking Activity based Pruning
by: Li, Yaxin, et al.
Published: (2024)
by: Li, Yaxin, et al.
Published: (2024)
Adaptively Pruned Spiking Neural Networks for Energy-Efficient Intracortical Neural Decoding
by: Rivelli, Francesca, et al.
Published: (2025)
by: Rivelli, Francesca, et al.
Published: (2025)
CaRe-BN: Precise Moving Statistics for Stabilizing Spiking Neural Networks in Reinforcement Learning
by: Xu, Zijie, et al.
Published: (2025)
by: Xu, Zijie, et al.
Published: (2025)
Robust Stable Spiking Neural Networks
by: Ding, Jianhao, et al.
Published: (2024)
by: Ding, Jianhao, et al.
Published: (2024)
APTx: better activation function than MISH, SWISH, and ReLU's variants used in deep learning
by: Kumar, Ravin
Published: (2022)
by: Kumar, Ravin
Published: (2022)
ASRC-SNN: Adaptive Skip Recurrent Connection Spiking Neural Network
by: Xu, Shang, et al.
Published: (2025)
by: Xu, Shang, et al.
Published: (2025)
Integrating Pruning with Quantization for Efficient Deep Neural Networks Compression
by: Makenali, Sara, et al.
Published: (2025)
by: Makenali, Sara, et al.
Published: (2025)
Bridging Quantized Artificial Neural Networks and Neuromorphic Hardware
by: Chen, Zhenhui, et al.
Published: (2025)
by: Chen, Zhenhui, et al.
Published: (2025)
Adaptive Reorganization of Neural Pathways for Continual Learning with Spiking Neural Networks
by: Han, Bing, et al.
Published: (2023)
by: Han, Bing, et al.
Published: (2023)
MorphSNN: Adaptive Graph Diffusion and Structural Plasticity for Spiking Neural Networks
by: Huang, Yongsheng, et al.
Published: (2026)
by: Huang, Yongsheng, et al.
Published: (2026)
Adaptive Gradient Learning for Spiking Neural Networks by Exploiting Membrane Potential Dynamics
by: Jiang, Jiaqiang, et al.
Published: (2025)
by: Jiang, Jiaqiang, et al.
Published: (2025)
Stitching for Neuroevolution: Recombining Deep Neural Networks without Breaking Them
by: Guijt, Arthur, et al.
Published: (2024)
by: Guijt, Arthur, et al.
Published: (2024)
Evaluating Deep Neural Networks in Deployment (A Comparative and Replicability Study)
by: Pinconschi, Eduard, et al.
Published: (2024)
by: Pinconschi, Eduard, et al.
Published: (2024)
Training Deep Normalization-Free Spiking Neural Networks with Lateral Inhibition
by: Liu, Peiyu, et al.
Published: (2025)
by: Liu, Peiyu, et al.
Published: (2025)
Coal Mine Safety Alert System: Refining BP Neural Network with Genetic Algorithm Optimization
by: Luo, Jiabin, et al.
Published: (2024)
by: Luo, Jiabin, et al.
Published: (2024)
Parallel Training in Spiking Neural Networks
by: Huang, Yanbin, et al.
Published: (2026)
by: Huang, Yanbin, et al.
Published: (2026)
TDSNNs: Competitive Topographic Deep Spiking Neural Networks for Visual Cortex Modeling
by: Zhou, Deming, et al.
Published: (2025)
by: Zhou, Deming, et al.
Published: (2025)
Spiking Neural Networks for Temporal Processing: Status Quo and Future Prospects
by: Ma, Chenxiang, et al.
Published: (2025)
by: Ma, Chenxiang, et al.
Published: (2025)
An Adaptive Re-evaluation Method for Evolution Strategy under Additive Noise
by: Dinu, Catalin-Viorel, et al.
Published: (2024)
by: Dinu, Catalin-Viorel, et al.
Published: (2024)
Similar Items
-
On Space Folds of ReLU Neural Networks
by: Lewandowski, Michal, et al.
Published: (2025) -
The Geometry of ReLU Networks through the ReLU Transition Graph
by: Dhayalkar, Sahil Rajesh
Published: (2025) -
From Tempered to Benign Overfitting in ReLU Neural Networks
by: Kornowski, Guy, et al.
Published: (2023) -
ReLU-KAN: New Kolmogorov-Arnold Networks that Only Need Matrix Addition, Dot Multiplication, and ReLU
by: Qiu, Qi, et al.
Published: (2024) -
Causal Explanations from the Geometric Properties of ReLU Neural Networks
by: Woods, Hector, et al.
Published: (2026)