Sign Gradient Descent-based Neuronal Dynamics: ANN-to-SNN Conversion Beyond ReLU Network
Fuente:
arXiv
Saved in:
| Main Authors: | Oh, Hyunseok, Lee, Youngki |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
The Geometry of ReLU Networks through the ReLU Transition Graph
by: Dhayalkar, Sahil Rajesh
Published: (2025)
by: Dhayalkar, Sahil Rajesh
Published: (2025)
On Space Folds of ReLU Neural Networks
by: Lewandowski, Michal, et al.
Published: (2025)
by: Lewandowski, Michal, et al.
Published: (2025)
ReLU-KAN: New Kolmogorov-Arnold Networks that Only Need Matrix Addition, Dot Multiplication, and ReLU
by: Qiu, Qi, et al.
Published: (2024)
by: Qiu, Qi, et al.
Published: (2024)
From Tempered to Benign Overfitting in ReLU Neural Networks
by: Kornowski, Guy, et al.
Published: (2023)
by: Kornowski, Guy, et al.
Published: (2023)
Optimal ANN-SNN Conversion with Group Neurons
by: Lv, Liuzhenghao, et al.
Published: (2024)
by: Lv, Liuzhenghao, et al.
Published: (2024)
Causal Explanations from the Geometric Properties of ReLU Neural Networks
by: Woods, Hector, et al.
Published: (2026)
by: Woods, Hector, et al.
Published: (2026)
Provable Unlearning with Gradient Ascent on Two-Layer ReLU Neural Networks
by: Melamed, Odelia, et al.
Published: (2025)
by: Melamed, Odelia, et al.
Published: (2025)
Efficient ANN-SNN Conversion with Error Compensation Learning
by: Liu, Chang, et al.
Published: (2025)
by: Liu, Chang, et al.
Published: (2025)
Towards Lossless ANN-SNN Conversion under Ultra-Low Latency with Dual-Phase Optimization
by: Wang, Ziming, et al.
Published: (2022)
by: Wang, Ziming, et al.
Published: (2022)
On the Depth of Monotone ReLU Neural Networks and ICNNs
by: Bakaev, Egor, et al.
Published: (2025)
by: Bakaev, Egor, et al.
Published: (2025)
Towards Lower Bounds on the Depth of ReLU Neural Networks
by: Hertrich, Christoph, et al.
Published: (2021)
by: Hertrich, Christoph, et al.
Published: (2021)
Zorro: A Flexible and Differentiable Parametric Family of Activation Functions That Extends ReLU and GELU
by: Roodschild, Matias, et al.
Published: (2024)
by: Roodschild, Matias, et al.
Published: (2024)
Expressivity and Approximation Properties of Deep Neural Networks with ReLU$^k$ Activation
by: He, Juncai, et al.
Published: (2023)
by: He, Juncai, et al.
Published: (2023)
Competition-based Adaptive ReLU for Deep Neural Networks
by: Chen, Junjia, et al.
Published: (2024)
by: Chen, Junjia, et al.
Published: (2024)
Deep Learning using Rectified Linear Units (ReLU)
by: Agarap, Abien Fred
Published: (2018)
by: Agarap, Abien Fred
Published: (2018)
The Computational Complexity of Counting Linear Regions in ReLU Neural Networks
by: Stargalla, Moritz, et al.
Published: (2025)
by: Stargalla, Moritz, et al.
Published: (2025)
One-Timestep is Enough: Achieving High-performance ANN-to-SNN Conversion via Scale-and-Fire Neurons
by: Chen, Qiuyang, et al.
Published: (2025)
by: Chen, Qiuyang, et al.
Published: (2025)
ReLU Neural Networks of Polynomial Size for Exact Maximum Flow Computation
by: Hertrich, Christoph, et al.
Published: (2021)
by: Hertrich, Christoph, et al.
Published: (2021)
Geometry-induced Regularization in Deep ReLU Neural Networks
by: Bona-Pellissier, Joachim, et al.
Published: (2024)
by: Bona-Pellissier, Joachim, et al.
Published: (2024)
Approximation Rates and VC-Dimension Bounds for (P)ReLU MLP Mixture of Experts
by: Kratsios, Anastasis, et al.
Published: (2024)
by: Kratsios, Anastasis, et al.
Published: (2024)
Robustness of Deep ReLU Networks to Misclassification of High-Dimensional Data
by: Kůrková, Věra
Published: (2026)
by: Kůrková, Věra
Published: (2026)
Efficient Approximation to Analytic and $L^p$ functions by Height-Augmented ReLU Networks
by: Li, ZeYu, et al.
Published: (2026)
by: Li, ZeYu, et al.
Published: (2026)
STARS: Spike Tail-Aware Relational Synthesis for ANN-to-SNN Data-Free Knowledge Distillation
by: Ye, Shuhan, et al.
Published: (2026)
by: Ye, Shuhan, et al.
Published: (2026)
Event-based Optical Flow on Neuromorphic Processor: ANN vs. SNN Comparison based on Activation Sparsification
by: Xu, Yingfu, et al.
Published: (2024)
by: Xu, Yingfu, et al.
Published: (2024)
MC-QDSNN: Quantized Deep evolutionary SNN with Multi-Dendritic Compartment Neurons for Stress Detection using Physiological Signals
by: S, Ajay B, et al.
Published: (2024)
by: S, Ajay B, et al.
Published: (2024)
Correlations Are Ruining Your Gradient Descent
by: Ahmad, Nasir
Published: (2024)
by: Ahmad, Nasir
Published: (2024)
Inference-Scale Complexity in ANN-SNN Conversion for High-Performance and Low-Power Applications
by: Bu, Tong, et al.
Published: (2024)
by: Bu, Tong, et al.
Published: (2024)
Bio-Inspired Adaptive Neurons for Dynamic Weighting in Artificial Neural Networks
by: Islam, Ashhadul, et al.
Published: (2024)
by: Islam, Ashhadul, et al.
Published: (2024)
NiSNN-A: Non-iterative Spiking Neural Networks with Attention with Application to Motor Imagery EEG Classification
by: Zhang, Chuhan, et al.
Published: (2023)
by: Zhang, Chuhan, et al.
Published: (2023)
APTx: better activation function than MISH, SWISH, and ReLU's variants used in deep learning
by: Kumar, Ravin
Published: (2022)
by: Kumar, Ravin
Published: (2022)
BrainTransformers: SNN-LLM
by: Tang, Zhengzheng, et al.
Published: (2024)
by: Tang, Zhengzheng, et al.
Published: (2024)
Density Descent for Diversity Optimization
by: Lee, David H., et al.
Published: (2023)
by: Lee, David H., et al.
Published: (2023)
Reservoir Computation with Networks of Differentiating Neuron Ring Oscillators
by: Yeung, Alexander, et al.
Published: (2025)
by: Yeung, Alexander, et al.
Published: (2025)
CHNNet: An Artificial Neural Network With Connected Hidden Neurons
by: Shahir, Rafiad Sadat, et al.
Published: (2023)
by: Shahir, Rafiad Sadat, et al.
Published: (2023)
Accelerating Hopfield Network Dynamics: Beyond Synchronous Updates and Forward Euler
by: Goemaere, Cédric, et al.
Published: (2023)
by: Goemaere, Cédric, et al.
Published: (2023)
Gradient Descent, Stochastic Optimization, and Other Tales
by: Lu, Jun
Published: (2022)
by: Lu, Jun
Published: (2022)
PASCAL: Precise and Efficient ANN- SNN Conversion using Spike Accumulation and Adaptive Layerwise Activation
by: Ramesh, Pranav, et al.
Published: (2025)
by: Ramesh, Pranav, et al.
Published: (2025)
Advancing Direct Training for Spiking Neural Networks with Circulate-Firing Neurons and Learnable Gradients
by: Zhou, Feifan, et al.
Published: (2026)
by: Zhou, Feifan, et al.
Published: (2026)
A Neural Network Training Method Based on Neuron Connection Coefficient Adjustments
by: Jiang, Kun
Published: (2025)
by: Jiang, Kun
Published: (2025)
No One-Size-Fits-All Neurons: Task-based Neurons for Artificial Neural Networks
by: Fan, Feng-Lei, et al.
Published: (2024)
by: Fan, Feng-Lei, et al.
Published: (2024)
Similar Items
-
The Geometry of ReLU Networks through the ReLU Transition Graph
by: Dhayalkar, Sahil Rajesh
Published: (2025) -
On Space Folds of ReLU Neural Networks
by: Lewandowski, Michal, et al.
Published: (2025) -
ReLU-KAN: New Kolmogorov-Arnold Networks that Only Need Matrix Addition, Dot Multiplication, and ReLU
by: Qiu, Qi, et al.
Published: (2024) -
From Tempered to Benign Overfitting in ReLU Neural Networks
by: Kornowski, Guy, et al.
Published: (2023) -
Optimal ANN-SNN Conversion with Group Neurons
by: Lv, Liuzhenghao, et al.
Published: (2024)