Copertina

Stable and Robust Deep Learning By Hyperbolic Tangent Exponential Linear Unit (TeLU)

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Fernandez, Alfredo, Mali, Ankur
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Neural and Evolutionary Computing
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

TeLU Activation Function for Fast and Stable Deep Learning
di: Fernandez, Alfredo, et al.
Pubblicazione: (2024)

Deep Learning using Rectified Linear Units (ReLU)
di: Agarap, Abien Fred
Pubblicazione: (2018)

Neuro-mimetic Task-free Unsupervised Online Learning with Continual Self-Organizing Maps
di: Vaidya, Hitesh, et al.
Pubblicazione: (2024)

A Review of Neuroscience-Inspired Machine Learning
di: Ororbia, Alexander, et al.
Pubblicazione: (2024)

Tight Stability, Convergence, and Robustness Bounds for Predictive Coding Networks
di: Mali, Ankur, et al.
Pubblicazione: (2024)

Moderate Adaptive Linear Units (MoLU)
di: Koh, Hankyul, et al.
Pubblicazione: (2023)

ReLU-KAN: New Kolmogorov-Arnold Networks that Only Need Matrix Addition, Dot Multiplication, and ReLU
di: Qiu, Qi, et al.
Pubblicazione: (2024)

On Space Folds of ReLU Neural Networks
di: Lewandowski, Michal, et al.
Pubblicazione: (2025)

From Tempered to Benign Overfitting in ReLU Neural Networks
di: Kornowski, Guy, et al.
Pubblicazione: (2023)

Causal Explanations from the Geometric Properties of ReLU Neural Networks
di: Woods, Hector, et al.
Pubblicazione: (2026)

Zorro: A Flexible and Differentiable Parametric Family of Activation Functions That Extends ReLU and GELU
di: Roodschild, Matias, et al.
Pubblicazione: (2024)

The Geometry of ReLU Networks through the ReLU Transition Graph
di: Dhayalkar, Sahil Rajesh
Pubblicazione: (2025)

Sign Gradient Descent-based Neuronal Dynamics: ANN-to-SNN Conversion Beyond ReLU Network
di: Oh, Hyunseok, et al.
Pubblicazione: (2024)

Expressivity and Approximation Properties of Deep Neural Networks with ReLU$^k$ Activation
di: He, Juncai, et al.
Pubblicazione: (2023)

Brain-inspired Computational Intelligence via Predictive Coding
di: Salvatori, Tommaso, et al.
Pubblicazione: (2023)

On Non-Linear operators for Geometric Deep Learning
di: Sergeant-Perthuis, Grégoire, et al.
Pubblicazione: (2022)

Modular Duality in Deep Learning
di: Bernstein, Jeremy, et al.
Pubblicazione: (2024)

Deep Learning-Based Operators for Evolutionary Algorithms
di: Shem-Tov, Eliad, et al.
Pubblicazione: (2024)

Scaling Down Deep Learning with MNIST-1D
di: Greydanus, Sam, et al.
Pubblicazione: (2020)

Partial Soft-Matching Distance for Neural Representational Comparison with Partial Unit Correspondence
di: Kapoor, Chaitanya, et al.
Pubblicazione: (2026)

QuAKE: Speeding up Model Inference Using Quick and Approximate Kernels for Exponential Non-Linearities
di: Narayanaswami, Sai Kiran, et al.
Pubblicazione: (2024)

Towards Interpretable Deep Local Learning with Successive Gradient Reconciliation
di: Yang, Yibo, et al.
Pubblicazione: (2024)

Pretraining with Random Noise for Fast and Robust Learning without Weight Transport
di: Cheon, Jeonghwan, et al.
Pubblicazione: (2024)

The Computational Complexity of Counting Linear Regions in ReLU Neural Networks
di: Stargalla, Moritz, et al.
Pubblicazione: (2025)

Deep Intrinsic Surprise-Regularized Control (DISRC): A Biologically Inspired Mechanism for Efficient Deep Q-Learning in Sparse Environments
di: Kini, Yash, et al.
Pubblicazione: (2026)

APALU: A Trainable, Adaptive Activation Function for Deep Learning Networks
di: Subramanian, Barathi, et al.
Pubblicazione: (2024)

SwarmFusion: Revolutionizing Disaster Response with Swarm Intelligence and Deep Learning
di: Lankipalle, Vasavi
Pubblicazione: (2025)

Rethinking Deep Learning: Non-backpropagation and Non-optimization Machine Learning Approach Using Hebbian Neural Networks
di: Itoh, Kei
Pubblicazione: (2024)

Robustness of Deep ReLU Networks to Misclassification of High-Dimensional Data
di: Kůrková, Věra
Pubblicazione: (2026)

A Comprehensive Survey of Convolutions in Deep Learning: Applications, Challenges, and Future Trends
di: Younesi, Abolfazl, et al.
Pubblicazione: (2024)

AdaSwarm: Augmenting Gradient-Based optimizers in Deep Learning with Swarm Intelligence
di: Mohapatra, Rohan, et al.
Pubblicazione: (2020)

Surrogate Ensemble in Expensive Multi-Objective Optimization via Deep Q-Learning
di: Wu, Yuxin, et al.
Pubblicazione: (2026)

PReLU: Yet Another Single-Layer Solution to the XOR Problem
di: Pinto, Rafael C., et al.
Pubblicazione: (2024)

DDCL: Deep Dual Competitive Learning: A Differentiable End-to-End Framework for Unsupervised Prototype-Based Representation Learning
di: Cirrincione, Giansalvo
Pubblicazione: (2026)

Predicting the Stay Length of Patients in Hospitals using Convolutional Gated Recurrent Deep Learning Model
di: Neshat, Mehdi, et al.
Pubblicazione: (2024)

Towards Trustworthy Web Attack Detection: An Uncertainty-Aware Ensemble Deep Kernel Learning Model
di: Zhou, Yonghang, et al.
Pubblicazione: (2024)

MDN: Parallelizing Stepwise Momentum for Delta Linear Attention
di: Huang, Yulong, et al.
Pubblicazione: (2026)

Provable Unlearning with Gradient Ascent on Two-Layer ReLU Neural Networks
di: Melamed, Odelia, et al.
Pubblicazione: (2025)

Curriculum-Learned Vanishing Stacked Residual PINNs for Hyperbolic PDE State Reconstruction
di: Eshkofti, Katayoun, et al.
Pubblicazione: (2026)

The Deep Learning model of Higher-Lower-Order Cognition, Memory, and Affection- More General Than KAN
di: Tao, Jun-Bo, et al.
Pubblicazione: (2022)