Copertina

APALU: A Trainable, Adaptive Activation Function for Deep Learning Networks

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Subramanian, Barathi, Jeyaraj, Rathinaraja, Ugli, Rakhmonov Akhrorjon Akhmadjon
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Neural and Evolutionary Computing
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Adaptive Activation Functions for Predictive Modeling with Sparse Experimental Data
di: Pourkamali-Anaraki, Farhad, et al.
Pubblicazione: (2024)

Topology-Aware Activation Functions in Neural Networks
di: Snopov, Pavel, et al.
Pubblicazione: (2025)

Activation Functions for "A Feedforward Unitary Equivariant Neural Network"
di: Ma, Pui-Wai
Pubblicazione: (2024)

ENN: A Neural Network with DCT Adaptive Activation Functions
di: Martinez-Gost, Marc, et al.
Pubblicazione: (2023)

Learnable Activation Functions in Physics-Informed Neural Networks for Solving Partial Differential Equations
di: Farea, Afrah, et al.
Pubblicazione: (2024)

Deriving Activation Functions Using Integration
di: Huang, Allen Hao, et al.
Pubblicazione: (2024)

Dynamically Weighted Momentum with Adaptive Step Sizes for Efficient Deep Network Training
di: Wang, Zhifeng, et al.
Pubblicazione: (2025)

Expanded Gating Ranges Improve Activation Functions
di: Huang, Allen Hao
Pubblicazione: (2024)

Contrast-Enhanced Gating in GRUs for Robust Low-Data Sequence Learning
di: Subramanian, Barathi, et al.
Pubblicazione: (2024)

A More Accurate Approximation of Activation Function with Few Spikes Neurons
di: Jeong, Dayena, et al.
Pubblicazione: (2024)

AONet: Attention network with optional activation for unsupervised video anomaly detection
di: Akhrorjon Akhmadjon Ugli Rakhmonov, et al.
Pubblicazione: (2024)

Exploring the Relationship: Transformative Adaptive Activation Functions in Comparison to Other Activation Functions
di: Kunc, Vladimír
Pubblicazione: (2024)

Meta-Learning Loss Functions for Deep Neural Networks
di: Raymond, Christian
Pubblicazione: (2024)

Zorro: A Flexible and Differentiable Parametric Family of Activation Functions That Extends ReLU and GELU
di: Roodschild, Matias, et al.
Pubblicazione: (2024)

Nonlinearity Enhanced Adaptive Activation Functions
di: Yevick, David
Pubblicazione: (2024)

Evolving Multi-Channel Confidence-Aware Activation Functions for Missing Data with Channel Propagation
di: Sani, Naeem Shahabi, et al.
Pubblicazione: (2026)

Rethinking Deep Learning: Non-backpropagation and Non-optimization Machine Learning Approach Using Hebbian Neural Networks
di: Itoh, Kei
Pubblicazione: (2024)

Linearly Constrained Weights: Reducing Activation Shift for Faster Training of Neural Networks
di: Kutsuna, Takuro
Pubblicazione: (2024)

Deep Pulse-Coupled Neural Networks
di: Yi, Zexiang, et al.
Pubblicazione: (2023)

Generalising E-prop to Deep Networks
di: Millidge, Beren
Pubblicazione: (2025)

Integrating Functionalities To A System Via Autoencoder Hippocampus Network
di: Luo, Siwei
Pubblicazione: (2024)

Learning to Forget: Continual Learning with Adaptive Weight Decay
di: Ramesh, Aditya A., et al.
Pubblicazione: (2026)

Frequency and Generalisation of Periodic Activation Functions in Reinforcement Learning
di: Mavor-Parker, Augustine N., et al.
Pubblicazione: (2024)

Exploiting Chaotic Dynamics as Deep Neural Networks
di: Liu, Shuhong, et al.
Pubblicazione: (2024)

Multi-Timescale Conductance Spiking Networks: A Sparse, Gradient-Trainable Framework with Rich Firing Dynamics for Enhanced Temporal Processing
di: Fulleda-Garcia, Alex, et al.
Pubblicazione: (2026)

Hysteresis Activation Function for Efficient Inference
di: Kimhi, Moshe, et al.
Pubblicazione: (2024)

Modular Duality in Deep Learning
di: Bernstein, Jeremy, et al.
Pubblicazione: (2024)

Parallel Algorithms for Exact Enumeration of Deep Neural Network Activation Regions
di: Drammis, Sabrina, et al.
Pubblicazione: (2024)

Breaking the Conventional Forward-Backward Tie in Neural Networks: Activation Functions
di: Troiano, Luigi, et al.
Pubblicazione: (2025)

Bio-Inspired Adaptive Neurons for Dynamic Weighting in Artificial Neural Networks
di: Islam, Ashhadul, et al.
Pubblicazione: (2024)

Expressivity and Approximation Properties of Deep Neural Networks with ReLU$^k$ Activation
di: He, Juncai, et al.
Pubblicazione: (2023)

Three Decades of Activations: A Comprehensive Survey of 400 Activation Functions for Neural Networks
di: Kunc, Vladimír, et al.
Pubblicazione: (2024)

Deep Learning-Based Operators for Evolutionary Algorithms
di: Shem-Tov, Eliad, et al.
Pubblicazione: (2024)

Biologically Plausible Training of Deep Neural Networks Using a Top-down Credit Assignment Network
di: Chen, Jian-Hui, et al.
Pubblicazione: (2022)

Self-Supervised Neural Architecture Search for Multimodal Deep Neural Networks
di: Suzuki, Shota, et al.
Pubblicazione: (2025)

Deep Intrinsic Surprise-Regularized Control (DISRC): A Biologically Inspired Mechanism for Efficient Deep Q-Learning in Sparse Environments
di: Kini, Yash, et al.
Pubblicazione: (2026)

Learning Symbolic Model-Agnostic Loss Functions via Meta-Learning
di: Raymond, Christian, et al.
Pubblicazione: (2022)

A Comprehensive Survey of Convolutions in Deep Learning: Applications, Challenges, and Future Trends
di: Younesi, Abolfazl, et al.
Pubblicazione: (2024)

Neuromorphic Graph Anomaly Detection via Adaptive STDP and Spiking Graph Neural Networks
di: Fofanah, Abdul Joseph, et al.
Pubblicazione: (2026)

Self-Motivated Growing Neural Network for Adaptive Architecture via Local Structural Plasticity
di: Jia, Yiyang, et al.
Pubblicazione: (2025)