Cover Image

Deriving Activation Functions Using Integration

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Huang, Allen Hao, Schlag, Imanol
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Neural and Evolutionary Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Expanded Gating Ranges Improve Activation Functions
by: Huang, Allen Hao
Published: (2024)

Topology-Aware Activation Functions in Neural Networks
by: Snopov, Pavel, et al.
Published: (2025)

Activation Functions for "A Feedforward Unitary Equivariant Neural Network"
by: Ma, Pui-Wai
Published: (2024)

Adaptive Activation Functions for Predictive Modeling with Sparse Experimental Data
by: Pourkamali-Anaraki, Farhad, et al.
Published: (2024)

APALU: A Trainable, Adaptive Activation Function for Deep Learning Networks
by: Subramanian, Barathi, et al.
Published: (2024)

A More Accurate Approximation of Activation Function with Few Spikes Neurons
by: Jeong, Dayena, et al.
Published: (2024)

Learnable Activation Functions in Physics-Informed Neural Networks for Solving Partial Differential Equations
by: Farea, Afrah, et al.
Published: (2024)

Evolving Multi-Channel Confidence-Aware Activation Functions for Missing Data with Channel Propagation
by: Sani, Naeem Shahabi, et al.
Published: (2026)

Zorro: A Flexible and Differentiable Parametric Family of Activation Functions That Extends ReLU and GELU
by: Roodschild, Matias, et al.
Published: (2024)

Integrating Functionalities To A System Via Autoencoder Hippocampus Network
by: Luo, Siwei
Published: (2024)

Hysteresis Activation Function for Efficient Inference
by: Kimhi, Moshe, et al.
Published: (2024)

Optimizing Monotone Chance-Constrained Submodular Functions Using Evolutionary Multi-Objective Algorithms
by: Neumann, Aneta, et al.
Published: (2020)

Directly Learning Stock Trading Strategies Through Profit Guided Loss Functions
by: Kar, Devroop, et al.
Published: (2025)

ActNAS : Generating Efficient YOLO Models using Activation NAS
by: Sah, Sudhakar, et al.
Published: (2024)

Linearly Constrained Weights: Reducing Activation Shift for Faster Training of Neural Networks
by: Kutsuna, Takuro
Published: (2024)

Frequency and Generalisation of Periodic Activation Functions in Reinforcement Learning
by: Mavor-Parker, Augustine N., et al.
Published: (2024)

Exploring the Relationship: Transformative Adaptive Activation Functions in Comparison to Other Activation Functions
by: Kunc, Vladimír
Published: (2024)

Steering Large Language Models using Conceptors: Improving Addition-Based Activation Engineering
by: Postmus, Joris, et al.
Published: (2024)

GRASP: GRouped Activation Shared Parameterization for Parameter-Efficient Fine-Tuning and Robust Inference of Transformers
by: Bal, Malyaban, et al.
Published: (2025)

ENN: A Neural Network with DCT Adaptive Activation Functions
by: Martinez-Gost, Marc, et al.
Published: (2023)

Neural-Symbolic Integration with Evolvable Policies
by: Thoma, Marios, et al.
Published: (2026)

Frame Theoretical Derivation of Three Factor Learning Rule for Oja's Subspace Rule
by: Yamada, Taiki
Published: (2026)

Breaking the Conventional Forward-Backward Tie in Neural Networks: Activation Functions
by: Troiano, Luigi, et al.
Published: (2025)

Model Uncertainty in Evolutionary Optimization and Bayesian Optimization: A Comparative Analysis
by: Hao, Hao, et al.
Published: (2024)

Effective Regularization Through Loss-Function Metalearning
by: Gonzalez, Santiago, et al.
Published: (2020)

Closed-Form Test Functions for Biophysical Sequence Optimization Algorithms
by: Stanton, Samuel, et al.
Published: (2024)

Generalized Dynamic Brain Functional Connectivity Based on Random Convolutions
by: Duan, Yongjie, et al.
Published: (2024)

PlatMetaX: An Integrated MATLAB platform for Meta-Black-Box Optimization
by: Yang, Xu, et al.
Published: (2025)

Memory-Augmented Spiking Networks: Synergistic Integration of Complementary Mechanisms for Neuromorphic Vision
by: Blessing, Effiong, et al.
Published: (2026)

Learning Symbolic Model-Agnostic Loss Functions via Meta-Learning
by: Raymond, Christian, et al.
Published: (2022)

Non-linear PCA via Evolution Strategies: a Novel Objective Function
by: Uriot, Thomas, et al.
Published: (2026)

Three Decades of Activations: A Comprehensive Survey of 400 Activation Functions for Neural Networks
by: Kunc, Vladimír, et al.
Published: (2024)

Nonlinearity Enhanced Adaptive Activation Functions
by: Yevick, David
Published: (2024)

Controlling Chaos Using Edge Computing Hardware
by: Kent, Robert M., et al.
Published: (2024)

Boosting Brain-inspired Path Integration Efficiency via Learning-based Replication of Continuous Attractor Neurodynamics
by: Ge, Zhangyu, et al.
Published: (2025)

AdaptiveMDL-GenClust: A Robust Clustering Framework Integrating Normalized Mutual Information and Evolutionary Algorithms
by: Jahani, H., et al.
Published: (2024)

Temporal-Difference Learning Using Distributed Error Signals
by: Guan, Jonas, et al.
Published: (2024)

Cost Optimization in Production Line Using Genetic Algorithm
by: Rezaee, Alireza
Published: (2026)

Investigating Quantum Circuit Designs Using Neuro-Evolution
by: Kar, Devroop, et al.
Published: (2026)

Explicit and Non-asymptotic Query Complexities of Rank-Based Zeroth-order Algorithms on Smooth Functions
by: Ye, Haishan
Published: (2025)