Copertina

Exploring the Relationship: Transformative Adaptive Activation Functions in Comparison to Other Activation Functions

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autore principale:	Kunc, Vladimír
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Neural and Evolutionary Computing I.5.1
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Three Decades of Activations: A Comprehensive Survey of 400 Activation Functions for Neural Networks
di: Kunc, Vladimír, et al.
Pubblicazione: (2024)

Timing-Based Backpropagation in Spiking Neural Networks Without Single-Spike Restrictions
di: Yamamoto, Kakei, et al.
Pubblicazione: (2022)

Theoretical Analysis of the Advantage of Deepening Neural Networks
di: Esaki, Yasushi, et al.
Pubblicazione: (2020)

Developing Convolutional Neural Networks using a Novel Lamarckian Co-Evolutionary Algorithm
di: Sharifi, Zaniar, et al.
Pubblicazione: (2024)

Expanding continual few-shot learning benchmarks to include recognition of specific instances
di: Kowadlo, Gideon, et al.
Pubblicazione: (2022)

Distal Interference: Exploring the Limits of Model-Based Continual Learning
di: van Deventer, Heinrich, et al.
Pubblicazione: (2024)

K-Way Energy Probes for Metacognition Reduce to Softmax in Discriminative Predictive Coding Networks
di: Cacioli, Jon-Paul
Pubblicazione: (2026)

Random Search as a Baseline for Sparse Neural Network Architecture Search
di: Farahani, Rezsa
Pubblicazione: (2024)

Multi-objective Genetic Programming with Multi-view Multi-level Feature for Enhanced Protein Secondary Structure Prediction
di: Qian, Yining, et al.
Pubblicazione: (2026)

Collapse or Preserve: Data-Dependent Temporal Aggregation for Spiking Neural Network Acceleration
di: Qin, Jiahao
Pubblicazione: (2026)

TabConv: Low-Computation CNN Inference via Table Lookups
di: Gupta, Neelesh, et al.
Pubblicazione: (2024)

Enhanced Protein Intrinsic Disorder Prediction Through Dual-View Multiscale Features and Multi-objective Evolutionary Algorithm
di: Wang, Shaokuan, et al.
Pubblicazione: (2026)

Neural Attention: A Novel Mechanism for Enhanced Expressive Power in Transformer Models
di: DiGiugno, Andrew, et al.
Pubblicazione: (2025)

Deep Convolutional Autoencoder for Assessment of Drive-Cycle Anomalies in Connected Vehicle Sensor Data
di: Geglio, Anthony, et al.
Pubblicazione: (2022)

Neuromorphic Parameter Estimation for Power Converter Health Monitoring Using Spiking Neural Networks
di: Baik, Hyeongmeen, et al.
Pubblicazione: (2026)

Pulse-Driven Neural Architecture: Learnable Oscillatory Dynamics for Robust Continuous-Time Sequence Processing
di: Sharma, Paras
Pubblicazione: (2026)

Asynchronous Stochastic Gradient Descent with Decoupled Backpropagation and Layer-Wise Updates
di: Fokam, Cabrel Teguemne, et al.
Pubblicazione: (2024)

Deep learning in a bilateral brain with hemispheric specialization
di: Rajagopalan, Chandramouli, et al.
Pubblicazione: (2022)

On the Convergence and Stability of Upside-Down Reinforcement Learning, Goal-Conditioned Supervised Learning, and Online Decision Transformers
di: Štrupl, Miroslav, et al.
Pubblicazione: (2025)

Isotropic Activation Functions Enable Deindividuated Neurons and Adaptive Topologies
di: Bird, George
Pubblicazione: (2026)

Self-Distillation Learning Based on Temporal-Spatial Consistency for Spiking Neural Networks
di: Zuo, Lin, et al.
Pubblicazione: (2024)

Decoding Phone Pairs from MEG Signals Across Speech Modalities
di: de Zuazo, Xabier, et al.
Pubblicazione: (2025)

Growing Cosine Unit: A Novel Oscillatory Activation Function That Can Speedup Training and Reduce Parameters in Convolutional Neural Networks
di: Noel, Mathew Mithra, et al.
Pubblicazione: (2021)

Spiking Sequence Machines and Transformers
di: Bose, Joy
Pubblicazione: (2026)

Spiking Neural Network Architecture Search: A Survey
di: Svoboda, Kama, et al.
Pubblicazione: (2025)

Vector Symbolic Architectures answer Jackendoff's challenges for cognitive neuroscience
di: Gayler, Ross W.
Pubblicazione: (2004)

Pendulum Model of Spiking Neurons
di: Bose, Joy
Pubblicazione: (2025)

Eventprop training for efficient neuromorphic applications
di: Shoesmith, Thomas, et al.
Pubblicazione: (2025)

Perforated Neural Networks for Keyword Spotting
di: Gopal, Vishy, et al.
Pubblicazione: (2026)

mlx-snn: Spiking Neural Networks on Apple Silicon via MLX
di: Qin, Jiahao
Pubblicazione: (2026)

The Hidden Linear Structure in Score-Based Models and its Application
di: Wang, Binxu, et al.
Pubblicazione: (2023)

Dissecting Larval Zebrafish Hunting using Deep Reinforcement Learning Trained RNN Agents
di: Malik, Raaghav, et al.
Pubblicazione: (2025)

Tensor Logic: The Language of AI
di: Domingos, Pedro
Pubblicazione: (2025)

Adaptive Activation Functions for Predictive Modeling with Sparse Experimental Data
di: Pourkamali-Anaraki, Farhad, et al.
Pubblicazione: (2024)

Model Input-Output Configuration Search with Embedded Feature Selection for Sensor Time-series and Image Classification
di: Hoang, Anh T., et al.
Pubblicazione: (2023)

APALU: A Trainable, Adaptive Activation Function for Deep Learning Networks
di: Subramanian, Barathi, et al.
Pubblicazione: (2024)

Statistical Analysis of the Impact of Quaternion Components in Convolutional Neural Networks
di: Altamirano-Gómez, Gerardo, et al.
Pubblicazione: (2024)

Deriving Activation Functions Using Integration
di: Huang, Allen Hao, et al.
Pubblicazione: (2024)

Scalable Nested Optimization for Deep Learning
di: Lorraine, Jonathan
Pubblicazione: (2024)

dynActivation: A Trainable Activation Family for Adaptive Nonlinearity
di: Bachmann, Alois
Pubblicazione: (2026)