Cover Image

Nonlinearity Enhanced Adaptive Activation Functions

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Yevick, David
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Computer Vision and Pattern Recognition Neural and Evolutionary Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Improving Quaternion Neural Networks with Quaternionic Activation Functions
by: Pöppelbaum, Johannes, et al.
Published: (2024)

Tangma: A Tanh-Guided Activation Function with Learnable Parameters
by: Golwala, Shreel
Published: (2025)

Efficient Learning With Sine-Activated Low-rank Matrices
by: Ji, Yiping, et al.
Published: (2024)

SWAP-NAS: Sample-Wise Activation Patterns for Ultra-fast NAS
by: Peng, Yameng, et al.
Published: (2024)

Event-based Optical Flow on Neuromorphic Processor: ANN vs. SNN Comparison based on Activation Sparsification
by: Xu, Yingfu, et al.
Published: (2024)

Next Generation Loss Function for Image Classification
by: Akhmedova, Shakhnaz, et al.
Published: (2024)

Poultry Farm Intelligence: An Integrated Multi-Sensor AI Platform for Enhanced Welfare and Productivity
by: Panagi, Pieris, et al.
Published: (2025)

Online Continual Learning via Spiking Neural Networks with Sleep Enhanced Latent Replay
by: Lin, Erliang, et al.
Published: (2025)

Enhancing SNN-based Spatio-Temporal Learning: A Benchmark Dataset and Cross-Modality Attention Model
by: Zhou, Shibo, et al.
Published: (2024)

The Bayesian Method of Tensor Networks
by: Guo, Erdong, et al.
Published: (2021)

Growing Cosine Unit: A Novel Oscillatory Activation Function That Can Speedup Training and Reduce Parameters in Convolutional Neural Networks
by: Noel, Mathew Mithra, et al.
Published: (2021)

A Significantly Better Class of Activation Functions Than ReLU Like Activation Functions
by: Noel, Mathew Mithra, et al.
Published: (2024)

Dynamic Activation with Knowledge Distillation for Energy-Efficient Spiking NN Ensembles
by: Konstantaropoulos, Orestis, et al.
Published: (2025)

Covariant spatio-temporal receptive fields for spiking neural networks
by: Pedersen, Jens Egholm, et al.
Published: (2024)

Scaling Supervised Local Learning with Augmented Auxiliary Networks
by: Ma, Chenxiang, et al.
Published: (2024)

Outlier-Aware Training for Low-Bit Quantization of Structural Re-Parameterized Networks
by: Niu, Muqun, et al.
Published: (2024)

SpikingResformer: Bridging ResNet and Vision Transformer in Spiking Neural Networks
by: Shi, Xinyu, et al.
Published: (2024)

Spatio-Temporal Fuzzy-oriented Multi-Modal Meta-Learning for Fine-grained Emotion Recognition
by: Wang, Jingyao, et al.
Published: (2024)

Fourier or Wavelet bases as counterpart self-attention in spikformer for efficient visual classification
by: Wang, Qingyu, et al.
Published: (2024)

A Multi-Branched Radial Basis Network Approach to Predicting Complex Chaotic Behaviours
by: Sinha, Aarush
Published: (2024)

Uncertainty Quantification in Detecting Choroidal Metastases on MRI via Evolutionary Strategies
by: McRae-Posani, Bala, et al.
Published: (2024)

Subspace Node Pruning
by: Offergeld, Joshua, et al.
Published: (2024)

Learning Object Semantic Similarity with Self-Supervision
by: Aubret, Arthur, et al.
Published: (2024)

Metric as Transform: Exploring beyond Affine Transform for Interpretable Neural Network
by: Sapkota, Suman
Published: (2024)

Cauchy activation function and XNet
by: Li, Xin, et al.
Published: (2024)

Brain-Inspired Online Adaptation for Remote Sensing with Spiking Neural Network
by: Duan, Dexin, et al.
Published: (2024)

Order of Compression: A Systematic and Optimal Sequence to Combinationally Compress CNN
by: Shen, Yingtao, et al.
Published: (2024)

Spikformer V2: Join the High Accuracy Club on ImageNet with an SNN Ticket
by: Zhou, Zhaokun, et al.
Published: (2024)

Defining Neural Network Architecture through Polytope Structures of Dataset
by: Lee, Sangmin, et al.
Published: (2024)

Zero-Shot NAS via the Suppression of Local Entropy Decrease
by: Wu, Ning, et al.
Published: (2024)

Exploring The Neural Burden In Pruned Models: An Insight Inspired By Neuroscience
by: Wang, Zeyu, et al.
Published: (2024)

Evaluation in Neural Style Transfer: A Review
by: Ioannou, Eleftherios, et al.
Published: (2024)

HoughToRadon Transform: New Neural Network Layer for Features Improvement in Projection Space
by: Zhabitskaya, Alexandra, et al.
Published: (2024)

Spiking CenterNet: A Distillation-boosted Spiking Neural Network for Object Detection
by: Bodden, Lennard, et al.
Published: (2024)

FSTA-SNN:Frequency-based Spatial-Temporal Attention Module for Spiking Neural Networks
by: Yu, Kairong, et al.
Published: (2024)

Deep Neural Network Models Trained With A Fixed Random Classifier Transfer Better Across Domains
by: Ali, Hafiz Tiomoko, et al.
Published: (2024)

Optimizing Feature Selection for Binary Classification with Noisy Labels: A Genetic Algorithm Approach
by: Imani, Vandad, et al.
Published: (2024)

Towards Narrowing the Generalization Gap in Deep Boolean Networks
by: Kim, Youngsung
Published: (2024)

TIM: An Efficient Temporal Interaction Module for Spiking Transformer
by: Shen, Sicheng, et al.
Published: (2024)

DenseNets Reloaded: Paradigm Shift Beyond ResNets and ViTs
by: Kim, Donghyun, et al.
Published: (2024)