Copertina

Growing Cosine Unit: A Novel Oscillatory Activation Function That Can Speedup Training and Reduce Parameters in Convolutional Neural Networks

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Noel, Mathew Mithra, L, Arunkumar, Trivedi, Advait, Dutta, Praneet
Natura:	Preprint
Pubblicazione:	2021
Soggetti:	Machine Learning Computer Vision and Pattern Recognition Neural and Evolutionary Computing I.5
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Biologically Inspired Oscillating Activation Functions Can Bridge the Performance Gap between Biological and Artificial Neurons
di: Noel, Matthew Mithra, et al.
Pubblicazione: (2021)

A Significantly Better Class of Activation Functions Than ReLU Like Activation Functions
di: Noel, Mathew Mithra, et al.
Pubblicazione: (2024)

Alternate Loss Functions for Classification and Robust Regression Can Improve the Accuracy of Artificial Neural Networks
di: Noel, Mathew Mithra, et al.
Pubblicazione: (2023)

Efficient Vectorized Backpropagation Algorithms for Training Feedforward Networks Composed of Quadratic Neurons
di: Noel, Mathew Mithra, et al.
Pubblicazione: (2023)

Parallel Spiking Unit for Efficient Training of Spiking Neural Networks
di: Li, Yang, et al.
Pubblicazione: (2024)

Linearly Constrained Weights: Reducing Activation Shift for Faster Training of Neural Networks
di: Kutsuna, Takuro
Pubblicazione: (2024)

Continuous-Time Neural Networks Can Stably Memorize Random Spike Trains
di: Aguettaz, Hugo, et al.
Pubblicazione: (2024)

Convolutional Spiking Neural Network for Image Classification
di: Kiselev, Mikhail, et al.
Pubblicazione: (2025)

Lagrange Oscillatory Neural Networks for Constraint Satisfaction and Optimization
di: Delacour, Corentin, et al.
Pubblicazione: (2025)

Scaling SNNs Trained Using Equilibrium Propagation to Convolutional Architectures
di: Lin, Jiaqi, et al.
Pubblicazione: (2024)

Combining Convolution and Delay Learning in Recurrent Spiking Neural Networks
di: Zebendo, Lúcio Folly Sanches, et al.
Pubblicazione: (2026)

SoftReMish: A Novel Activation Function for Enhanced Convolutional Neural Networks for Visual Recognition Performance
di: Gücen, Mustafa Bayram
Pubblicazione: (2025)

UDE-III: An Enhanced Unified Differential Evolution Algorithm for Constrained Optimization Problems
di: Trivedi, Anupam, et al.
Pubblicazione: (2024)

Twin Network Augmentation: A Novel Training Strategy for Improved Spiking Neural Networks and Efficient Weight Quantization
di: Deckers, Lucas, et al.
Pubblicazione: (2024)

Expand-and-Cluster: Parameter Recovery of Neural Networks
di: Martinelli, Flavio, et al.
Pubblicazione: (2023)

A Multi-operator Ensemble LSHADE with Restart and Local Search Mechanisms for Single-objective Optimization
di: Chauhan, Dikshit, et al.
Pubblicazione: (2024)

Topology-Aware Activation Functions in Neural Networks
di: Snopov, Pavel, et al.
Pubblicazione: (2025)

Convolutional Spiking Neural Networks for Detecting Anticipatory Brain Potentials Using Electroencephalogram
di: Lutes, Nathan, et al.
Pubblicazione: (2022)

SHA-CNN: Scalable Hierarchical Aware Convolutional Neural Network for Edge AI
di: Dhakad, Narendra Singh, et al.
Pubblicazione: (2024)

Deep Oscillatory Neural Network
di: Rohan, Nurani Rajagopal, et al.
Pubblicazione: (2024)

Spiking Convolutional Neural Networks for Text Classification
di: Lv, Changze, et al.
Pubblicazione: (2024)

Parallel Training in Spiking Neural Networks
di: Huang, Yanbin, et al.
Pubblicazione: (2026)

Optimizing Performance of Feedforward and Convolutional Neural Networks through Dynamic Activation Functions
di: Rane, Chinmay, et al.
Pubblicazione: (2023)

Oscillatory State-Space Models
di: Rusch, T. Konstantin, et al.
Pubblicazione: (2024)

Hebbian-Oscillatory Co-Learning
di: Hays, Hasi
Pubblicazione: (2026)

Enhancing Adaptive History Reserving by Spiking Convolutional Block Attention Module in Recurrent Neural Networks
di: Xu, Qi, et al.
Pubblicazione: (2024)

TT-SNN: Tensor Train Decomposition for Efficient Spiking Neural Network Training
di: Lee, Donghyun, et al.
Pubblicazione: (2024)

Functional Connectivity Graph Neural Networks
di: Li, Yang, et al.
Pubblicazione: (2025)

Activation Functions for "A Feedforward Unitary Equivariant Neural Network"
di: Ma, Pui-Wai
Pubblicazione: (2024)

Growing Artificial Neural Networks for Control: the Role of Neuronal Diversity
di: Nisioti, Eleni, et al.
Pubblicazione: (2024)

Cannistraci-Hebb Training on Ultra-Sparse Spiking Neural Networks
di: Hua, Yuan, et al.
Pubblicazione: (2025)

Full Integer Arithmetic Online Training for Spiking Neural Networks
di: Gomez, Ismael, et al.
Pubblicazione: (2025)

Playing Atari Space Invaders with Sparse Cosine Optimized Policy Evolution
di: O'Connor, Jim, et al.
Pubblicazione: (2025)

CosineGate: Semantic Dynamic Routing via Cosine Incompatibility in Residual Networks
di: Thota, Yogeswar Reddy
Pubblicazione: (2025)

Directly Training Temporal Spiking Neural Network with Sparse Surrogate Gradient
di: Li, Yang, et al.
Pubblicazione: (2024)

Training Deep Normalization-Free Spiking Neural Networks with Lateral Inhibition
di: Liu, Peiyu, et al.
Pubblicazione: (2025)

CADE: Cosine Annealing Differential Evolution for Spiking Neural Network
di: Jiang, Runhua, et al.
Pubblicazione: (2024)

Gated Attention Coding for Training High-performance and Efficient Spiking Neural Networks
di: Qiu, Xuerui, et al.
Pubblicazione: (2023)

Efficiently Training Time-to-First-Spike Spiking Neural Networks from Scratch
di: Che, Kaiwei, et al.
Pubblicazione: (2024)

Hybrid Temporal-8-Bit Spike Coding for Spiking Neural Network Surrogate Training
di: Nhan, Luu Trong, et al.
Pubblicazione: (2025)