Cover Image

Fourier or Wavelet bases as counterpart self-attention in spikformer for efficient visual classification

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wang, Qingyu, Zhang, Duzhen, Zhang, Tilelin, Xu, Bo
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Machine Learning Neural and Evolutionary Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

FSTA-SNN:Frequency-based Spatial-Temporal Attention Module for Spiking Neural Networks
by: Yu, Kairong, et al.
Published: (2024)

Event-based Optical Flow on Neuromorphic Processor: ANN vs. SNN Comparison based on Activation Sparsification
by: Xu, Yingfu, et al.
Published: (2024)

Enhancing SNN-based Spatio-Temporal Learning: A Benchmark Dataset and Cross-Modality Attention Model
by: Zhou, Shibo, et al.
Published: (2024)

Evolutionary Generalized Zero-Shot Learning
by: Chen, Dubing, et al.
Published: (2022)

Cauchy activation function and XNet
by: Li, Xin, et al.
Published: (2024)

Efficient Learning With Sine-Activated Low-rank Matrices
by: Ji, Yiping, et al.
Published: (2024)

Projection-based Adversarial Attack using Physics-in-the-Loop Optimization for Monocular Depth Estimation
by: Kusakabe, Takeru, et al.
Published: (2025)

Predictive Coding-based Deep Neural Network Fine-tuning for Computationally Efficient Domain Adaptation
by: Cardoni, Matteo, et al.
Published: (2025)

Variational Imbalanced Regression: Fair Uncertainty Quantification via Probabilistic Smoothing
by: Wang, Ziyan, et al.
Published: (2023)

Zero-Shot NAS via the Suppression of Local Entropy Decrease
by: Wu, Ning, et al.
Published: (2024)

A Lightweight Convolution and Vision Transformer integrated model with Multi-scale Self-attention Mechanism
by: Zhang, Yi, et al.
Published: (2025)

When Person Re-Identification Meets Event Camera: A Benchmark Dataset and An Attribute-guided Re-Identification Framework
by: Wang, Xiao, et al.
Published: (2025)

An extended asymmetric sigmoid with Perceptron (SIGTRON) for imbalanced linear classification
by: Woo, Hyenkyun
Published: (2023)

Spatio-Temporal Fuzzy-oriented Multi-Modal Meta-Learning for Fine-grained Emotion Recognition
by: Wang, Jingyao, et al.
Published: (2024)

Kuramoto Oscillatory Phase Encoding: Neuro-inspired Synchronization for Improved Learning Efficiency
by: Xiao, Mingqing, et al.
Published: (2026)

Exploring The Neural Burden In Pruned Models: An Insight Inspired By Neuroscience
by: Wang, Zeyu, et al.
Published: (2024)

Neural network interpretability with layer-wise relevance propagation: novel techniques for neuron selection and visualization
by: Bhati, Deepshikha, et al.
Published: (2024)

Covariant spatio-temporal receptive fields for spiking neural networks
by: Pedersen, Jens Egholm, et al.
Published: (2024)

Where to Bind Matters: Hebbian Fast Weights in Vision Transformers for Few-Shot Character Recognition
by: Money, Gavin, et al.
Published: (2026)

Scaling Supervised Local Learning with Augmented Auxiliary Networks
by: Ma, Chenxiang, et al.
Published: (2024)

Outlier-Aware Training for Low-Bit Quantization of Structural Re-Parameterized Networks
by: Niu, Muqun, et al.
Published: (2024)

SpikingResformer: Bridging ResNet and Vision Transformer in Spiking Neural Networks
by: Shi, Xinyu, et al.
Published: (2024)

Room Scene Discovery and Grouping in Unstructured Vacation Rental Image Collections
by: Kappagantula, Vignesh Ram Nithin, et al.
Published: (2025)

How to Train Your Metamorphic Deep Neural Network
by: Sommariva, Thomas, et al.
Published: (2025)

LTBs-KAN: Linear-Time B-splines Kolmogorov-Arnold Networks
by: Merin-Martinez, Eduardo Said, et al.
Published: (2026)

XnODR and XnIDR: Two Accurate and Fast Fully Connected Layers For Convolutional Neural Networks
by: Sun, Jian, et al.
Published: (2021)

A Multi-Branched Radial Basis Network Approach to Predicting Complex Chaotic Behaviours
by: Sinha, Aarush
Published: (2024)

A Novel Convolutional Neural Network Architecture with a Continuous Symmetry
by: Liu, Yao, et al.
Published: (2023)

Contrastive Learning and the Emergence of Attributes Associations
by: Nissani, Daniel N.
Published: (2023)

Tangma: A Tanh-Guided Activation Function with Learnable Parameters
by: Golwala, Shreel
Published: (2025)

V3H: View Variation and View Heredity for Incomplete Multi-view Clustering
by: Fang, Xiang, et al.
Published: (2020)

Next Generation Loss Function for Image Classification
by: Akhmedova, Shakhnaz, et al.
Published: (2024)

Uncertainty Quantification in Detecting Choroidal Metastases on MRI via Evolutionary Strategies
by: McRae-Posani, Bala, et al.
Published: (2024)

Poultry Farm Intelligence: An Integrated Multi-Sensor AI Platform for Enhanced Welfare and Productivity
by: Panagi, Pieris, et al.
Published: (2025)

Subspace Node Pruning
by: Offergeld, Joshua, et al.
Published: (2024)

Learning Object Semantic Similarity with Self-Supervision
by: Aubret, Arthur, et al.
Published: (2024)

Metric as Transform: Exploring beyond Affine Transform for Interpretable Neural Network
by: Sapkota, Suman
Published: (2024)

Brain-Inspired Online Adaptation for Remote Sensing with Spiking Neural Network
by: Duan, Dexin, et al.
Published: (2024)

Improving Quaternion Neural Networks with Quaternionic Activation Functions
by: Pöppelbaum, Johannes, et al.
Published: (2024)

Order of Compression: A Systematic and Optimal Sequence to Combinationally Compress CNN
by: Shen, Yingtao, et al.
Published: (2024)