Copertina

Neural Dynamics Self-Attention for Spiking Transformers

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zhang, Dehao, Guo, Fukai, Wang, Shuai, Wang, Jingya, Zhang, Jieyuan, Shan, Yimeng, Zhang, Malu, Yang, Yang, Li, Haizhou
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Neural and Evolutionary Computing Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Memory-Free and Parallel Computation for Quantized Spiking Neural Networks
di: Zhang, Dehao, et al.
Pubblicazione: (2025)

Unveiling the Spatial-temporal Effective Receptive Fields of Spiking Neural Networks
di: Zhang, Jieyuan, et al.
Pubblicazione: (2025)

Global-Local Convolution with Spiking Neural Networks for Energy-efficient Keyword Spotting
di: Wang, Shuai, et al.
Pubblicazione: (2024)

Breaking Global Self-Attention Bottlenecks in Transformer-based Spiking Neural Networks with Local Structure-Aware Self-Attention
di: Li, Lingdong, et al.
Pubblicazione: (2026)

SDTrack: A Baseline for Event-based Tracking via Spiking Neural Networks
di: Shan, Yimeng, et al.
Pubblicazione: (2025)

Dynamic Weight Adaptation in Spiking Neural Networks Inspired by Biological Homeostasis
di: Zhou, Yunduo, et al.
Pubblicazione: (2025)

Stable Spike: Dual Consistency Optimization via Bitwise AND Operations for Spiking Neural Networks
di: Ding, Yongqi, et al.
Pubblicazione: (2026)

LitE-SNN: Designing Lightweight and Efficient Spiking Neural Network through Spatial-Temporal Compressive Network Search and Joint Optimization
di: Liu, Qianhui, et al.
Pubblicazione: (2024)

ESVAE: An Efficient Spiking Variational Autoencoder with Reparameterizable Poisson Spiking Sampling
di: Zhan, Qiugang, et al.
Pubblicazione: (2023)

DA-LIF: Dual Adaptive Leaky Integrate-and-Fire Model for Deep Spiking Neural Networks
di: Zhang, Tianqing, et al.
Pubblicazione: (2025)

TS-SNN: Temporal Shift Module for Spiking Neural Networks
di: Yu, Kairong, et al.
Pubblicazione: (2025)

Optimization of Low-Latency Spiking Neural Networks Utilizing Historical Dynamics of Refractory Periods
di: Tao, Liying, et al.
Pubblicazione: (2025)

Decoding Listeners Identity: Person Identification from EEG Signals Using a Lightweight Spiking Transformer
di: Lin, Zheyuan, et al.
Pubblicazione: (2025)

Spikingformer: A Key Foundation Model for Spiking Neural Networks
di: Zhou, Chenlin, et al.
Pubblicazione: (2023)

SDSNN: A Single-Timestep Spiking Neural Network with Self-Dropping Neuron and Bayesian Optimization
di: Xu, Changqing, et al.
Pubblicazione: (2025)

Temporal Regularization Training: Unleashing the Potential of Spiking Neural Networks
di: Zhang, Boxuan, et al.
Pubblicazione: (2025)

Generalization Bounds of Spiking Neural Networks via Rademacher Complexity
di: Zhang, Shao-Qun, et al.
Pubblicazione: (2026)

CogniSNN: Enabling Neuron-Expandability, Pathway-Reusability, and Dynamic-Configurability with Random Graph Architectures in Spiking Neural Networks
di: Huang, Yongsheng, et al.
Pubblicazione: (2025)

Spiking-LEAF: A Learnable Auditory front-end for Spiking Neural Networks
di: Song, Zeyang, et al.
Pubblicazione: (2023)

Revisiting Reset Mechanisms in Spiking Neural Networks for Sequential Modeling: Specialized Discretization for Binary Activated RNN
di: Zhang, Enqi
Pubblicazione: (2025)

Learning with Spike Synchrony in Spiking Neural Networks
di: Tian, Yuchen, et al.
Pubblicazione: (2025)

SpikeZIP-TF: Conversion is All You Need for Transformer-based SNN
di: You, Kang, et al.
Pubblicazione: (2024)

Tuning Synaptic Connections instead of Weights by Genetic Algorithm in Spiking Policy Network
di: Zhang, Duzhen, et al.
Pubblicazione: (2022)

Reconstructing Spiking Neural Networks Using a Single Neuron with Autapses
di: Cai, Wuque, et al.
Pubblicazione: (2026)

Event-Driven Learning for Spiking Neural Networks
di: Wei, Wenjie, et al.
Pubblicazione: (2024)

Topological Representations of Heterogeneous Learning Dynamics of Recurrent Spiking Neural Networks
di: Chakraborty, Biswadeep, et al.
Pubblicazione: (2024)

SRAM-Based Compute-in-Memory Accelerator for Linear-decay Spiking Neural Networks
di: Shang, Hongyang, et al.
Pubblicazione: (2026)

Spike Accumulation Forwarding for Effective Training of Spiking Neural Networks
di: Saiin, Ryuji, et al.
Pubblicazione: (2023)

Ternary Spike-based Neuromorphic Signal Processing System
di: Wang, Shuai, et al.
Pubblicazione: (2024)

Towards Efficient Deep Spiking Neural Networks Construction with Spiking Activity based Pruning
di: Li, Yaxin, et al.
Pubblicazione: (2024)

SpikeFI: A Fault Injection Framework for Spiking Neural Networks
di: Spyrou, Theofilos, et al.
Pubblicazione: (2024)

Efficient Training of Spiking Neural Networks by Spike-aware Data Pruning
di: Ma, Chenxiang, et al.
Pubblicazione: (2025)

Autaptic Synaptic Circuit Enhances Spatio-temporal Predictive Learning of Spiking Neural Networks
di: Wang, Lihao, et al.
Pubblicazione: (2024)

Dynamic Spiking Framework for Graph Neural Networks
di: Yin, Nan, et al.
Pubblicazione: (2023)

Spiking Point Transformer for Point Cloud Classification
di: Wu, Peixi, et al.
Pubblicazione: (2025)

BiSpikCLM: A Spiking Language Model integrating Softmax-Free Spiking Attention and Spike-Aware Alignment Distillation
di: Guo, Sihang, et al.
Pubblicazione: (2026)

Adaptive Reorganization of Neural Pathways for Continual Learning with Spiking Neural Networks
di: Han, Bing, et al.
Pubblicazione: (2023)

What Is Next for LLMs? Next-Generation AI Computing Hardware Using Photonic Chips
di: Li, Renjie, et al.
Pubblicazione: (2025)

SPikE-SSM: A Sparse, Precise, and Efficient Spiking State Space Model for Long Sequences Learning
di: Zhong, Yan, et al.
Pubblicazione: (2024)

Agent-GWO: Collaborative Agents for Dynamic Prompt Optimization in Large Language Models
di: Wang, Xudong, et al.
Pubblicazione: (2026)