Cover Image

Breaking Global Self-Attention Bottlenecks in Transformer-based Spiking Neural Networks with Local Structure-Aware Self-Attention

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Li, Lingdong, Zhang, Hangming, Yu, Qiang
Format:	Preprint
Published:	2026
Subjects:	Neural and Evolutionary Computing Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Neural Dynamics Self-Attention for Spiking Transformers
by: Zhang, Dehao, et al.
Published: (2026)

Combining Aggregated Attention and Transformer Architecture for Accurate and Efficient Performance of Spiking Neural Networks
by: Zhang, Hangming, et al.
Published: (2024)

Quantization Meets Spikes: Lossless Conversion in the First Timestep via Polarity Multi-Spike Mapping
by: Zhang, Hangming, et al.
Published: (2025)

Multi-Plasticity Synergy with Adaptive Mechanism Assignment for Training Spiking Neural Networks
by: Liu, Yuzhe, et al.
Published: (2025)

Hierarchical Self-Attention: Generalizing Neural Attention Mechanics to Multi-Scale Problems
by: Amizadeh, Saeed, et al.
Published: (2025)

SDSNN: A Single-Timestep Spiking Neural Network with Self-Dropping Neuron and Bayesian Optimization
by: Xu, Changqing, et al.
Published: (2025)

Enhancing Graph Representation Learning with Attention-Driven Spiking Neural Networks
by: Yin, Huifeng, et al.
Published: (2024)

Towards Efficient Deep Spiking Neural Networks Construction with Spiking Activity based Pruning
by: Li, Yaxin, et al.
Published: (2024)

Learning with Spike Synchrony in Spiking Neural Networks
by: Tian, Yuchen, et al.
Published: (2025)

Stable Spike: Dual Consistency Optimization via Bitwise AND Operations for Spiking Neural Networks
by: Ding, Yongqi, et al.
Published: (2026)

QKFormer: Hierarchical Spiking Transformer using Q-K Attention
by: Zhou, Chenlin, et al.
Published: (2024)

TS-SNN: Temporal Shift Module for Spiking Neural Networks
by: Yu, Kairong, et al.
Published: (2025)

TDFormer: A Top-Down Attention-Controlled Spiking Transformer
by: Zhu, Zizheng, et al.
Published: (2025)

Geometry-Aware Spiking Graph Neural Network
by: Zhang, Bowen, et al.
Published: (2025)

Spike Accumulation Forwarding for Effective Training of Spiking Neural Networks
by: Saiin, Ryuji, et al.
Published: (2023)

Spikingformer: A Key Foundation Model for Spiking Neural Networks
by: Zhou, Chenlin, et al.
Published: (2023)

Beyond Rate Coding: Surrogate Gradients Enable Spike Timing Learning in Spiking Neural Networks
by: Yu, Ziqiao, et al.
Published: (2025)

Learning in Spiking Neural Networks with a Calcium-based Hebbian Rule for Spike-timing-dependent Plasticity
by: Girão, Willian Soares, et al.
Published: (2025)

SpikeFI: A Fault Injection Framework for Spiking Neural Networks
by: Spyrou, Theofilos, et al.
Published: (2024)

Efficient Training of Spiking Neural Networks by Spike-aware Data Pruning
by: Ma, Chenxiang, et al.
Published: (2025)

DTA: Dual Temporal-channel-wise Attention for Spiking Neural Networks
by: Kim, Minje, et al.
Published: (2025)

DA-LIF: Dual Adaptive Leaky Integrate-and-Fire Model for Deep Spiking Neural Networks
by: Zhang, Tianqing, et al.
Published: (2025)

BiSpikCLM: A Spiking Language Model integrating Softmax-Free Spiking Attention and Spike-Aware Alignment Distillation
by: Guo, Sihang, et al.
Published: (2026)

Adaptive Reorganization of Neural Pathways for Continual Learning with Spiking Neural Networks
by: Han, Bing, et al.
Published: (2023)

NeuroTrain: Surveying Local Learning Rules for Spiking Neural Networks with an Open Benchmarking Framework
by: Caviglia, Alessio, et al.
Published: (2026)

Generalization Bounds of Spiking Neural Networks via Rademacher Complexity
by: Zhang, Shao-Qun, et al.
Published: (2026)

Temporal Regularization Training: Unleashing the Potential of Spiking Neural Networks
by: Zhang, Boxuan, et al.
Published: (2025)

An Introductory Review of Spiking Neural Network and Artificial Neural Network: From Biological Intelligence to Artificial Intelligence
by: Zheng, Shengjie, et al.
Published: (2022)

Parallel Hyperparameter Optimization Of Spiking Neural Network
by: Firmin, Thomas, et al.
Published: (2024)

Continual Learning with Columnar Spiking Neural Networks
by: Larionov, Denis, et al.
Published: (2025)

Spiker-LL: An Energy-Efficient FPGA Accelerator Enabling Adaptive Local Learning in Spiking Neural Networks
by: Caviglia, Alessio, et al.
Published: (2026)

SpikeExplorer: hardware-oriented Design Space Exploration for Spiking Neural Networks on FPGA
by: Padovano, Dario, et al.
Published: (2024)

Autaptic Synaptic Circuit Enhances Spatio-temporal Predictive Learning of Spiking Neural Networks
by: Wang, Lihao, et al.
Published: (2024)

Exploring the Limitations of Layer Synchronization in Spiking Neural Networks
by: Koopman, Roel, et al.
Published: (2024)

Spiking Neural Networks: The Future of Brain-Inspired Computing
by: Aribe Jr, Sales G.
Published: (2025)

Dynamic Weight Adaptation in Spiking Neural Networks Inspired by Biological Homeostasis
by: Zhou, Yunduo, et al.
Published: (2025)

SpikeNAS: A Fast Memory-Aware Neural Architecture Search Framework for Spiking Neural Network-based Embedded AI Systems
by: Putra, Rachmad Vidya Wicaksana, et al.
Published: (2024)

Attentions Under the Microscope: A Comparative Study of Resource Utilization for Variants of Self-Attention
by: Tian, Zhengyu, et al.
Published: (2025)

Towards 3D Acceleration for low-power Mixture-of-Experts and Multi-Head Attention Spiking Transformers
by: Xu, Boxun, et al.
Published: (2024)

Input-Triggered Hardware Trojan Attack on Spiking Neural Networks
by: Raptis, Spyridon, et al.
Published: (2025)