Spike-driven Transformer V2: Meta Spiking Neural Network Architecture Inspiring the Design of Next-generation Neuromorphic Chips
Fuente:
arXiv
Saved in:
| Main Authors: | Yao, Man, Hu, Jiakui, Hu, Tianxiang, Xu, Yifan, Zhou, Zhaokun, Tian, Yonghong, Xu, Bo, Li, Guoqi |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Spike2Former: Efficient Spiking Transformer for High-performance Image Segmentation
by: Lei, Zhenxin, et al.
Published: (2024)
by: Lei, Zhenxin, et al.
Published: (2024)
Scalable Dendritic Modeling Advances Expressive and Robust Deep Spiking Neural Networks
by: Huang, Yifan, et al.
Published: (2024)
by: Huang, Yifan, et al.
Published: (2024)
Spatial-Temporal Search for Spiking Neural Networks
by: Che, Kaiwei, et al.
Published: (2024)
by: Che, Kaiwei, et al.
Published: (2024)
Parallel Training in Spiking Neural Networks
by: Huang, Yanbin, et al.
Published: (2026)
by: Huang, Yanbin, et al.
Published: (2026)
High-Performance Temporal Reversible Spiking Neural Networks with $O(L)$ Training Memory and $O(1)$ Inference Cost
by: Hu, JiaKui, et al.
Published: (2024)
by: Hu, JiaKui, et al.
Published: (2024)
Spike-driven Large Language Model
by: Xu, Han, et al.
Published: (2026)
by: Xu, Han, et al.
Published: (2026)
SpikeVoice: High-Quality Text-to-Speech Via Efficient Spiking Neural Network
by: Wang, Kexin, et al.
Published: (2024)
by: Wang, Kexin, et al.
Published: (2024)
Multiplication-Free Parallelizable Spiking Neurons with Efficient Spatio-Temporal Dynamics
by: Xue, Peng, et al.
Published: (2025)
by: Xue, Peng, et al.
Published: (2025)
Efficiently Training Time-to-First-Spike Spiking Neural Networks from Scratch
by: Che, Kaiwei, et al.
Published: (2024)
by: Che, Kaiwei, et al.
Published: (2024)
SpikeAtConv: An Integrated Spiking-Convolutional Attention Architecture for Energy-Efficient Neuromorphic Vision Processing
by: Liao, Wangdan, et al.
Published: (2024)
by: Liao, Wangdan, et al.
Published: (2024)
SpikePool: Event-driven Spiking Transformer with Pooling Attention
by: Lee, Donghyun, et al.
Published: (2025)
by: Lee, Donghyun, et al.
Published: (2025)
Winner-Take-All Spiking Transformer for Language Modeling
by: Zhou, Chenlin, et al.
Published: (2026)
by: Zhou, Chenlin, et al.
Published: (2026)
Direct Training High-Performance Deep Spiking Neural Networks: A Review of Theories and Methods
by: Zhou, Chenlin, et al.
Published: (2024)
by: Zhou, Chenlin, et al.
Published: (2024)
Spiking Wavelet Transformer
by: Fang, Yuetong, et al.
Published: (2024)
by: Fang, Yuetong, et al.
Published: (2024)
Spikingformer: A Key Foundation Model for Spiking Neural Networks
by: Zhou, Chenlin, et al.
Published: (2023)
by: Zhou, Chenlin, et al.
Published: (2023)
SpikeMLLM: Spike-based Multimodal Large Language Models via Modality-Specific Temporal Scales and Temporal Compression
by: Xu, Han, et al.
Published: (2026)
by: Xu, Han, et al.
Published: (2026)
Spiking and Event-driven Neuromorphic Mamba Models for Efficient Speech Recognition
by: Ahmed, Tauseef, et al.
Published: (2026)
by: Ahmed, Tauseef, et al.
Published: (2026)
Parallel Spiking Neurons with High Efficiency and Ability to Learn Long-term Dependencies
by: Fang, Wei, et al.
Published: (2023)
by: Fang, Wei, et al.
Published: (2023)
STEMNIST: Spiking Tactile Extended MNIST Neuromorphic Dataset
by: Tripathi, Anubhab, et al.
Published: (2026)
by: Tripathi, Anubhab, et al.
Published: (2026)
Maximizing Information in Neuron Populations for Neuromorphic Spike Encoding
by: Ferdaoussi, Ahmad El, et al.
Published: (2024)
by: Ferdaoussi, Ahmad El, et al.
Published: (2024)
Adaptive Spiking Neurons for Vision and Language Modeling
by: Zhou, Chenlin, et al.
Published: (2026)
by: Zhou, Chenlin, et al.
Published: (2026)
QKFormer: Hierarchical Spiking Transformer using Q-K Attention
by: Zhou, Chenlin, et al.
Published: (2024)
by: Zhou, Chenlin, et al.
Published: (2024)
Noisy Spiking Actor Network for Exploration
by: Chen, Ding, et al.
Published: (2024)
by: Chen, Ding, et al.
Published: (2024)
A Self-Ensemble Inspired Approach for Effective Training of Binary-Weight Spiking Neural Networks
by: Meng, Qingyan, et al.
Published: (2025)
by: Meng, Qingyan, et al.
Published: (2025)
SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networks
by: Zhu, Rui-Jie, et al.
Published: (2023)
by: Zhu, Rui-Jie, et al.
Published: (2023)
Neuromorphic Spiking Neural Network Based Classification of COVID-19 Spike Sequences
by: Murad, Taslim, et al.
Published: (2024)
by: Murad, Taslim, et al.
Published: (2024)
PredNext: Explicit Cross-View Temporal Prediction for Unsupervised Learning in Spiking Neural Networks
by: Dong, Yiting, et al.
Published: (2025)
by: Dong, Yiting, et al.
Published: (2025)
Gated Attention Coding for Training High-performance and Efficient Spiking Neural Networks
by: Qiu, Xuerui, et al.
Published: (2023)
by: Qiu, Xuerui, et al.
Published: (2023)
The Potential of Combined Learning Strategies to Enhance Energy Efficiency of Spiking Neuromorphic Systems
by: Sichani, Ali Shiri, et al.
Published: (2024)
by: Sichani, Ali Shiri, et al.
Published: (2024)
Spiking Transformer with Spatial-Temporal Attention
by: Lee, Donghyun, et al.
Published: (2024)
by: Lee, Donghyun, et al.
Published: (2024)
Bishop: Sparsified Bundling Spiking Transformers on Heterogeneous Cores with Error-Constrained Pruning
by: Xu, Boxun, et al.
Published: (2025)
by: Xu, Boxun, et al.
Published: (2025)
SpikeLM: Towards General Spike-Driven Language Modeling via Elastic Bi-Spiking Mechanisms
by: Xing, Xingrun, et al.
Published: (2024)
by: Xing, Xingrun, et al.
Published: (2024)
Combining Aggregated Attention and Transformer Architecture for Accurate and Efficient Performance of Spiking Neural Networks
by: Zhang, Hangming, et al.
Published: (2024)
by: Zhang, Hangming, et al.
Published: (2024)
NeuromorphicRx: From Neural to Spiking Receiver
by: Gupta, Ankit, et al.
Published: (2025)
by: Gupta, Ankit, et al.
Published: (2025)
SpikeLLM: Scaling up Spiking Neural Network to Large Language Models via Saliency-based Spiking
by: Xing, Xingrun, et al.
Published: (2024)
by: Xing, Xingrun, et al.
Published: (2024)
Core Placement Optimization of Many-core Brain-Inspired Near-Storage Systems for Spiking Neural Network Training
by: Zhu, Xueke, et al.
Published: (2024)
by: Zhu, Xueke, et al.
Published: (2024)
Neuromorphic Circuits with Spiking Astrocytes for Increased Energy Efficiency, Fault Tolerance, and Memory Capacitance
by: Yunusoglu, Aybars, et al.
Published: (2025)
by: Yunusoglu, Aybars, et al.
Published: (2025)
Biologically Inspired Spiking Diffusion Model with Adaptive Lateral Selection Mechanism
by: Feng, Linghao, et al.
Published: (2025)
by: Feng, Linghao, et al.
Published: (2025)
UniSpike: Accelerating Spiking Neural Networks on Neuromorphic Systems via Eliminating Address Redundancy
by: Xing, Qinghui, et al.
Published: (2026)
by: Xing, Qinghui, et al.
Published: (2026)
Toward Relative Positional Encoding in Spiking Transformers
by: Lv, Changze, et al.
Published: (2025)
by: Lv, Changze, et al.
Published: (2025)
Similar Items
-
Spike2Former: Efficient Spiking Transformer for High-performance Image Segmentation
by: Lei, Zhenxin, et al.
Published: (2024) -
Scalable Dendritic Modeling Advances Expressive and Robust Deep Spiking Neural Networks
by: Huang, Yifan, et al.
Published: (2024) -
Spatial-Temporal Search for Spiking Neural Networks
by: Che, Kaiwei, et al.
Published: (2024) -
Parallel Training in Spiking Neural Networks
by: Huang, Yanbin, et al.
Published: (2026) -
High-Performance Temporal Reversible Spiking Neural Networks with $O(L)$ Training Memory and $O(1)$ Inference Cost
by: Hu, JiaKui, et al.
Published: (2024)