Cover Image

Scaling Spike-driven Transformer with Efficient Spike Firing Approximation Training

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yao, Man, Qiu, Xuerui, Hu, Tianxiang, Hu, Jiakui, Chou, Yuhong, Tian, Keyu, Liao, Jianxing, Leng, Luziwei, Xu, Bo, Li, Guoqi
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Spike-driven Transformer V2: Meta Spiking Neural Network Architecture Inspiring the Design of Next-generation Neuromorphic Chips
by: Yao, Man, et al.
Published: (2024)

Efficient 3D Recognition with Event-driven Spike Sparse Convolution
by: Qiu, Xuerui, et al.
Published: (2024)

Spike2Former: Efficient Spiking Transformer for High-performance Image Segmentation
by: Lei, Zhenxin, et al.
Published: (2024)

Integer-Valued Training and Spike-Driven Inference Spiking Neural Network for High-performance and Energy-efficient Object Detection
by: Luo, Xinhao, et al.
Published: (2024)

High-Performance Temporal Reversible Spiking Neural Networks with $O(L)$ Training Memory and $O(1)$ Inference Cost
by: Hu, JiaKui, et al.
Published: (2024)

Gated Attention Coding for Training High-performance and Efficient Spiking Neural Networks
by: Qiu, Xuerui, et al.
Published: (2023)

RSC-SNN: Exploring the Trade-off Between Adversarial Robustness and Accuracy in Spiking Neural Networks via Randomized Smoothing Coding
by: Wu, Keming, et al.
Published: (2024)

Efficient Deep Spiking Multi-Layer Perceptrons with Multiplication-Free Inference
by: Li, Boyan, et al.
Published: (2023)

Automotive Object Detection via Learning Sparse Events by Spiking Neurons
by: Zhang, Hu, et al.
Published: (2023)

SpikingBrain: Spiking Brain-inspired Large Models
by: Pan, Yuqi, et al.
Published: (2025)

Spike-driven Large Language Model
by: Xu, Han, et al.
Published: (2026)

SpikeMLLM: Spike-based Multimodal Large Language Models via Modality-Specific Temporal Scales and Temporal Compression
by: Xu, Han, et al.
Published: (2026)

SpikeVoice: High-Quality Text-to-Speech Via Efficient Spiking Neural Network
by: Wang, Kexin, et al.
Published: (2024)

Parallel Training in Spiking Neural Networks
by: Huang, Yanbin, et al.
Published: (2026)

Accurate and Efficient Event-based Semantic Segmentation Using Adaptive Spiking Encoder-Decoder Network
by: Zhang, Rui, et al.
Published: (2023)

Quantized Spike-driven Transformer
by: Qiu, Xuerui, et al.
Published: (2025)

Spatial-Temporal Search for Spiking Neural Networks
by: Che, Kaiwei, et al.
Published: (2024)

SVL: Spike-based Vision-language Pretraining for Efficient 3D Open-world Understanding
by: Qiu, Xuerui, et al.
Published: (2025)

Efficient Spike-driven Transformer for High-performance Drone-View Geo-Localization
by: Chen, Zhongwei, et al.
Published: (2025)

SpikingSSMs: Learning Long Sequences with Sparse and Parallel Spiking State Space Models
by: Shen, Shuaijie, et al.
Published: (2024)

SpikeTrack: A Spike-driven Framework for Efficient Visual Tracking
by: Zhang, Qiuyang, et al.
Published: (2026)

SpikingBrain2.0: Brain-Inspired Foundation Models for Efficient Long-Context and Cross-Platform Inference
by: Pan, Yuqi, et al.
Published: (2026)

Threshold Modulation for Online Test-Time Adaptation of Spiking Neural Networks
by: Zhao, Kejie, et al.
Published: (2025)

SpikeVideoFormer: An Efficient Spike-Driven Video Transformer with Hamming Attention and $\mathcal{O}(T)$ Complexity
by: Zou, Shihao, et al.
Published: (2025)

SPikE-SSM: A Sparse, Precise, and Efficient Spiking State Space Model for Long Sequences Learning
by: Zhong, Yan, et al.
Published: (2024)

Evolutionary Spiking Neural Networks: A Survey
by: Shen, Shuaijie, et al.
Published: (2024)

SpikingMamba: Towards Energy-Efficient Large Language Models via Knowledge Distillation from Mamba
by: Huang, Yulong, et al.
Published: (2025)

IML-Spikeformer: Input-aware Multi-Level Spiking Transformer for Speech Processing
by: Song, Zeyang, et al.
Published: (2025)

SpikeLLM: Scaling up Spiking Neural Network to Large Language Models via Saliency-based Spiking
by: Xing, Xingrun, et al.
Published: (2024)

Scalable Autoregressive Image Generation with Mamba
by: Li, Haopeng, et al.
Published: (2024)

SpikePool: Event-driven Spiking Transformer with Pooling Attention
by: Lee, Donghyun, et al.
Published: (2025)

SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networks
by: Zhu, Rui-Jie, et al.
Published: (2023)

Efficiently Training Time-to-First-Spike Spiking Neural Networks from Scratch
by: Che, Kaiwei, et al.
Published: (2024)

SynA-ResNet: Spike-driven ResNet Achieved through OR Residual Connection
by: Shan, Yimeng, et al.
Published: (2023)

Hardware Efficient Accelerator for Spiking Transformer With Reconfigurable Parallel Time Step Computing
by: Chen, Bo-Yu, et al.
Published: (2025)

Toward Large-scale Spiking Neural Networks: A Comprehensive Survey and Future Directions
by: Hu, Yangfan, et al.
Published: (2024)

Parallel Spiking Unit for Efficient Training of Spiking Neural Networks
by: Li, Yang, et al.
Published: (2024)

MetaLA: Unified Optimal Linear Approximation to Softmax Attention Map
by: Chou, Yuhong, et al.
Published: (2024)

SpikeDet: Better Firing Patterns for Accurate and Energy-Efficient Object Detection with Spiking Neural Networks
by: Fan, Yimeng, et al.
Published: (2025)

SpikeLM: Towards General Spike-Driven Language Modeling via Elastic Bi-Spiking Mechanisms
by: Xing, Xingrun, et al.
Published: (2024)