Cover Image

SpikeLLM: Scaling up Spiking Neural Network to Large Language Models via Saliency-based Spiking

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Xing, Xingrun, Gao, Boyan, Zhang, Zheng, Clifton, David A., Xiao, Shitao, Du, Li, Li, Guoqi, Zhang, Jiajun
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Computation and Language Neural and Evolutionary Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

SpikeLM: Towards General Spike-Driven Language Modeling via Elastic Bi-Spiking Mechanisms
by: Xing, Xingrun, et al.
Published: (2024)

Spike-driven Large Language Model
by: Xu, Han, et al.
Published: (2026)

Parallel Training in Spiking Neural Networks
by: Huang, Yanbin, et al.
Published: (2026)

SpikeVoice: High-Quality Text-to-Speech Via Efficient Spiking Neural Network
by: Wang, Kexin, et al.
Published: (2024)

SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networks
by: Zhu, Rui-Jie, et al.
Published: (2023)

Fractional-order Spiking Neural Network
by: Ge, Chengjie, et al.
Published: (2025)

Scalable Dendritic Modeling Advances Expressive and Robust Deep Spiking Neural Networks
by: Huang, Yifan, et al.
Published: (2024)

Parallel Spiking Unit for Efficient Training of Spiking Neural Networks
by: Li, Yang, et al.
Published: (2024)

Stochastic Spiking Neural Networks with First-to-Spike Coding
by: Jiang, Yi, et al.
Published: (2024)

Gated Attention Coding for Training High-performance and Efficient Spiking Neural Networks
by: Qiu, Xuerui, et al.
Published: (2023)

$SpikePack$: Enhanced Information Flow in Spiking Neural Networks with High Hardware Compatibility
by: Shen, Guobin, et al.
Published: (2025)

Spiking Neural Networks for Temporal Processing: Status Quo and Future Prospects
by: Ma, Chenxiang, et al.
Published: (2025)

SpikeMLLM: Spike-based Multimodal Large Language Models via Modality-Specific Temporal Scales and Temporal Compression
by: Xu, Han, et al.
Published: (2026)

UniSpike: Accelerating Spiking Neural Networks on Neuromorphic Systems via Eliminating Address Redundancy
by: Xing, Qinghui, et al.
Published: (2026)

Efficiently Training Time-to-First-Spike Spiking Neural Networks from Scratch
by: Che, Kaiwei, et al.
Published: (2024)

Spatial-Temporal Search for Spiking Neural Networks
by: Che, Kaiwei, et al.
Published: (2024)

Quantization Meets Spikes: Lossless Conversion in the First Timestep via Polarity Multi-Spike Mapping
by: Zhang, Hangming, et al.
Published: (2025)

Expressivity of Spiking Neural Networks
by: Singh, Manjot, et al.
Published: (2023)

Evolutionary Spiking Neural Networks: A Survey
by: Shen, Shuaijie, et al.
Published: (2024)

Wafer2Spike: Spiking Neural Network for Wafer Map Pattern Classification
by: Mishra, Abhishek, et al.
Published: (2024)

Learning with Spike Synchrony in Spiking Neural Networks
by: Tian, Yuchen, et al.
Published: (2025)

Spiking Neural Network Phase Encoding for Cognitive Computing
by: Zhang, Lei
Published: (2024)

Research Advances and New Paradigms for Biology-inspired Spiking Neural Networks
by: Zheng, Tianyu, et al.
Published: (2024)

Bayesian Inference Accelerator for Spiking Neural Networks
by: Katti, Prabodh, et al.
Published: (2024)

Hybrid Temporal-8-Bit Spike Coding for Spiking Neural Network Surrogate Training
by: Nhan, Luu Trong, et al.
Published: (2025)

Efficient and Effective Time-Series Forecasting with Spiking Neural Networks
by: Lv, Changze, et al.
Published: (2024)

Robust Stable Spiking Neural Networks
by: Ding, Jianhao, et al.
Published: (2024)

Stable Spike: Dual Consistency Optimization via Bitwise AND Operations for Spiking Neural Networks
by: Ding, Yongqi, et al.
Published: (2026)

Neural Architecture Search of Time-to-First-Spike-Coded Spiking Neural Networks for Efficient Eye-based Emotion Recognition
by: Liu, Qianhui, et al.
Published: (2025)

Spike-driven Transformer V2: Meta Spiking Neural Network Architecture Inspiring the Design of Next-generation Neuromorphic Chips
by: Yao, Man, et al.
Published: (2024)

Frequency Matching in Spiking Neural Networks for mmWave Sensing
by: Yu, Di, et al.
Published: (2026)

Spiking-LEAF: A Learnable Auditory front-end for Spiking Neural Networks
by: Song, Zeyang, et al.
Published: (2023)

Spiking Convolutional Neural Networks for Text Classification
by: Lv, Changze, et al.
Published: (2024)

Workload-Balanced Pruning for Sparse Spiking Neural Networks
by: Yin, Ruokai, et al.
Published: (2023)

Unveiling the Spatial-temporal Effective Receptive Fields of Spiking Neural Networks
by: Zhang, Jieyuan, et al.
Published: (2025)

Advancing Spiking Neural Networks for Sequential Modeling with Central Pattern Generators
by: Lv, Changze, et al.
Published: (2024)

SpikePool: Event-driven Spiking Transformer with Pooling Attention
by: Lee, Donghyun, et al.
Published: (2025)

Spike Accumulation Forwarding for Effective Training of Spiking Neural Networks
by: Saiin, Ryuji, et al.
Published: (2023)

Cannistraci-Hebb Training on Ultra-Sparse Spiking Neural Networks
by: Hua, Yuan, et al.
Published: (2025)

Direct-to-Event Spiking Neural Network Transfer
by: Luu, Nhan Trong, et al.
Published: (2026)