Copertina

SpikeLM: Towards General Spike-Driven Language Modeling via Elastic Bi-Spiking Mechanisms

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Xing, Xingrun, Zhang, Zheng, Ni, Ziyi, Xiao, Shitao, Ju, Yiming, Fan, Siqi, Wang, Yequan, Zhang, Jiajun, Li, Guoqi
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Neural and Evolutionary Computing Computation and Language Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

SpikeLLM: Scaling up Spiking Neural Network to Large Language Models via Saliency-based Spiking
di: Xing, Xingrun, et al.
Pubblicazione: (2024)

Spike-driven Large Language Model
di: Xu, Han, et al.
Pubblicazione: (2026)

Parallel Training in Spiking Neural Networks
di: Huang, Yanbin, et al.
Pubblicazione: (2026)

SpikeVoice: High-Quality Text-to-Speech Via Efficient Spiking Neural Network
di: Wang, Kexin, et al.
Pubblicazione: (2024)

SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networks
di: Zhu, Rui-Jie, et al.
Pubblicazione: (2023)

Stochastic Spiking Neural Networks with First-to-Spike Coding
di: Jiang, Yi, et al.
Pubblicazione: (2024)

Spiking Wavelet Transformer
di: Fang, Yuetong, et al.
Pubblicazione: (2024)

Scalable Dendritic Modeling Advances Expressive and Robust Deep Spiking Neural Networks
di: Huang, Yifan, et al.
Pubblicazione: (2024)

To Spike or Not to Spike, that is the Question
di: Takaghaj, Sanaz Mahmoodi, et al.
Pubblicazione: (2024)

Parallel Spiking Unit for Efficient Training of Spiking Neural Networks
di: Li, Yang, et al.
Pubblicazione: (2024)

SpikePool: Event-driven Spiking Transformer with Pooling Attention
di: Lee, Donghyun, et al.
Pubblicazione: (2025)

Quantization Meets Spikes: Lossless Conversion in the First Timestep via Polarity Multi-Spike Mapping
di: Zhang, Hangming, et al.
Pubblicazione: (2025)

SpikeMLLM: Spike-based Multimodal Large Language Models via Modality-Specific Temporal Scales and Temporal Compression
di: Xu, Han, et al.
Pubblicazione: (2026)

Gated Attention Coding for Training High-performance and Efficient Spiking Neural Networks
di: Qiu, Xuerui, et al.
Pubblicazione: (2023)

Toward Relative Positional Encoding in Spiking Transformers
di: Lv, Changze, et al.
Pubblicazione: (2025)

Efficiently Training Time-to-First-Spike Spiking Neural Networks from Scratch
di: Che, Kaiwei, et al.
Pubblicazione: (2024)

Wafer2Spike: Spiking Neural Network for Wafer Map Pattern Classification
di: Mishra, Abhishek, et al.
Pubblicazione: (2024)

Spiking Transformer with Spatial-Temporal Attention
di: Lee, Donghyun, et al.
Pubblicazione: (2024)

SpikingMamba: Towards Energy-Efficient Large Language Models via Knowledge Distillation from Mamba
di: Huang, Yulong, et al.
Pubblicazione: (2025)

Spiking Neural Networks for Temporal Processing: Status Quo and Future Prospects
di: Ma, Chenxiang, et al.
Pubblicazione: (2025)

Hybrid Temporal-8-Bit Spike Coding for Spiking Neural Network Surrogate Training
di: Nhan, Luu Trong, et al.
Pubblicazione: (2025)

SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentiation
di: Bal, Malyaban, et al.
Pubblicazione: (2023)

$SpikePack$: Enhanced Information Flow in Spiking Neural Networks with High Hardware Compatibility
di: Shen, Guobin, et al.
Pubblicazione: (2025)

Fractional-order Spiking Neural Network
di: Ge, Chengjie, et al.
Pubblicazione: (2025)

Spiking Neural Network Phase Encoding for Cognitive Computing
di: Zhang, Lei
Pubblicazione: (2024)

Spike2Former: Efficient Spiking Transformer for High-performance Image Segmentation
di: Lei, Zhenxin, et al.
Pubblicazione: (2024)

Evolutionary Spiking Neural Networks: A Survey
di: Shen, Shuaijie, et al.
Pubblicazione: (2024)

RTFormer: Re-parameter TSBN Spiking Transformer
di: Wang, Hongzhi, et al.
Pubblicazione: (2024)

Learning with Spike Synchrony in Spiking Neural Networks
di: Tian, Yuchen, et al.
Pubblicazione: (2025)

Expressivity of Spiking Neural Networks
di: Singh, Manjot, et al.
Pubblicazione: (2023)

SpikeAtConv: An Integrated Spiking-Convolutional Attention Architecture for Energy-Efficient Neuromorphic Vision Processing
di: Liao, Wangdan, et al.
Pubblicazione: (2024)

Spatial-Temporal Search for Spiking Neural Networks
di: Che, Kaiwei, et al.
Pubblicazione: (2024)

UniSpike: Accelerating Spiking Neural Networks on Neuromorphic Systems via Eliminating Address Redundancy
di: Xing, Qinghui, et al.
Pubblicazione: (2026)

Towards Efficient Deep Spiking Neural Networks Construction with Spiking Activity based Pruning
di: Li, Yaxin, et al.
Pubblicazione: (2024)

P-SpikeSSM: Harnessing Probabilistic Spiking State Space Models for Long-Range Dependency Tasks
di: Bal, Malyaban, et al.
Pubblicazione: (2024)

Spike-driven Transformer V2: Meta Spiking Neural Network Architecture Inspiring the Design of Next-generation Neuromorphic Chips
di: Yao, Man, et al.
Pubblicazione: (2024)

Event-Driven Learning for Spiking Neural Networks
di: Wei, Wenjie, et al.
Pubblicazione: (2024)

Decision SpikeFormer: Spike-Driven Transformer for Decision Making
di: Huang, Wei, et al.
Pubblicazione: (2025)

Robust Stable Spiking Neural Networks
di: Ding, Jianhao, et al.
Pubblicazione: (2024)

Learning the Plasticity: Plasticity-Driven Learning Framework in Spiking Neural Networks
di: Shen, Guobin, et al.
Pubblicazione: (2023)