Cover Image

SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhu, Rui-Jie, Zhao, Qihang, Li, Guoqi, Eshraghian, Jason K.
Format:	Preprint
Published:	2023
Subjects:	Computation and Language Machine Learning Neural and Evolutionary Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

SpikeLLM: Scaling up Spiking Neural Network to Large Language Models via Saliency-based Spiking
by: Xing, Xingrun, et al.
Published: (2024)

Autonomous Driving with Spiking Neural Networks
by: Zhu, Rui-Jie, et al.
Published: (2024)

SQUAT: Stateful Quantization-Aware Training in Recurrent Spiking Neural Networks
by: Venkatesh, Sreyes, et al.
Published: (2024)

SpikeLM: Towards General Spike-Driven Language Modeling via Elastic Bi-Spiking Mechanisms
by: Xing, Xingrun, et al.
Published: (2024)

Learning with Spike Synchrony in Spiking Neural Networks
by: Tian, Yuchen, et al.
Published: (2025)

Synchrony-Gated Plasticity with Dopamine Modulation for Spiking Neural Networks
by: Tian, Yuchen, et al.
Published: (2025)

SpikeVoice: High-Quality Text-to-Speech Via Efficient Spiking Neural Network
by: Wang, Kexin, et al.
Published: (2024)

Gated Attention Coding for Training High-performance and Efficient Spiking Neural Networks
by: Qiu, Xuerui, et al.
Published: (2023)

Parallel Training in Spiking Neural Networks
by: Huang, Yanbin, et al.
Published: (2026)

SpikeCLIP: A Contrastive Language-Image Pretrained Spiking Neural Network
by: Lv, Changze, et al.
Published: (2023)

Spiking Convolutional Neural Networks for Text Classification
by: Lv, Changze, et al.
Published: (2024)

Scalable Dendritic Modeling Advances Expressive and Robust Deep Spiking Neural Networks
by: Huang, Yifan, et al.
Published: (2024)

SpikingSSMs: Learning Long Sequences with Sparse and Parallel Spiking State Space Models
by: Shen, Shuaijie, et al.
Published: (2024)

Reducing Data Bottlenecks in Distributed, Heterogeneous Neural Networks
by: Lin, Ruhai, et al.
Published: (2024)

Sorbet: A Neuromorphic Hardware-Compatible Transformer-Based Spiking Language Model
by: Tang, Kaiwen, et al.
Published: (2024)

To Spike or Not To Spike: A Digital Hardware Perspective on Deep Learning Acceleration
by: Ottati, Fabrizio, et al.
Published: (2023)

Neuromorphic Spiking Neural Network Based Classification of COVID-19 Spike Sequences
by: Murad, Taslim, et al.
Published: (2024)

Time to Spike? Understanding the Representational Power of Spiking Neural Networks in Discrete Time
by: Nguyen, Duc Anh, et al.
Published: (2025)

Parallel Spiking Unit for Efficient Training of Spiking Neural Networks
by: Li, Yang, et al.
Published: (2024)

ChronoPlastic Spiking Neural Networks
by: Chaudhry, Sarim
Published: (2025)

SNNAX -- Spiking Neural Networks in JAX
by: Lohoff, Jamie, et al.
Published: (2024)

Spiking Neural Networks with Random Network Architecture
by: Dai, Zihan, et al.
Published: (2025)

Spiking Synaptic Penalty: Appropriate Penalty Term for Energy-Efficient Spiking Neural Networks
by: Suetake, Kazuma, et al.
Published: (2023)

Spiking Brain Compression: Post-Training Second-order Compression for Spiking Neural Networks
by: Shi, Lianfeng, et al.
Published: (2025)

Unsupervised Sparse Coding-based Spiking Neural Network for Real-time Spike Sorting
by: Melot, Alexis, et al.
Published: (2025)

EchoSpike Predictive Plasticity: An Online Local Learning Rule for Spiking Neural Networks
by: Graf, Lars, et al.
Published: (2024)

Supervised Spike Agreement Dependent Plasticity for Fast Local Learning in Spiking Neural Networks
by: S, Gouri Lakshmi, et al.
Published: (2026)

SDTrack: A Baseline for Event-based Tracking via Spiking Neural Networks
by: Shan, Yimeng, et al.
Published: (2025)

Stochastic Spiking Neural Networks with First-to-Spike Coding
by: Jiang, Yi, et al.
Published: (2024)

Spiking Neural Networks for Temporal Processing: Status Quo and Future Prospects
by: Ma, Chenxiang, et al.
Published: (2025)

Learning Long Sequences in Spiking Neural Networks
by: Stan, Matei Ioan, et al.
Published: (2023)

The Role of Temporal Hierarchy in Spiking Neural Networks
by: Moro, Filippo, et al.
Published: (2024)

On the Universal Representation Property of Spiking Neural Networks
by: Hundrieser, Shayan, et al.
Published: (2025)

Spike Agreement Dependent Plasticity: A scalable Bio-Inspired learning paradigm for Spiking Neural Networks
by: Bej, Saptarshi, et al.
Published: (2025)

Sleep-Based Homeostatic Regularization for Stabilizing Spike-Timing-Dependent Plasticity in Recurrent Spiking Neural Networks
by: Massey, Andreas, et al.
Published: (2026)

$SpikePack$: Enhanced Information Flow in Spiking Neural Networks with High Hardware Compatibility
by: Shen, Guobin, et al.
Published: (2025)

Pre-trained Language Models Learn Remarkably Accurate Representations of Numbers
by: Kadlčík, Marek, et al.
Published: (2025)

Expressivity of Spiking Neural Networks
by: Singh, Manjot, et al.
Published: (2023)

Sharpness Aware Surrogate Training for Spiking Neural Networks
by: Nicholson, Maximilian
Published: (2026)

Evolutionary Spiking Neural Networks: A Survey
by: Shen, Shuaijie, et al.
Published: (2024)