Cover Image

Sorbet: A Neuromorphic Hardware-Compatible Transformer-Based Spiking Language Model

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Tang, Kaiwen, Yan, Zhanglu, Wong, Weng-Fai
Format:	Preprint
Published:	2024
Subjects:	Neural and Evolutionary Computing Computation and Language Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

SpikySpace: A Spiking State Space Model for Energy-Efficient Time Series Forecasting
by: Tang, Kaiwen, et al.
Published: (2026)

ShiftLIF: Efficient Multi-Level Spiking Neurons with Power-of-Two Quantization
by: Tang, Kaiwen, et al.
Published: (2026)

Reconsidering the energy efficiency of spiking neural networks
by: Yan, Zhanglu, et al.
Published: (2024)

SparrowSNN: A Hardware/software Co-design for Energy Efficient ECG Classification
by: Yan, Zhanglu, et al.
Published: (2024)

SpikeLM: Towards General Spike-Driven Language Modeling via Elastic Bi-Spiking Mechanisms
by: Xing, Xingrun, et al.
Published: (2024)

HAT: Hardware-Aware Transformers for Efficient Natural Language Processing
by: Wang, Hanrui, et al.
Published: (2020)

SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networks
by: Zhu, Rui-Jie, et al.
Published: (2023)

SpikeLLM: Scaling up Spiking Neural Network to Large Language Models via Saliency-based Spiking
by: Xing, Xingrun, et al.
Published: (2024)

SpikeFit: Towards Optimal Deployment of Spiking Networks on Neuromorphic Hardware
by: Kartashov, Ivan, et al.
Published: (2025)

SpikingSSMs: Learning Long Sequences with Sparse and Parallel Spiking State Space Models
by: Shen, Shuaijie, et al.
Published: (2024)

Neuromorphic Spiking Neural Network Based Classification of COVID-19 Spike Sequences
by: Murad, Taslim, et al.
Published: (2024)

Language Modeling on a SpiNNaker 2 Neuromorphic Chip
by: Nazeer, Khaleelulla Khan, et al.
Published: (2023)

BrainTransformers: SNN-LLM
by: Tang, Zhengzheng, et al.
Published: (2024)

Memory-Augmented Spiking Networks: Synergistic Integration of Complementary Mechanisms for Neuromorphic Vision
by: Blessing, Effiong, et al.
Published: (2026)

Neuromorphic Graph Anomaly Detection via Adaptive STDP and Spiking Graph Neural Networks
by: Fofanah, Abdul Joseph, et al.
Published: (2026)

SpikeGraphormer: A High-Performance Graph Transformer with Spiking Graph Attention
by: Sun, Yundong, et al.
Published: (2024)

Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for Large Language Models
by: Dong, Peijie, et al.
Published: (2024)

$SpikePack$: Enhanced Information Flow in Spiking Neural Networks with High Hardware Compatibility
by: Shen, Guobin, et al.
Published: (2025)

SpikeCLIP: A Contrastive Language-Image Pretrained Spiking Neural Network
by: Lv, Changze, et al.
Published: (2023)

Large Language Models for Tuning Evolution Strategies
by: Kramer, Oliver
Published: (2024)

On the Power of Convolution Augmented Transformer
by: Li, Mingchen, et al.
Published: (2024)

Neuromorphic Wireless Split Computing with Multi-Level Spikes
by: Wu, Dengyu, et al.
Published: (2024)

A Hormone-inspired Emotion Layer for Transformer language models (HELT)
by: Reda, Eslam, et al.
Published: (2026)

Pre-trained Language Models Learn Remarkably Accurate Representations of Numbers
by: Kadlčík, Marek, et al.
Published: (2025)

Multiple Population Alternate Evolution Neural Architecture Search
by: Zou, Juan, et al.
Published: (2024)

Genetic Instruct: Scaling up Synthetic Generation of Coding Instructions for Large Language Models
by: Majumdar, Somshubra, et al.
Published: (2024)

SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention
by: Csordás, Róbert, et al.
Published: (2023)

Large Language Models Suffer From Their Own Output: An Analysis of the Self-Consuming Training Loop
by: Briesch, Martin, et al.
Published: (2023)

The Backpropagation Algorithm Implemented on Spiking Neuromorphic Hardware
by: Renner, Alpha, et al.
Published: (2021)

A Transformer-based Neural Architecture Search Method
by: Wang, Shang, et al.
Published: (2025)

Sleep-Based Homeostatic Regularization for Stabilizing Spike-Timing-Dependent Plasticity in Recurrent Spiking Neural Networks
by: Massey, Andreas, et al.
Published: (2026)

Watermarking Neuromorphic Brains: Intellectual Property Protection in Spiking Neural Networks
by: Poursiami, Hamed, et al.
Published: (2024)

Online Pseudo-Zeroth-Order Training of Neuromorphic Spiking Neural Networks
by: Xiao, Mingqing, et al.
Published: (2024)

CLANE: Continual Learning of Actions on Neuromorphic Hardware from Event Cameras
by: Hajizada, Elvin, et al.
Published: (2026)

GT-SNT: A Linear-Time Transformer for Large-Scale Graphs via Spiking Node Tokenization
by: Zhang, Huizhe, et al.
Published: (2025)

Improving Language Plasticity via Pretraining with Active Forgetting
by: Chen, Yihong, et al.
Published: (2023)

Few-Shot Transfer Learning for Individualized Braking Intent Detection on Neuromorphic Hardware
by: Lutes, Nathan, et al.
Published: (2024)

Spike Agreement Dependent Plasticity: A scalable Bio-Inspired learning paradigm for Spiking Neural Networks
by: Bej, Saptarshi, et al.
Published: (2025)

Time to Spike? Understanding the Representational Power of Spiking Neural Networks in Discrete Time
by: Nguyen, Duc Anh, et al.
Published: (2025)

An enhanced Teaching-Learning-Based Optimization (TLBO) with Grey Wolf Optimizer (GWO) for text feature selection and clustering
by: Azarshab, Mahsa, et al.
Published: (2024)