Copertina

Exploring Extreme Quantization in Spiking Language Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Bal, Malyaban, Jiang, Yi, Sengupta, Abhronil
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Neural and Evolutionary Computing
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentiation
di: Bal, Malyaban, et al.
Pubblicazione: (2023)

P-SpikeSSM: Harnessing Probabilistic Spiking State Space Models for Long-Range Dependency Tasks
di: Bal, Malyaban, et al.
Pubblicazione: (2024)

GRASP: GRouped Activation Shared Parameterization for Parameter-Efficient Fine-Tuning and Robust Inference of Transformers
di: Bal, Malyaban, et al.
Pubblicazione: (2025)

Scaling SNNs Trained Using Equilibrium Propagation to Convolutional Architectures
di: Lin, Jiaqi, et al.
Pubblicazione: (2024)

Spatio-Temporal Pruning for Compressed Spiking Large Language Models
di: Jiang, Yi, et al.
Pubblicazione: (2025)

Benchmarking Spiking Neural Network Learning Methods with Varying Locality
di: Lin, Jiaqi, et al.
Pubblicazione: (2024)

Stochastic Spiking Neural Networks with First-to-Spike Coding
di: Jiang, Yi, et al.
Pubblicazione: (2024)

RMAAT: Astrocyte-Inspired Memory Compression and Replay for Efficient Long-Context Transformers
di: Mia, Md Zesun Ahmed, et al.
Pubblicazione: (2026)

Delving Deeper Into Astromorphic Transformers
di: Mia, Md Zesun Ahmed, et al.
Pubblicazione: (2023)

On the Adversarial Robustness of Spiking Neural Networks Trained by Local Learning
di: Lin, Jiaqi, et al.
Pubblicazione: (2025)

Astrocyte Regulated Neuromorphic Central Pattern Generator Control of Legged Robotic Locomotion
di: Han, Zhuangyu, et al.
Pubblicazione: (2023)

Neuromorphic Reinforcement Learning for Quadruped Locomotion Control on Uneven Terrain
di: Han, Zhuangyu, et al.
Pubblicazione: (2026)

Neuromorphic Cybersecurity with Semi-supervised Lifelong Learning
di: Mia, Md Zesun Ahmed, et al.
Pubblicazione: (2025)

Quantization Meets Spikes: Lossless Conversion in the First Timestep via Polarity Multi-Spike Mapping
di: Zhang, Hangming, et al.
Pubblicazione: (2025)

Adaptive Spiking Neurons for Vision and Language Modeling
di: Zhou, Chenlin, et al.
Pubblicazione: (2026)

MD-SNN: Membrane Potential-aware Distillation on Quantized Spiking Neural Network
di: Lee, Donghyun, et al.
Pubblicazione: (2025)

Winner-Take-All Spiking Transformer for Language Modeling
di: Zhou, Chenlin, et al.
Pubblicazione: (2026)

Parallel Spiking Unit for Efficient Training of Spiking Neural Networks
di: Li, Yang, et al.
Pubblicazione: (2024)

Spiking World Model with Multi-Compartment Neurons for Model-based Reinforcement Learning
di: Sun, Yinqian, et al.
Pubblicazione: (2025)

Biologically Inspired Spiking Diffusion Model with Adaptive Lateral Selection Mechanism
di: Feng, Linghao, et al.
Pubblicazione: (2025)

$SpikePack$: Enhanced Information Flow in Spiking Neural Networks with High Hardware Compatibility
di: Shen, Guobin, et al.
Pubblicazione: (2025)

Trilinear Compute-in-Memory Architecture for Energy-Efficient Transformer Acceleration
di: Mia, Md Zesun Ahmed, et al.
Pubblicazione: (2026)

TEFormer: Structured Bidirectional Temporal Enhancement Modeling in Spiking Transformers
di: Shen, Sicheng, et al.
Pubblicazione: (2026)

Twin Network Augmentation: A Novel Training Strategy for Improved Spiking Neural Networks and Efficient Weight Quantization
di: Deckers, Lucas, et al.
Pubblicazione: (2024)

Walk the Robot: Exploring Soft Robotic Morphological Communication driven by Spiking Neural Networks
di: Meek, Matthew, et al.
Pubblicazione: (2025)

Adaptive Gradient Learning for Spiking Neural Networks by Exploiting Membrane Potential Dynamics
di: Jiang, Jiaqiang, et al.
Pubblicazione: (2025)

SpikingMamba: Towards Energy-Efficient Large Language Models via Knowledge Distillation from Mamba
di: Huang, Yulong, et al.
Pubblicazione: (2025)

SpikePool: Event-driven Spiking Transformer with Pooling Attention
di: Lee, Donghyun, et al.
Pubblicazione: (2025)

Directly Training Temporal Spiking Neural Network with Sparse Surrogate Gradient
di: Li, Yang, et al.
Pubblicazione: (2024)

Spike-driven Large Language Model
di: Xu, Han, et al.
Pubblicazione: (2026)

A Latency Coding Framework for Deep Spiking Neural Networks with Ultra-Low Latency
di: Lu, Yi, et al.
Pubblicazione: (2026)

Spiking Neural Networks with Consistent Mapping Relations Allow High-Accuracy Inference
di: Li, Yang, et al.
Pubblicazione: (2024)

SQUAT: Stateful Quantization-Aware Training in Recurrent Spiking Neural Networks
di: Venkatesh, Sreyes, et al.
Pubblicazione: (2024)

Spiking Wavelet Transformer
di: Fang, Yuetong, et al.
Pubblicazione: (2024)

Learning the Plasticity: Plasticity-Driven Learning Framework in Spiking Neural Networks
di: Shen, Guobin, et al.
Pubblicazione: (2023)

Efficiently Training Time-to-First-Spike Spiking Neural Networks from Scratch
di: Che, Kaiwei, et al.
Pubblicazione: (2024)

Wafer2Spike: Spiking Neural Network for Wafer Map Pattern Classification
di: Mishra, Abhishek, et al.
Pubblicazione: (2024)

ASRC-SNN: Adaptive Skip Recurrent Connection Spiking Neural Network
di: Xu, Shang, et al.
Pubblicazione: (2025)

Hybrid Temporal-8-Bit Spike Coding for Spiking Neural Network Surrogate Training
di: Nhan, Luu Trong, et al.
Pubblicazione: (2025)

Frequency Matching in Spiking Neural Networks for mmWave Sensing
di: Yu, Di, et al.
Pubblicazione: (2026)