QSLM: A Performance- and Memory-aware Quantization Framework with Tiered Search Strategy for Spike-driven Language Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Putra, Rachmad Vidya Wicaksana, Wickramasinghe, Pasindu, Shafique, Muhammad
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Neural and Evolutionary Computing Artificial Intelligence Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Enabling Efficient Processing of Spiking Neural Networks with On-Chip Learning on Commodity Neuromorphic Processors for Edge AI Systems
di: Putra, Rachmad Vidya Wicaksana, et al.
Pubblicazione: (2025)

SpikeNAS: A Fast Memory-Aware Neural Architecture Search Framework for Spiking Neural Network-based Embedded AI Systems
di: Putra, Rachmad Vidya Wicaksana, et al.
Pubblicazione: (2024)

SpikeVox: Towards Energy-Efficient Speech Therapy Framework with Spike-driven Generative Language Models
di: Putra, Rachmad Vidya Wicaksana, et al.
Pubblicazione: (2025)

NeuroNAS: Enhancing Efficiency of Neuromorphic In-Memory Computing for Intelligent Mobile Agents through Hardware-Aware Spiking Neural Architecture Search
di: Putra, Rachmad Vidya Wicaksana, et al.
Pubblicazione: (2024)

QSViT: A Methodology for Quantizing Spiking Vision Transformers
di: Putra, Rachmad Vidya Wicaksana, et al.
Pubblicazione: (2025)

SpiKernel: A Kernel Size Exploration Methodology for Improving Accuracy of the Embedded Spiking Neural Network Systems
di: Putra, Rachmad Vidya Wicaksana, et al.
Pubblicazione: (2024)

TopSpark: A Timestep Optimization Methodology for Energy-Efficient Spiking Neural Networks on Autonomous Mobile Agents
di: Putra, Rachmad Vidya Wicaksana, et al.
Pubblicazione: (2023)

MTSpark: Enabling Multi-Task Learning with Spiking Neural Networks for Generalist Agents
di: Devkota, Avaneesh, et al.
Pubblicazione: (2024)

SNN4Agents: A Framework for Developing Energy-Efficient Embodied Spiking Neural Networks for Autonomous Agents
di: Putra, Rachmad Vidya Wicaksana, et al.
Pubblicazione: (2024)

Scalable Multi-Task Learning through Spiking Neural Networks with Adaptive Task-Switching Policy for Intelligent Autonomous Agents
di: Putra, Rachmad Vidya Wicaksana, et al.
Pubblicazione: (2025)

A Methodology to Study the Impact of Spiking Neural Network Parameters considering Event-Based Automotive Data
di: Bano, Iqra, et al.
Pubblicazione: (2024)

FastSpiker: Enabling Fast Training for Spiking Neural Networks on Event-based Data through Learning Rate Enhancements for Autonomous Embedded Systems
di: Bano, Iqra, et al.
Pubblicazione: (2024)

PENDRAM: Enabling High-Performance and Energy-Efficient Processing of Deep Neural Networks through a Generalized DRAM Data Mapping Policy
di: Putra, Rachmad Vidya Wicaksana, et al.
Pubblicazione: (2024)

Replay4NCL: An Efficient Memory Replay-based Methodology for Neuromorphic Continual Learning in Embedded AI Systems
di: Minhas, Mishal Fatima, et al.
Pubblicazione: (2025)

Embodied Neuromorphic Artificial Intelligence for Robotics: Perspectives, Challenges, and Research Development Stack
di: Putra, Rachmad Vidya Wicaksana, et al.
Pubblicazione: (2024)

Continual Learning with Neuromorphic Computing: Foundations, Methods, and Emerging Applications
di: Minhas, Mishal Fatima, et al.
Pubblicazione: (2024)

Focus Session: Hardware and Software Techniques for Accelerating Multimodal Foundation Models
di: Shafique, Muhammad, et al.
Pubblicazione: (2026)

Spike-driven Large Language Model
di: Xu, Han, et al.
Pubblicazione: (2026)

Trimming Down Large Spiking Vision Transformers via Heterogeneous Quantization Search
di: Xu, Boxun, et al.
Pubblicazione: (2024)

Efficient Training of Spiking Neural Networks by Spike-aware Data Pruning
di: Ma, Chenxiang, et al.
Pubblicazione: (2025)

SpikeFI: A Fault Injection Framework for Spiking Neural Networks
di: Spyrou, Theofilos, et al.
Pubblicazione: (2024)

A feedback control optimizer for online and hardware-aware training of Spiking Neural Networks
di: Saponati, Matteo, et al.
Pubblicazione: (2026)

SpikeMLLM: Spike-based Multimodal Large Language Models via Modality-Specific Temporal Scales and Temporal Compression
di: Xu, Han, et al.
Pubblicazione: (2026)

Word2Spike: Poisson Rate Coding for Associative Memories and Neuromorphic Algorithms
di: Kalra, Archit, et al.
Pubblicazione: (2025)

Learning with Spike Synchrony in Spiking Neural Networks
di: Tian, Yuchen, et al.
Pubblicazione: (2025)

Evolve Cost-aware Acquisition Functions Using Large Language Models
di: Yao, Yiming, et al.
Pubblicazione: (2024)

Spike Accumulation Forwarding for Effective Training of Spiking Neural Networks
di: Saiin, Ryuji, et al.
Pubblicazione: (2023)

Spikingformer: A Key Foundation Model for Spiking Neural Networks
di: Zhou, Chenlin, et al.
Pubblicazione: (2023)

Memory-Driven Metaheuristics: Improving Optimization Performance
di: Farahmand-Tabar, Salar
Pubblicazione: (2024)

NeuroTrain: Surveying Local Learning Rules for Spiking Neural Networks with an Open Benchmarking Framework
di: Caviglia, Alessio, et al.
Pubblicazione: (2026)

Stable Spike: Dual Consistency Optimization via Bitwise AND Operations for Spiking Neural Networks
di: Ding, Yongqi, et al.
Pubblicazione: (2026)

SpikeExplorer: hardware-oriented Design Space Exploration for Spiking Neural Networks on FPGA
di: Padovano, Dario, et al.
Pubblicazione: (2024)

Towards Efficient Deep Spiking Neural Networks Construction with Spiking Activity based Pruning
di: Li, Yaxin, et al.
Pubblicazione: (2024)

Fitness Landscape of Large Language Model-Assisted Automated Algorithm Search
di: Liu, Fei, et al.
Pubblicazione: (2025)

Stabilizing Spiking Neuron Training
di: Herranz-Celotti, Luca, et al.
Pubblicazione: (2022)

Beyond Rate Coding: Surrogate Gradients Enable Spike Timing Learning in Spiking Neural Networks
di: Yu, Ziqiao, et al.
Pubblicazione: (2025)

BiSpikCLM: A Spiking Language Model integrating Softmax-Free Spiking Attention and Spike-Aware Alignment Distillation
di: Guo, Sihang, et al.
Pubblicazione: (2026)

ShiftLIF: Efficient Multi-Level Spiking Neurons with Power-of-Two Quantization
di: Tang, Kaiwen, et al.
Pubblicazione: (2026)

Learning in Spiking Neural Networks with a Calcium-based Hebbian Rule for Spike-timing-dependent Plasticity
di: Girão, Willian Soares, et al.
Pubblicazione: (2025)

Mamba-Spike: Enhancing the Mamba Architecture with a Spiking Front-End for Efficient Temporal Data Processing
di: Qin, Jiahao, et al.
Pubblicazione: (2024)