Copertina

Toward Relative Positional Encoding in Spiking Transformers

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Lv, Changze, Wang, Yansen, Han, Dongqi, Shen, Yifei, Zheng, Xiaoqing, Huang, Xuanjing, Li, Dongsheng
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Neural and Evolutionary Computing
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Efficient and Effective Time-Series Forecasting with Spiking Neural Networks
di: Lv, Changze, et al.
Pubblicazione: (2024)

Advancing Spiking Neural Networks for Sequential Modeling with Central Pattern Generators
di: Lv, Changze, et al.
Pubblicazione: (2024)

Biologically Plausible Learning via Bidirectional Spike-Based Distillation
di: Lv, Changze, et al.
Pubblicazione: (2025)

Spiking Convolutional Neural Networks for Text Classification
di: Lv, Changze, et al.
Pubblicazione: (2024)

Parallel Training in Spiking Neural Networks
di: Huang, Yanbin, et al.
Pubblicazione: (2026)

Kuramoto Oscillatory Phase Encoding: Neuro-inspired Synchronization for Improved Learning Efficiency
di: Xiao, Mingqing, et al.
Pubblicazione: (2026)

Dendritic Localized Learning: Toward Biologically Plausible Algorithm
di: Lv, Changze, et al.
Pubblicazione: (2025)

SpikeCLIP: A Contrastive Language-Image Pretrained Spiking Neural Network
di: Lv, Changze, et al.
Pubblicazione: (2023)

Frequency Matching in Spiking Neural Networks for mmWave Sensing
di: Yu, Di, et al.
Pubblicazione: (2026)

TEFormer: Structured Bidirectional Temporal Enhancement Modeling in Spiking Transformers
di: Shen, Sicheng, et al.
Pubblicazione: (2026)

STF: Shallow-Level Temporal Feedback to Enhance Spiking Transformers
di: Zheng, Zeqi, et al.
Pubblicazione: (2025)

Spiking Wavelet Transformer
di: Fang, Yuetong, et al.
Pubblicazione: (2024)

STEP: A Unified Spiking Transformer Evaluation Platform for Fair and Reproducible Benchmarking
di: Shen, Sicheng, et al.
Pubblicazione: (2025)

Maximizing Information in Neuron Populations for Neuromorphic Spike Encoding
di: Ferdaoussi, Ahmad El, et al.
Pubblicazione: (2024)

Spiking Neural Network Phase Encoding for Cognitive Computing
di: Zhang, Lei
Pubblicazione: (2024)

Towards Biologically Plausible Computing: A Comprehensive Comparison
di: Lv, Changze, et al.
Pubblicazione: (2024)

SpikePool: Event-driven Spiking Transformer with Pooling Attention
di: Lee, Donghyun, et al.
Pubblicazione: (2025)

RTFormer: Re-parameter TSBN Spiking Transformer
di: Wang, Hongzhi, et al.
Pubblicazione: (2024)

Spiking Transformer with Spatial-Temporal Attention
di: Lee, Donghyun, et al.
Pubblicazione: (2024)

GridPE: Unifying Positional Encoding in Transformers with a Grid Cell-Inspired Framework
di: Li, Boyang, et al.
Pubblicazione: (2024)

$SpikePack$: Enhanced Information Flow in Spiking Neural Networks with High Hardware Compatibility
di: Shen, Guobin, et al.
Pubblicazione: (2025)

Sparse Spike Encoding of Channel Responses for Energy Efficient Human Activity Recognition
di: Cicciarella, Eleonora, et al.
Pubblicazione: (2026)

ShiftLIF: Efficient Multi-Level Spiking Neurons with Power-of-Two Quantization
di: Tang, Kaiwen, et al.
Pubblicazione: (2026)

Quantization Meets Spikes: Lossless Conversion in the First Timestep via Polarity Multi-Spike Mapping
di: Zhang, Hangming, et al.
Pubblicazione: (2025)

Research Advances and New Paradigms for Biology-inspired Spiking Neural Networks
di: Zheng, Tianyu, et al.
Pubblicazione: (2024)

Evolving Efficient Genetic Encoding for Deep Spiking Neural Networks
di: Pan, Wenxuan, et al.
Pubblicazione: (2024)

Winner-Take-All Spiking Transformer for Language Modeling
di: Zhou, Chenlin, et al.
Pubblicazione: (2026)

TMN: A Lightweight Neuron Model for Efficient Nonlinear Spike Representation
di: Gu, Yiwen, et al.
Pubblicazione: (2024)

Evolutionary Spiking Neural Networks: A Survey
di: Shen, Shuaijie, et al.
Pubblicazione: (2024)

Spiking Neural Networks with Consistent Mapping Relations Allow High-Accuracy Inference
di: Li, Yang, et al.
Pubblicazione: (2024)

SpikingMamba: Towards Energy-Efficient Large Language Models via Knowledge Distillation from Mamba
di: Huang, Yulong, et al.
Pubblicazione: (2025)

Towards Efficient Deep Spiking Neural Networks Construction with Spiking Activity based Pruning
di: Li, Yaxin, et al.
Pubblicazione: (2024)

Bishop: Sparsified Bundling Spiking Transformers on Heterogeneous Cores with Error-Constrained Pruning
di: Xu, Boxun, et al.
Pubblicazione: (2025)

Efficiently Training Time-to-First-Spike Spiking Neural Networks from Scratch
di: Che, Kaiwei, et al.
Pubblicazione: (2024)

Fractional-order Spiking Neural Network
di: Ge, Chengjie, et al.
Pubblicazione: (2025)

Spiking World Model with Multi-Compartment Neurons for Model-based Reinforcement Learning
di: Sun, Yinqian, et al.
Pubblicazione: (2025)

Parallel Spiking Unit for Efficient Training of Spiking Neural Networks
di: Li, Yang, et al.
Pubblicazione: (2024)

Learning the Plasticity: Plasticity-Driven Learning Framework in Spiking Neural Networks
di: Shen, Guobin, et al.
Pubblicazione: (2023)

General Self-Prediction Enhancement for Spiking Neurons
di: Huang, Zihan, et al.
Pubblicazione: (2026)

Spatio-Temporal Cluster-Triggered Encoding for Spiking Neural Networks
di: Hu, Minchi
Pubblicazione: (2025)