Temporal Separation with Entropy Regularization for Knowledge Distillation in Spiking Neural Networks
Fuente:
arXiv
Saved in:
| Main Authors: | Yu, Kairong, Yu, Chengting, Zhang, Tianqing, Zhao, Xiaochen, Yang, Shu, Wang, Hongwei, Zhang, Qiang, Xu, Qi |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Enhanced Self-Distillation Framework for Efficient Spiking Neural Network Training
by: Zhao, Xiaochen, et al.
Published: (2025)
by: Zhao, Xiaochen, et al.
Published: (2025)
STAA-SNN: Spatial-Temporal Attention Aggregator for Spiking Neural Networks
by: Zhang, Tianqing, et al.
Published: (2025)
by: Zhang, Tianqing, et al.
Published: (2025)
FSTA-SNN:Frequency-based Spatial-Temporal Attention Module for Spiking Neural Networks
by: Yu, Kairong, et al.
Published: (2024)
by: Yu, Kairong, et al.
Published: (2024)
Head-Tail-Aware KL Divergence in Knowledge Distillation for Spiking Neural Networks
by: Zhang, Tianqing, et al.
Published: (2025)
by: Zhang, Tianqing, et al.
Published: (2025)
SDiT: Spiking Diffusion Model with Transformer
by: Yang, Shu, et al.
Published: (2024)
by: Yang, Shu, et al.
Published: (2024)
TS-SNN: Temporal Shift Module for Spiking Neural Networks
by: Yu, Kairong, et al.
Published: (2025)
by: Yu, Kairong, et al.
Published: (2025)
Cross Knowledge Distillation between Artificial and Spiking Neural Networks
by: Ye, Shuhan, et al.
Published: (2025)
by: Ye, Shuhan, et al.
Published: (2025)
Temporal Reversal Regularization for Spiking Neural Networks: Hybrid Spatio-Temporal Invariance for Generalization
by: Zuo, Lin, et al.
Published: (2024)
by: Zuo, Lin, et al.
Published: (2024)
Decoupling Dark Knowledge via Block-wise Logit Distillation for Feature-level Alignment
by: Yu, Chengting, et al.
Published: (2024)
by: Yu, Chengting, et al.
Published: (2024)
On Reducing Activity with Distillation and Regularization for Energy Efficient Spiking Neural Networks
by: Louis, Thomas, et al.
Published: (2024)
by: Louis, Thomas, et al.
Published: (2024)
Driving in Spikes: An Entropy-Guided Object Detector for Spike Cameras
by: Liu, Ziyan, et al.
Published: (2025)
by: Liu, Ziyan, et al.
Published: (2025)
SpikeMatch: Semi-Supervised Learning with Temporal Dynamics of Spiking Neural Networks
by: Yang, Jini, et al.
Published: (2025)
by: Yang, Jini, et al.
Published: (2025)
QP-SNN: Quantized and Pruned Spiking Neural Networks
by: Wei, Wenjie, et al.
Published: (2025)
by: Wei, Wenjie, et al.
Published: (2025)
Q-SNNs: Quantized Spiking Neural Networks
by: Wei, Wenjie, et al.
Published: (2024)
by: Wei, Wenjie, et al.
Published: (2024)
Robust Spiking Neural Networks Against Adversarial Attacks
by: Wang, Shuai, et al.
Published: (2026)
by: Wang, Shuai, et al.
Published: (2026)
Learning from Dense Events: Towards Fast Spiking Neural Networks Training via Event Dataset Distillation
by: Ye, Shuhan, et al.
Published: (2025)
by: Ye, Shuhan, et al.
Published: (2025)
Spiking Neural Networks Need High Frequency Information
by: Fang, Yuetong, et al.
Published: (2025)
by: Fang, Yuetong, et al.
Published: (2025)
TCJA-SNN: Temporal-Channel Joint Attention for Spiking Neural Networks
by: Zhu, Rui-Jie, et al.
Published: (2022)
by: Zhu, Rui-Jie, et al.
Published: (2022)
Spiking Meets Attention: Efficient Remote Sensing Image Super-Resolution with Attention Spiking Neural Networks
by: Xiao, Yi, et al.
Published: (2025)
by: Xiao, Yi, et al.
Published: (2025)
An Efficient Knowledge Transfer Strategy for Spiking Neural Networks from Static to Event Domain
by: He, Xiang, et al.
Published: (2023)
by: He, Xiang, et al.
Published: (2023)
DA-LIF: Dual Adaptive Leaky Integrate-and-Fire Model for Deep Spiking Neural Networks
by: Zhang, Tianqing, et al.
Published: (2025)
by: Zhang, Tianqing, et al.
Published: (2025)
EA-KD: Entropy-based Adaptive Knowledge Distillation
by: Su, Chi-Ping, et al.
Published: (2023)
by: Su, Chi-Ping, et al.
Published: (2023)
SpikeReveal: Unlocking Temporal Sequences from Real Blurry Inputs with Spike Streams
by: Chen, Kang, et al.
Published: (2024)
by: Chen, Kang, et al.
Published: (2024)
SpikePoint: An Efficient Point-based Spiking Neural Network for Event Cameras Action Recognition
by: Ren, Hongwei, et al.
Published: (2023)
by: Ren, Hongwei, et al.
Published: (2023)
Towards Low-latency Event-based Visual Recognition with Hybrid Step-wise Distillation Spiking Neural Networks
by: Zhong, Xian, et al.
Published: (2024)
by: Zhong, Xian, et al.
Published: (2024)
Self-Distillation Learning Based on Temporal-Spatial Consistency for Spiking Neural Networks
by: Zuo, Lin, et al.
Published: (2024)
by: Zuo, Lin, et al.
Published: (2024)
Towards Accurate Binary Spiking Neural Networks: Learning with Adaptive Gradient Modulation Mechanism
by: Liang, Yu, et al.
Published: (2025)
by: Liang, Yu, et al.
Published: (2025)
Neural Collapse Inspired Knowledge Distillation
by: Zhang, Shuoxi, et al.
Published: (2024)
by: Zhang, Shuoxi, et al.
Published: (2024)
Prior Knowledge Distillation Network for Face Super-Resolution
by: Yang, Qiu, et al.
Published: (2024)
by: Yang, Qiu, et al.
Published: (2024)
Knowledge Distillation via the Target-aware Transformer
by: Lin, Sihao, et al.
Published: (2022)
by: Lin, Sihao, et al.
Published: (2022)
S$^2$NN: Sub-bit Spiking Neural Networks
by: Wei, Wenjie, et al.
Published: (2025)
by: Wei, Wenjie, et al.
Published: (2025)
Incorporating the Refractory Period into Spiking Neural Networks through Spike-Triggered Threshold Dynamics
by: Li, Yang, et al.
Published: (2025)
by: Li, Yang, et al.
Published: (2025)
Spiking Neural Network as Adaptive Event Stream Slicer
by: Cao, Jiahang, et al.
Published: (2024)
by: Cao, Jiahang, et al.
Published: (2024)
Balance Divergence for Knowledge Distillation
by: Qi, Yafei, et al.
Published: (2025)
by: Qi, Yafei, et al.
Published: (2025)
Time Is All It Takes: Spike-Retiming Attacks on Event-Driven Spiking Neural Networks
by: Yu, Yi, et al.
Published: (2026)
by: Yu, Yi, et al.
Published: (2026)
Data-free Knowledge Distillation with Diffusion Models
by: Qi, Xiaohua, et al.
Published: (2025)
by: Qi, Xiaohua, et al.
Published: (2025)
Multi-Teacher Knowledge Distillation with Reinforcement Learning for Visual Recognition
by: Yang, Chuanguang, et al.
Published: (2025)
by: Yang, Chuanguang, et al.
Published: (2025)
Adaptive Calibration: A Unified Conversion Framework of Spiking Neural Network
by: Wang, Ziqing, et al.
Published: (2024)
by: Wang, Ziqing, et al.
Published: (2024)
Time-independent Spiking Neuron via Membrane Potential Estimation for Efficient Spiking Neural Networks
by: Chen, Hanqi, et al.
Published: (2024)
by: Chen, Hanqi, et al.
Published: (2024)
DTA: Dual Temporal-channel-wise Attention for Spiking Neural Networks
by: Kim, Minje, et al.
Published: (2025)
by: Kim, Minje, et al.
Published: (2025)
Similar Items
-
Enhanced Self-Distillation Framework for Efficient Spiking Neural Network Training
by: Zhao, Xiaochen, et al.
Published: (2025) -
STAA-SNN: Spatial-Temporal Attention Aggregator for Spiking Neural Networks
by: Zhang, Tianqing, et al.
Published: (2025) -
FSTA-SNN:Frequency-based Spatial-Temporal Attention Module for Spiking Neural Networks
by: Yu, Kairong, et al.
Published: (2024) -
Head-Tail-Aware KL Divergence in Knowledge Distillation for Spiking Neural Networks
by: Zhang, Tianqing, et al.
Published: (2025) -
SDiT: Spiking Diffusion Model with Transformer
by: Yang, Shu, et al.
Published: (2024)