Outlier-Aware Training for Low-Bit Quantization of Structural Re-Parameterized Networks
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | Niu, Muqun, Ren, Yuan, Li, Boyu, Ding, Chenchen |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
Documents similaires
Sharpness-Aware Surrogate Training for On-Sensor Spiking Neural Networks
par: Nicholson, Maximilian
Publié: (2026)
par: Nicholson, Maximilian
Publié: (2026)
How to Train Your Metamorphic Deep Neural Network
par: Sommariva, Thomas, et autres
Publié: (2025)
par: Sommariva, Thomas, et autres
Publié: (2025)
Defining Neural Network Architecture through Polytope Structures of Dataset
par: Lee, Sangmin, et autres
Publié: (2024)
par: Lee, Sangmin, et autres
Publié: (2024)
SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantization
par: Zhang, Jintao, et autres
Publié: (2024)
par: Zhang, Jintao, et autres
Publié: (2024)
Deep Neural Network Models Trained With A Fixed Random Classifier Transfer Better Across Domains
par: Ali, Hafiz Tiomoko, et autres
Publié: (2024)
par: Ali, Hafiz Tiomoko, et autres
Publié: (2024)
Deep Learning using Rectified Linear Units (ReLU)
par: Agarap, Abien Fred
Publié: (2018)
par: Agarap, Abien Fred
Publié: (2018)
Towards Efficient and Accurate Spiking Neural Networks via Adaptive Bit Allocation
par: Yao, Xingting, et autres
Publié: (2025)
par: Yao, Xingting, et autres
Publié: (2025)
Efficient Learning With Sine-Activated Low-rank Matrices
par: Ji, Yiping, et autres
Publié: (2024)
par: Ji, Yiping, et autres
Publié: (2024)
WASH: Train your Ensemble with Communication-Efficient Weight Shuffling, then Average
par: Fournier, Louis, et autres
Publié: (2024)
par: Fournier, Louis, et autres
Publié: (2024)
The Bayesian Method of Tensor Networks
par: Guo, Erdong, et autres
Publié: (2021)
par: Guo, Erdong, et autres
Publié: (2021)
Scaling Supervised Local Learning with Augmented Auxiliary Networks
par: Ma, Chenxiang, et autres
Publié: (2024)
par: Ma, Chenxiang, et autres
Publié: (2024)
Improving Quaternion Neural Networks with Quaternionic Activation Functions
par: Pöppelbaum, Johannes, et autres
Publié: (2024)
par: Pöppelbaum, Johannes, et autres
Publié: (2024)
Towards Narrowing the Generalization Gap in Deep Boolean Networks
par: Kim, Youngsung
Publié: (2024)
par: Kim, Youngsung
Publié: (2024)
Binary Quadratic Quantization: Beyond First-Order Quantization for Real-Valued Matrix Compression
par: Kuroki, Kyo, et autres
Publié: (2025)
par: Kuroki, Kyo, et autres
Publié: (2025)
LTBs-KAN: Linear-Time B-splines Kolmogorov-Arnold Networks
par: Merin-Martinez, Eduardo Said, et autres
Publié: (2026)
par: Merin-Martinez, Eduardo Said, et autres
Publié: (2026)
A Novel Convolutional Neural Network Architecture with a Continuous Symmetry
par: Liu, Yao, et autres
Publié: (2023)
par: Liu, Yao, et autres
Publié: (2023)
Metric as Transform: Exploring beyond Affine Transform for Interpretable Neural Network
par: Sapkota, Suman
Publié: (2024)
par: Sapkota, Suman
Publié: (2024)
Brain-Inspired Online Adaptation for Remote Sensing with Spiking Neural Network
par: Duan, Dexin, et autres
Publié: (2024)
par: Duan, Dexin, et autres
Publié: (2024)
Magic for the Age of Quantized DNNs
par: Sawada, Yoshihide, et autres
Publié: (2024)
par: Sawada, Yoshihide, et autres
Publié: (2024)
SpikingResformer: Bridging ResNet and Vision Transformer in Spiking Neural Networks
par: Shi, Xinyu, et autres
Publié: (2024)
par: Shi, Xinyu, et autres
Publié: (2024)
BrainMAP: Multimodal Graph Learning For Efficient Brain Disease Localization
par: Le, Nguyen Linh Dan, et autres
Publié: (2025)
par: Le, Nguyen Linh Dan, et autres
Publié: (2025)
A Multi-Branched Radial Basis Network Approach to Predicting Complex Chaotic Behaviours
par: Sinha, Aarush
Publié: (2024)
par: Sinha, Aarush
Publié: (2024)
Randomly Weighted Neuromodulation in Neural Networks Facilitates Learning of Manifolds Common Across Tasks
par: Hong, Jinyung, et autres
Publié: (2023)
par: Hong, Jinyung, et autres
Publié: (2023)
HoughToRadon Transform: New Neural Network Layer for Features Improvement in Projection Space
par: Zhabitskaya, Alexandra, et autres
Publié: (2024)
par: Zhabitskaya, Alexandra, et autres
Publié: (2024)
Spiking CenterNet: A Distillation-boosted Spiking Neural Network for Object Detection
par: Bodden, Lennard, et autres
Publié: (2024)
par: Bodden, Lennard, et autres
Publié: (2024)
FSTA-SNN:Frequency-based Spatial-Temporal Attention Module for Spiking Neural Networks
par: Yu, Kairong, et autres
Publié: (2024)
par: Yu, Kairong, et autres
Publié: (2024)
Online Continual Learning via Spiking Neural Networks with Sleep Enhanced Latent Replay
par: Lin, Erliang, et autres
Publié: (2025)
par: Lin, Erliang, et autres
Publié: (2025)
Predictive Coding-based Deep Neural Network Fine-tuning for Computationally Efficient Domain Adaptation
par: Cardoni, Matteo, et autres
Publié: (2025)
par: Cardoni, Matteo, et autres
Publié: (2025)
XnODR and XnIDR: Two Accurate and Fast Fully Connected Layers For Convolutional Neural Networks
par: Sun, Jian, et autres
Publié: (2021)
par: Sun, Jian, et autres
Publié: (2021)
Stochastic Gradient Sampling for Enhancing Neural Networks Training
par: Yun, Juyoung
Publié: (2023)
par: Yun, Juyoung
Publié: (2023)
Enhancing SNN-based Spatio-Temporal Learning: A Benchmark Dataset and Cross-Modality Attention Model
par: Zhou, Shibo, et autres
Publié: (2024)
par: Zhou, Shibo, et autres
Publié: (2024)
Spikformer V2: Join the High Accuracy Club on ImageNet with an SNN Ticket
par: Zhou, Zhaokun, et autres
Publié: (2024)
par: Zhou, Zhaokun, et autres
Publié: (2024)
The Cooperative Network Architecture: Learning Structured Networks as Representation of Sensory Patterns
par: Sager, Pascal J., et autres
Publié: (2024)
par: Sager, Pascal J., et autres
Publié: (2024)
Winning the Lottery by Preserving Network Training Dynamics with Concrete Ticket Search
par: Arora, Tanay, et autres
Publié: (2025)
par: Arora, Tanay, et autres
Publié: (2025)
When Person Re-Identification Meets Event Camera: A Benchmark Dataset and An Attribute-guided Re-Identification Framework
par: Wang, Xiao, et autres
Publié: (2025)
par: Wang, Xiao, et autres
Publié: (2025)
Memory-Free and Parallel Computation for Quantized Spiking Neural Networks
par: Zhang, Dehao, et autres
Publié: (2025)
par: Zhang, Dehao, et autres
Publié: (2025)
Growing Cosine Unit: A Novel Oscillatory Activation Function That Can Speedup Training and Reduce Parameters in Convolutional Neural Networks
par: Noel, Mathew Mithra, et autres
Publié: (2021)
par: Noel, Mathew Mithra, et autres
Publié: (2021)
Covariant spatio-temporal receptive fields for spiking neural networks
par: Pedersen, Jens Egholm, et autres
Publié: (2024)
par: Pedersen, Jens Egholm, et autres
Publié: (2024)
Where to Bind Matters: Hebbian Fast Weights in Vision Transformers for Few-Shot Character Recognition
par: Money, Gavin, et autres
Publié: (2026)
par: Money, Gavin, et autres
Publié: (2026)
Spatio-Temporal Fuzzy-oriented Multi-Modal Meta-Learning for Fine-grained Emotion Recognition
par: Wang, Jingyao, et autres
Publié: (2024)
par: Wang, Jingyao, et autres
Publié: (2024)
Documents similaires
-
Sharpness-Aware Surrogate Training for On-Sensor Spiking Neural Networks
par: Nicholson, Maximilian
Publié: (2026) -
How to Train Your Metamorphic Deep Neural Network
par: Sommariva, Thomas, et autres
Publié: (2025) -
Defining Neural Network Architecture through Polytope Structures of Dataset
par: Lee, Sangmin, et autres
Publié: (2024) -
SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantization
par: Zhang, Jintao, et autres
Publié: (2024) -
Deep Neural Network Models Trained With A Fixed Random Classifier Transfer Better Across Domains
par: Ali, Hafiz Tiomoko, et autres
Publié: (2024)