Cover Image

Reducing Storage of Pretrained Neural Networks by Rate-Constrained Quantization and Entropy Coding

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Conzelmann, Alexander, Bamler, Robert
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Gaussian Rate-Distortion-Perception Coding and Entropy-Constrained Scalar Quantization
by: Xie, Li, et al.
Published: (2024)

A Compact Representation for Bayesian Neural Networks By Removing Permutation Symmetry
by: Xiao, Tim Z., et al.
Published: (2023)

Regularized KL-Divergence for Well-Defined Function-Space Variational Inference in Bayesian neural networks
by: Cinquin, Tristan, et al.
Published: (2024)

Differentiable Annealed Importance Sampling Minimizes The Symmetrized Kullback-Leibler Divergence Between Initial and Target Distribution
by: Zenn, Johannes, et al.
Published: (2024)

Decentralized Task Offloading and Load-Balancing for Mobile Edge Computing in Dense Networks
by: Yahya, Mariam, et al.
Published: (2024)

Forget by Uncertainty: Orthogonal Entropy Unlearning for Quantized Neural Networks
by: Zhang, Tian, et al.
Published: (2026)

Layer Collapse in Diffusion Language Models
by: Conzelmann, Alexander, et al.
Published: (2026)

Balancing Molecular Information and Empirical Data in the Prediction of Physico-Chemical Properties
by: Zenn, Johannes, et al.
Published: (2024)

Rate-Constrained Quantization for Communication-Efficient Federated Learning
by: Hamidi, Shayan Mohajer, et al.
Published: (2024)

Flipping Against All Odds: Reducing LLM Coin Flip Bias via Verbalized Rejection Sampling
by: Xiao, Tim Z., et al.
Published: (2025)

The Simpler The Better: An Entropy-Based Importance Metric To Reduce Neural Networks' Depth
by: Quétu, Victor, et al.
Published: (2024)

A Note on Generalization in Variational Autoencoders: How Effective Is Synthetic Data & Overparameterization?
by: Xiao, Tim Z., et al.
Published: (2023)

MCEL: Margin-Based Cross-Entropy Loss for Error-Tolerant Quantized Neural Networks
by: Yayla, Mikail, et al.
Published: (2026)

Energy Considerations for Large Pretrained Neural Networks
by: Mei, Leo, et al.
Published: (2025)

Linearly Constrained Weights: Reducing Activation Shift for Faster Training of Neural Networks
by: Kutsuna, Takuro
Published: (2024)

Frame Quantization of Neural Networks
by: Czaja, Wojciech, et al.
Published: (2024)

Towards Universal Neural Operators through Multiphysics Pretraining
by: Masliaev, Mikhail, et al.
Published: (2025)

Boosting Entropy with Bell Box Quantization
by: Yang, Ningfeng, et al.
Published: (2026)

FSP-Laplace: Function-Space Priors for the Laplace Approximation in Bayesian Deep Learning
by: Cinquin, Tristan, et al.
Published: (2024)

Predictive, scalable and interpretable knowledge tracing on structured domains
by: Zhou, Hanqi, et al.
Published: (2024)

Pruning and Quantization Impact on Graph Neural Networks
by: Khedri, Khatoon, et al.
Published: (2025)

Oscillations Make Neural Networks Robust to Quantization
by: Wenshøj, Jonathan, et al.
Published: (2025)

Constraint Guided Model Quantization of Neural Networks
by: Van Baelen, Quinten, et al.
Published: (2024)

Quantization of Spiking Neural Networks Beyond Accuracy
by: Smith, Evan Gibson, et al.
Published: (2026)

Unrolled Neural Networks for Constrained Optimization
by: Hadou, Samar, et al.
Published: (2026)

Efficient Mixed Precision Quantization in Graph Neural Networks
by: Moustafa, Samir, et al.
Published: (2025)

Quantization-Aware Regularizers for Deep Neural Networks Compression
by: Malchiodi, Dario, et al.
Published: (2026)

Evaluating Loss Functions for Graph Neural Networks: Towards Pretraining and Generalization
by: Abbas, Khushnood, et al.
Published: (2025)

Unrolled Graph Neural Networks for Constrained Optimization
by: Hadou, Samar, et al.
Published: (2025)

LoQT: Low-Rank Adapters for Quantized Pretraining
by: Loeschcke, Sebastian, et al.
Published: (2024)

Probabilistic Pretraining for Neural Regression
by: Oreshkin, Boris N., et al.
Published: (2025)

Strategies for Pretraining Neural Operators
by: Zhou, Anthony, et al.
Published: (2024)

Output-Constrained Lossy Source Coding With Application to Rate-Distortion-Perception Theory
by: Xie, Li, et al.
Published: (2024)

Understanding Neural Network Binarization with Forward and Backward Proximal Quantizers
by: Lu, Yiwei, et al.
Published: (2024)

Verbalized Machine Learning: Revisiting Machine Learning with Language Models
by: Xiao, Tim Z., et al.
Published: (2024)

Gradient-Free Training of Quantized Neural Networks
by: Cohen, Noa, et al.
Published: (2024)

Code Rate Optimization via Neural Polar Decoders
by: Aharoni, Ziv, et al.
Published: (2025)

Convergence Rates of Constrained Expected Improvement
by: Wang, Haowei, et al.
Published: (2025)

Saliency Assisted Quantization for Neural Networks
by: Rezabeyk, Elmira Mousa, et al.
Published: (2024)

Mind Your Entropy: From Maximum Entropy to Trajectory Entropy-Constrained RL
by: Zhan, Guojian, et al.
Published: (2025)