Coding for Computation: Efficient Compression of Neural Networks for Reconfigurable Hardware

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Rosenberger, Hans, Fischer, Rodrigo, Fröhlich, Johanna S., Bereyhi, Ali, Müller, Ralf R.
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909591819780096
author Rosenberger, Hans
Fischer, Rodrigo
Fröhlich, Johanna S.
Bereyhi, Ali
Müller, Ralf R.
author_facet Rosenberger, Hans
Fischer, Rodrigo
Fröhlich, Johanna S.
Bereyhi, Ali
Müller, Ralf R.
contents As state of the art neural networks (NNs) continue to grow in size, their resource-efficient implementation becomes ever more important. In this paper, we introduce a compression scheme that reduces the number of computations required for NN inference on reconfigurable hardware such as FPGAs. This is achieved by combining pruning via regularized training, weight sharing and linear computation coding (LCC). Contrary to common NN compression techniques, where the objective is to reduce the memory used for storing the weights of the NNs, our approach is optimized to reduce the number of additions required for inference in a hardware-friendly manner. The proposed scheme achieves competitive performance for simple multilayer perceptrons, as well as for large scale deep NNs such as ResNet-34.
format Preprint
id arxiv_https___arxiv_org_abs_2504_17403
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Coding for Computation: Efficient Compression of Neural Networks for Reconfigurable Hardware
Rosenberger, Hans
Fischer, Rodrigo
Fröhlich, Johanna S.
Bereyhi, Ali
Müller, Ralf R.
Machine Learning
Information Theory
Signal Processing
As state of the art neural networks (NNs) continue to grow in size, their resource-efficient implementation becomes ever more important. In this paper, we introduce a compression scheme that reduces the number of computations required for NN inference on reconfigurable hardware such as FPGAs. This is achieved by combining pruning via regularized training, weight sharing and linear computation coding (LCC). Contrary to common NN compression techniques, where the objective is to reduce the memory used for storing the weights of the NNs, our approach is optimized to reduce the number of additions required for inference in a hardware-friendly manner. The proposed scheme achieves competitive performance for simple multilayer perceptrons, as well as for large scale deep NNs such as ResNet-34.
title Coding for Computation: Efficient Compression of Neural Networks for Reconfigurable Hardware
topic Machine Learning
Information Theory
Signal Processing
url https://arxiv.org/abs/2504.17403