Model Compression Techniques in Biometrics Applications: A Survey

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Caldeira, Eduarda, Neto, Pedro C., Huber, Marco, Damer, Naser, Sequeira, Ana F.
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909076757151744
author Caldeira, Eduarda
Neto, Pedro C.
Huber, Marco
Damer, Naser
Sequeira, Ana F.
author_facet Caldeira, Eduarda
Neto, Pedro C.
Huber, Marco
Damer, Naser
Sequeira, Ana F.
contents The development of deep learning algorithms has extensively empowered humanity's task automatization capacity. However, the huge improvement in the performance of these models is highly correlated with their increasing level of complexity, limiting their usefulness in human-oriented applications, which are usually deployed in resource-constrained devices. This led to the development of compression techniques that drastically reduce the computational and memory costs of deep learning models without significant performance degradation. This paper aims to systematize the current literature on this topic by presenting a comprehensive survey of model compression techniques in biometrics applications, namely quantization, knowledge distillation and pruning. We conduct a critical analysis of the comparative value of these techniques, focusing on their advantages and disadvantages and presenting suggestions for future work directions that can potentially improve the current methods. Additionally, we discuss and analyze the link between model bias and model compression, highlighting the need to direct compression research toward model fairness in future works.
format Preprint
id arxiv_https___arxiv_org_abs_2401_10139
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Model Compression Techniques in Biometrics Applications: A Survey
Caldeira, Eduarda
Neto, Pedro C.
Huber, Marco
Damer, Naser
Sequeira, Ana F.
Computer Vision and Pattern Recognition
Artificial Intelligence
The development of deep learning algorithms has extensively empowered humanity's task automatization capacity. However, the huge improvement in the performance of these models is highly correlated with their increasing level of complexity, limiting their usefulness in human-oriented applications, which are usually deployed in resource-constrained devices. This led to the development of compression techniques that drastically reduce the computational and memory costs of deep learning models without significant performance degradation. This paper aims to systematize the current literature on this topic by presenting a comprehensive survey of model compression techniques in biometrics applications, namely quantization, knowledge distillation and pruning. We conduct a critical analysis of the comparative value of these techniques, focusing on their advantages and disadvantages and presenting suggestions for future work directions that can potentially improve the current methods. Additionally, we discuss and analyze the link between model bias and model compression, highlighting the need to direct compression research toward model fairness in future works.
title Model Compression Techniques in Biometrics Applications: A Survey
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2401.10139