Compression Aware Certified Training

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Xu, Changming, Singh, Gagandeep
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908407363010560
author Xu, Changming
Singh, Gagandeep
author_facet Xu, Changming
Singh, Gagandeep
contents Deep neural networks deployed in safety-critical, resource-constrained environments must balance efficiency and robustness. Existing methods treat compression and certified robustness as separate goals, compromising either efficiency or safety. We propose CACTUS (Compression Aware Certified Training Using network Sets), a general framework for unifying these objectives during training. CACTUS models maintain high certified accuracy even when compressed. We apply CACTUS for both pruning and quantization and show that it effectively trains models which can be efficiently compressed while maintaining high accuracy and certifiable robustness. CACTUS achieves state-of-the-art accuracy and certified performance for both pruning and quantization on a variety of datasets and input specifications.
format Preprint
id arxiv_https___arxiv_org_abs_2506_11992
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Compression Aware Certified Training
Xu, Changming
Singh, Gagandeep
Machine Learning
Deep neural networks deployed in safety-critical, resource-constrained environments must balance efficiency and robustness. Existing methods treat compression and certified robustness as separate goals, compromising either efficiency or safety. We propose CACTUS (Compression Aware Certified Training Using network Sets), a general framework for unifying these objectives during training. CACTUS models maintain high certified accuracy even when compressed. We apply CACTUS for both pruning and quantization and show that it effectively trains models which can be efficiently compressed while maintaining high accuracy and certifiable robustness. CACTUS achieves state-of-the-art accuracy and certified performance for both pruning and quantization on a variety of datasets and input specifications.
title Compression Aware Certified Training
topic Machine Learning
url https://arxiv.org/abs/2506.11992