High-Resolution Convolutional Neural Networks on Homomorphically Encrypted Data via Sharding Ciphertexts

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Maloney, Vivian, Obrecht, Richard F., Saraph, Vikram, Rama, Prathibha, Tallaksen, Kate
Natura: Preprint
Pubblicazione: 2023
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913211901542400
author Maloney, Vivian
Obrecht, Richard F.
Saraph, Vikram
Rama, Prathibha
Tallaksen, Kate
author_facet Maloney, Vivian
Obrecht, Richard F.
Saraph, Vikram
Rama, Prathibha
Tallaksen, Kate
contents Recently, Deep Convolutional Neural Networks (DCNNs) including the ResNet-20 architecture have been privately evaluated on encrypted, low-resolution data with the Residue-Number-System Cheon-Kim-Kim-Song (RNS-CKKS) homomorphic encryption scheme. We extend methods for evaluating DCNNs on images with larger dimensions and many channels, beyond what can be stored in single ciphertexts. Additionally, we simplify and improve the efficiency of the recently introduced multiplexed image format, demonstrating that homomorphic evaluation can work with standard, row-major matrix packing and results in encrypted inference time speedups by $4.6-6.5\times$. We also show how existing DCNN models can be regularized during the training process to further improve efficiency and accuracy. These techniques are applied to homomorphically evaluate a DCNN with high accuracy on the high-resolution ImageNet dataset, achieving $80.2\%$ top-1 accuracy. We also achieve an accuracy of homomorphically evaluated CNNs on the CIFAR-10 dataset of $98.3\%$.
format Preprint
id arxiv_https___arxiv_org_abs_2306_09189
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle High-Resolution Convolutional Neural Networks on Homomorphically Encrypted Data via Sharding Ciphertexts
Maloney, Vivian
Obrecht, Richard F.
Saraph, Vikram
Rama, Prathibha
Tallaksen, Kate
Cryptography and Security
Machine Learning
Recently, Deep Convolutional Neural Networks (DCNNs) including the ResNet-20 architecture have been privately evaluated on encrypted, low-resolution data with the Residue-Number-System Cheon-Kim-Kim-Song (RNS-CKKS) homomorphic encryption scheme. We extend methods for evaluating DCNNs on images with larger dimensions and many channels, beyond what can be stored in single ciphertexts. Additionally, we simplify and improve the efficiency of the recently introduced multiplexed image format, demonstrating that homomorphic evaluation can work with standard, row-major matrix packing and results in encrypted inference time speedups by $4.6-6.5\times$. We also show how existing DCNN models can be regularized during the training process to further improve efficiency and accuracy. These techniques are applied to homomorphically evaluate a DCNN with high accuracy on the high-resolution ImageNet dataset, achieving $80.2\%$ top-1 accuracy. We also achieve an accuracy of homomorphically evaluated CNNs on the CIFAR-10 dataset of $98.3\%$.
title High-Resolution Convolutional Neural Networks on Homomorphically Encrypted Data via Sharding Ciphertexts
topic Cryptography and Security
Machine Learning
url https://arxiv.org/abs/2306.09189