Learning Robust and Privacy-Preserving Representations via Information Theory

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhang, Binghui, Noorbakhsh, Sayedeh Leila, Dong, Yun, Hong, Yuan, Wang, Binghui
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910745867845632
author Zhang, Binghui
Noorbakhsh, Sayedeh Leila
Dong, Yun
Hong, Yuan
Wang, Binghui
author_facet Zhang, Binghui
Noorbakhsh, Sayedeh Leila
Dong, Yun
Hong, Yuan
Wang, Binghui
contents Machine learning models are vulnerable to both security attacks (e.g., adversarial examples) and privacy attacks (e.g., private attribute inference). We take the first step to mitigate both the security and privacy attacks, and maintain task utility as well. Particularly, we propose an information-theoretic framework to achieve the goals through the lens of representation learning, i.e., learning representations that are robust to both adversarial examples and attribute inference adversaries. We also derive novel theoretical results under our framework, e.g., the inherent trade-off between adversarial robustness/utility and attribute privacy, and guaranteed attribute privacy leakage against attribute inference adversaries.
format Preprint
id arxiv_https___arxiv_org_abs_2412_11066
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Learning Robust and Privacy-Preserving Representations via Information Theory
Zhang, Binghui
Noorbakhsh, Sayedeh Leila
Dong, Yun
Hong, Yuan
Wang, Binghui
Machine Learning
Cryptography and Security
Machine learning models are vulnerable to both security attacks (e.g., adversarial examples) and privacy attacks (e.g., private attribute inference). We take the first step to mitigate both the security and privacy attacks, and maintain task utility as well. Particularly, we propose an information-theoretic framework to achieve the goals through the lens of representation learning, i.e., learning representations that are robust to both adversarial examples and attribute inference adversaries. We also derive novel theoretical results under our framework, e.g., the inherent trade-off between adversarial robustness/utility and attribute privacy, and guaranteed attribute privacy leakage against attribute inference adversaries.
title Learning Robust and Privacy-Preserving Representations via Information Theory
topic Machine Learning
Cryptography and Security
url https://arxiv.org/abs/2412.11066