A Framework for Evaluating Privacy-Utility Trade-off in Vertical Federated Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kang, Yan, Luo, Jiahuan, He, Yuanqin, Zhang, Xiaojin, Fan, Lixin, Yang, Qiang
Format: Preprint
Published: 2022
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909278451793920
author Kang, Yan
Luo, Jiahuan
He, Yuanqin
Zhang, Xiaojin
Fan, Lixin
Yang, Qiang
author_facet Kang, Yan
Luo, Jiahuan
He, Yuanqin
Zhang, Xiaojin
Fan, Lixin
Yang, Qiang
contents Federated learning (FL) has emerged as a practical solution to tackle data silo issues without compromising user privacy. One of its variants, vertical federated learning (VFL), has recently gained increasing attention as the VFL matches the enterprises' demands of leveraging more valuable features to build better machine learning models while preserving user privacy. Current works in VFL concentrate on developing a specific protection or attack mechanism for a particular VFL algorithm. In this work, we propose an evaluation framework that formulates the privacy-utility evaluation problem. We then use this framework as a guide to comprehensively evaluate a broad range of protection mechanisms against most of the state-of-the-art privacy attacks for three widely deployed VFL algorithms. These evaluations may help FL practitioners select appropriate protection mechanisms given specific requirements. Our evaluation results demonstrate that: the model inversion and most of the label inference attacks can be thwarted by existing protection mechanisms; the model completion (MC) attack is difficult to be prevented, which calls for more advanced MC-targeted protection mechanisms. Based on our evaluation results, we offer concrete advice on improving the privacy-preserving capability of VFL systems. The code is available at https://github.com/yankang18/Attack-Defense-VFL
format Preprint
id arxiv_https___arxiv_org_abs_2209_03885
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle A Framework for Evaluating Privacy-Utility Trade-off in Vertical Federated Learning
Kang, Yan
Luo, Jiahuan
He, Yuanqin
Zhang, Xiaojin
Fan, Lixin
Yang, Qiang
Machine Learning
Cryptography and Security
Distributed, Parallel, and Cluster Computing
Federated learning (FL) has emerged as a practical solution to tackle data silo issues without compromising user privacy. One of its variants, vertical federated learning (VFL), has recently gained increasing attention as the VFL matches the enterprises' demands of leveraging more valuable features to build better machine learning models while preserving user privacy. Current works in VFL concentrate on developing a specific protection or attack mechanism for a particular VFL algorithm. In this work, we propose an evaluation framework that formulates the privacy-utility evaluation problem. We then use this framework as a guide to comprehensively evaluate a broad range of protection mechanisms against most of the state-of-the-art privacy attacks for three widely deployed VFL algorithms. These evaluations may help FL practitioners select appropriate protection mechanisms given specific requirements. Our evaluation results demonstrate that: the model inversion and most of the label inference attacks can be thwarted by existing protection mechanisms; the model completion (MC) attack is difficult to be prevented, which calls for more advanced MC-targeted protection mechanisms. Based on our evaluation results, we offer concrete advice on improving the privacy-preserving capability of VFL systems. The code is available at https://github.com/yankang18/Attack-Defense-VFL
title A Framework for Evaluating Privacy-Utility Trade-off in Vertical Federated Learning
topic Machine Learning
Cryptography and Security
Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2209.03885