DELTA: Variational Disentangled Learning for Privacy-Preserving Data Reprogramming

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Malarkkan, Arun Vignesh, Bai, Haoyue, Kaushik, Anjali, Fu, Yanjie
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909763044900864
author Malarkkan, Arun Vignesh
Bai, Haoyue
Kaushik, Anjali
Fu, Yanjie
author_facet Malarkkan, Arun Vignesh
Bai, Haoyue
Kaushik, Anjali
Fu, Yanjie
contents In real-world applications, domain data often contains identifiable or sensitive attributes, is subject to strict regulations (e.g., HIPAA, GDPR), and requires explicit data feature engineering for interpretability and transparency. Existing feature engineering primarily focuses on advancing downstream task performance, often risking privacy leakage. We generalize this learning task under such new requirements as Privacy-Preserving Data Reprogramming (PPDR): given a dataset, transforming features to maximize target attribute prediction accuracy while minimizing sensitive attribute prediction accuracy. PPDR poses challenges for existing systems: 1) generating high-utility feature transformations without being overwhelmed by a large search space, and 2) disentangling and eliminating sensitive information from utility-oriented features to reduce privacy inferability. To tackle these challenges, we propose DELTA, a two-phase variational disentangled generative learning framework. Phase I uses policy-guided reinforcement learning to discover feature transformations with downstream task utility, without any regard to privacy inferability. Phase II employs a variational LSTM seq2seq encoder-decoder with a utility-privacy disentangled latent space design and adversarial-causal disentanglement regularization to suppress privacy signals during feature generation. Experiments on eight datasets show DELTA improves predictive performance by ~9.3% and reduces privacy leakage by ~35%, demonstrating robust, privacy-aware data transformation.
format Preprint
id arxiv_https___arxiv_org_abs_2509_00693
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle DELTA: Variational Disentangled Learning for Privacy-Preserving Data Reprogramming
Malarkkan, Arun Vignesh
Bai, Haoyue
Kaushik, Anjali
Fu, Yanjie
Machine Learning
Artificial Intelligence
I.2.2; I.2.6
In real-world applications, domain data often contains identifiable or sensitive attributes, is subject to strict regulations (e.g., HIPAA, GDPR), and requires explicit data feature engineering for interpretability and transparency. Existing feature engineering primarily focuses on advancing downstream task performance, often risking privacy leakage. We generalize this learning task under such new requirements as Privacy-Preserving Data Reprogramming (PPDR): given a dataset, transforming features to maximize target attribute prediction accuracy while minimizing sensitive attribute prediction accuracy. PPDR poses challenges for existing systems: 1) generating high-utility feature transformations without being overwhelmed by a large search space, and 2) disentangling and eliminating sensitive information from utility-oriented features to reduce privacy inferability. To tackle these challenges, we propose DELTA, a two-phase variational disentangled generative learning framework. Phase I uses policy-guided reinforcement learning to discover feature transformations with downstream task utility, without any regard to privacy inferability. Phase II employs a variational LSTM seq2seq encoder-decoder with a utility-privacy disentangled latent space design and adversarial-causal disentanglement regularization to suppress privacy signals during feature generation. Experiments on eight datasets show DELTA improves predictive performance by ~9.3% and reduces privacy leakage by ~35%, demonstrating robust, privacy-aware data transformation.
title DELTA: Variational Disentangled Learning for Privacy-Preserving Data Reprogramming
topic Machine Learning
Artificial Intelligence
I.2.2; I.2.6
url https://arxiv.org/abs/2509.00693