Verifying Robust Unlearning: Probing Residual Knowledge in Unlearned Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Xuan, Hao, Li, Xingyu
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909586181586944
author Xuan, Hao
Li, Xingyu
author_facet Xuan, Hao
Li, Xingyu
contents Machine Unlearning (MUL) is crucial for privacy protection and content regulation, yet recent studies reveal that traces of forgotten information persist in unlearned models, enabling adversaries to resurface removed knowledge. Existing verification methods only confirm whether unlearning was executed, failing to detect such residual information leaks. To address this, we introduce the concept of Robust Unlearning, ensuring models are indistinguishable from retraining and resistant to adversarial recovery. To empirically evaluate whether unlearning techniques meet this security standard, we propose the Unlearning Mapping Attack (UMA), a post-unlearning verification framework that actively probes models for forgotten traces using adversarial queries. Extensive experiments on discriminative and generative tasks show that existing unlearning techniques remain vulnerable, even when passing existing verification metrics. By establishing UMA as a practical verification tool, this study sets a new standard for assessing and enhancing machine unlearning security.
format Preprint
id arxiv_https___arxiv_org_abs_2504_14798
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Verifying Robust Unlearning: Probing Residual Knowledge in Unlearned Models
Xuan, Hao
Li, Xingyu
Machine Learning
Computer Vision and Pattern Recognition
Machine Unlearning (MUL) is crucial for privacy protection and content regulation, yet recent studies reveal that traces of forgotten information persist in unlearned models, enabling adversaries to resurface removed knowledge. Existing verification methods only confirm whether unlearning was executed, failing to detect such residual information leaks. To address this, we introduce the concept of Robust Unlearning, ensuring models are indistinguishable from retraining and resistant to adversarial recovery. To empirically evaluate whether unlearning techniques meet this security standard, we propose the Unlearning Mapping Attack (UMA), a post-unlearning verification framework that actively probes models for forgotten traces using adversarial queries. Extensive experiments on discriminative and generative tasks show that existing unlearning techniques remain vulnerable, even when passing existing verification metrics. By establishing UMA as a practical verification tool, this study sets a new standard for assessing and enhancing machine unlearning security.
title Verifying Robust Unlearning: Probing Residual Knowledge in Unlearned Models
topic Machine Learning
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2504.14798