LoReUn: Data Itself Implicitly Provides Cues to Improve Machine Unlearning
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911083716935680 |
|---|---|
| author | Li, Xiang Shen, Qianli Wang, Haonan Kawaguchi, Kenji |
| author_facet | Li, Xiang Shen, Qianli Wang, Haonan Kawaguchi, Kenji |
| contents | Recent generative models face significant risks of producing harmful content, which has underscored the importance of machine unlearning (MU) as a critical technique for eliminating the influence of undesired data. However, existing MU methods typically assign the same weight to all data to be forgotten, which makes it difficult to effectively forget certain data that is harder to unlearn than others. In this paper, we empirically demonstrate that the loss of data itself can implicitly reflect its varying difficulty. Building on this insight, we introduce Loss-based Reweighting Unlearning (LoReUn), a simple yet effective plug-and-play strategy that dynamically reweights data during the unlearning process with minimal additional computational overhead. Our approach significantly reduces the gap between existing MU methods and exact unlearning in both image classification and generation tasks, effectively enhancing the prevention of harmful content generation in text-to-image diffusion models. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_22499 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | LoReUn: Data Itself Implicitly Provides Cues to Improve Machine Unlearning Li, Xiang Shen, Qianli Wang, Haonan Kawaguchi, Kenji Machine Learning Artificial Intelligence Recent generative models face significant risks of producing harmful content, which has underscored the importance of machine unlearning (MU) as a critical technique for eliminating the influence of undesired data. However, existing MU methods typically assign the same weight to all data to be forgotten, which makes it difficult to effectively forget certain data that is harder to unlearn than others. In this paper, we empirically demonstrate that the loss of data itself can implicitly reflect its varying difficulty. Building on this insight, we introduce Loss-based Reweighting Unlearning (LoReUn), a simple yet effective plug-and-play strategy that dynamically reweights data during the unlearning process with minimal additional computational overhead. Our approach significantly reduces the gap between existing MU methods and exact unlearning in both image classification and generation tasks, effectively enhancing the prevention of harmful content generation in text-to-image diffusion models. |
| title | LoReUn: Data Itself Implicitly Provides Cues to Improve Machine Unlearning |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2507.22499 |