AUVIC: Adversarial Unlearning of Visual Concepts for Multi-modal Large Language Models

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Chen, Haokun, Li, Jianing, Zhang, Yao, Bi, Jinhe, Xia, Yan, Gu, Jindong, Tresp, Volker
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914158516109312
author Chen, Haokun
Li, Jianing
Zhang, Yao
Bi, Jinhe
Xia, Yan
Gu, Jindong
Tresp, Volker
author_facet Chen, Haokun
Li, Jianing
Zhang, Yao
Bi, Jinhe
Xia, Yan
Gu, Jindong
Tresp, Volker
contents Multimodal Large Language Models (MLLMs) achieve impressive performance once optimized on massive datasets. Such datasets often contain sensitive or copyrighted content, raising significant data privacy concerns. Regulatory frameworks mandating the 'right to be forgotten' drive the need for machine unlearning. This technique allows for the removal of target data without resource-consuming retraining. However, while well-studied for text, visual concept unlearning in MLLMs remains underexplored. A primary challenge is precisely removing a target visual concept without disrupting model performance on related entities. To address this, we introduce AUVIC, a novel visual concept unlearning framework for MLLMs. AUVIC applies adversarial perturbations to enable precise forgetting. This approach effectively isolates the target concept while avoiding unintended effects on similar entities. To evaluate our method, we construct VCUBench. It is the first benchmark designed to assess visual concept unlearning in group contexts. Experimental results demonstrate that AUVIC achieves state-of-the-art target forgetting rates while incurs minimal performance degradation on non-target concepts.
format Preprint
id arxiv_https___arxiv_org_abs_2511_11299
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle AUVIC: Adversarial Unlearning of Visual Concepts for Multi-modal Large Language Models
Chen, Haokun
Li, Jianing
Zhang, Yao
Bi, Jinhe
Xia, Yan
Gu, Jindong
Tresp, Volker
Computer Vision and Pattern Recognition
Artificial Intelligence
Multimodal Large Language Models (MLLMs) achieve impressive performance once optimized on massive datasets. Such datasets often contain sensitive or copyrighted content, raising significant data privacy concerns. Regulatory frameworks mandating the 'right to be forgotten' drive the need for machine unlearning. This technique allows for the removal of target data without resource-consuming retraining. However, while well-studied for text, visual concept unlearning in MLLMs remains underexplored. A primary challenge is precisely removing a target visual concept without disrupting model performance on related entities. To address this, we introduce AUVIC, a novel visual concept unlearning framework for MLLMs. AUVIC applies adversarial perturbations to enable precise forgetting. This approach effectively isolates the target concept while avoiding unintended effects on similar entities. To evaluate our method, we construct VCUBench. It is the first benchmark designed to assess visual concept unlearning in group contexts. Experimental results demonstrate that AUVIC achieves state-of-the-art target forgetting rates while incurs minimal performance degradation on non-target concepts.
title AUVIC: Adversarial Unlearning of Visual Concepts for Multi-modal Large Language Models
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2511.11299