Verifying Machine Unlearning with Explainable AI

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Vidal, Àlex Pujol, Johansen, Anders S., Jahromi, Mohammad N. S., Escalera, Sergio, Nasrollahi, Kamal, Moeslund, Thomas B.
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909397358215168
author Vidal, Àlex Pujol
Johansen, Anders S.
Jahromi, Mohammad N. S.
Escalera, Sergio
Nasrollahi, Kamal
Moeslund, Thomas B.
author_facet Vidal, Àlex Pujol
Johansen, Anders S.
Jahromi, Mohammad N. S.
Escalera, Sergio
Nasrollahi, Kamal
Moeslund, Thomas B.
contents We investigate the effectiveness of Explainable AI (XAI) in verifying Machine Unlearning (MU) within the context of harbor front monitoring, focusing on data privacy and regulatory compliance. With the increasing need to adhere to privacy legislation such as the General Data Protection Regulation (GDPR), traditional methods of retraining ML models for data deletions prove impractical due to their complexity and resource demands. MU offers a solution by enabling models to selectively forget specific learned patterns without full retraining. We explore various removal techniques, including data relabeling, and model perturbation. Then, we leverage attribution-based XAI to discuss the effects of unlearning on model performance. Our proof-of-concept introduces feature importance as an innovative verification step for MU, expanding beyond traditional metrics and demonstrating techniques' ability to reduce reliance on undesired patterns. Additionally, we propose two novel XAI-based metrics, Heatmap Coverage (HC) and Attention Shift (AS), to evaluate the effectiveness of these methods. This approach not only highlights how XAI can complement MU by providing effective verification, but also sets the stage for future research to enhance their joint integration.
format Preprint
id arxiv_https___arxiv_org_abs_2411_13332
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Verifying Machine Unlearning with Explainable AI
Vidal, Àlex Pujol
Johansen, Anders S.
Jahromi, Mohammad N. S.
Escalera, Sergio
Nasrollahi, Kamal
Moeslund, Thomas B.
Machine Learning
Artificial Intelligence
We investigate the effectiveness of Explainable AI (XAI) in verifying Machine Unlearning (MU) within the context of harbor front monitoring, focusing on data privacy and regulatory compliance. With the increasing need to adhere to privacy legislation such as the General Data Protection Regulation (GDPR), traditional methods of retraining ML models for data deletions prove impractical due to their complexity and resource demands. MU offers a solution by enabling models to selectively forget specific learned patterns without full retraining. We explore various removal techniques, including data relabeling, and model perturbation. Then, we leverage attribution-based XAI to discuss the effects of unlearning on model performance. Our proof-of-concept introduces feature importance as an innovative verification step for MU, expanding beyond traditional metrics and demonstrating techniques' ability to reduce reliance on undesired patterns. Additionally, we propose two novel XAI-based metrics, Heatmap Coverage (HC) and Attention Shift (AS), to evaluate the effectiveness of these methods. This approach not only highlights how XAI can complement MU by providing effective verification, but also sets the stage for future research to enhance their joint integration.
title Verifying Machine Unlearning with Explainable AI
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2411.13332