Forget-MI: Machine Unlearning for Forgetting Multimodal Information in Healthcare Settings

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Hardan, Shahad, Taratynova, Darya, Essofi, Abdelmajid, Nandakumar, Karthik, Yaqub, Mohammad
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913917399203840
author Hardan, Shahad
Taratynova, Darya
Essofi, Abdelmajid
Nandakumar, Karthik
Yaqub, Mohammad
author_facet Hardan, Shahad
Taratynova, Darya
Essofi, Abdelmajid
Nandakumar, Karthik
Yaqub, Mohammad
contents Privacy preservation in AI is crucial, especially in healthcare, where models rely on sensitive patient data. In the emerging field of machine unlearning, existing methodologies struggle to remove patient data from trained multimodal architectures, which are widely used in healthcare. We propose Forget-MI, a novel machine unlearning method for multimodal medical data, by establishing loss functions and perturbation techniques. Our approach unlearns unimodal and joint representations of the data requested to be forgotten while preserving knowledge from the remaining data and maintaining comparable performance to the original model. We evaluate our results using performance on the forget dataset, performance on the test dataset, and Membership Inference Attack (MIA), which measures the attacker's ability to distinguish the forget dataset from the training dataset. Our model outperforms the existing approaches that aim to reduce MIA and the performance on the forget dataset while keeping an equivalent performance on the test set. Specifically, our approach reduces MIA by 0.202 and decreases AUC and F1 scores on the forget set by 0.221 and 0.305, respectively. Additionally, our performance on the test set matches that of the retrained model, while allowing forgetting. Code is available at https://github.com/BioMedIA-MBZUAI/Forget-MI.git
format Preprint
id arxiv_https___arxiv_org_abs_2506_23145
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Forget-MI: Machine Unlearning for Forgetting Multimodal Information in Healthcare Settings
Hardan, Shahad
Taratynova, Darya
Essofi, Abdelmajid
Nandakumar, Karthik
Yaqub, Mohammad
Machine Learning
Cryptography and Security
Computer Vision and Pattern Recognition
Privacy preservation in AI is crucial, especially in healthcare, where models rely on sensitive patient data. In the emerging field of machine unlearning, existing methodologies struggle to remove patient data from trained multimodal architectures, which are widely used in healthcare. We propose Forget-MI, a novel machine unlearning method for multimodal medical data, by establishing loss functions and perturbation techniques. Our approach unlearns unimodal and joint representations of the data requested to be forgotten while preserving knowledge from the remaining data and maintaining comparable performance to the original model. We evaluate our results using performance on the forget dataset, performance on the test dataset, and Membership Inference Attack (MIA), which measures the attacker's ability to distinguish the forget dataset from the training dataset. Our model outperforms the existing approaches that aim to reduce MIA and the performance on the forget dataset while keeping an equivalent performance on the test set. Specifically, our approach reduces MIA by 0.202 and decreases AUC and F1 scores on the forget set by 0.221 and 0.305, respectively. Additionally, our performance on the test set matches that of the retrained model, while allowing forgetting. Code is available at https://github.com/BioMedIA-MBZUAI/Forget-MI.git
title Forget-MI: Machine Unlearning for Forgetting Multimodal Information in Healthcare Settings
topic Machine Learning
Cryptography and Security
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.23145