FedMinds: Privacy-Preserving Personalized Brain Visual Decoding

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Bao, Guangyin, Miao, Duoqian
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917767436828672
author Bao, Guangyin
Miao, Duoqian
author_facet Bao, Guangyin
Miao, Duoqian
contents Exploring the mysteries of the human brain is a long-term research topic in neuroscience. With the help of deep learning, decoding visual information from human brain activity fMRI has achieved promising performance. However, these decoding models require centralized storage of fMRI data to conduct training, leading to potential privacy security issues. In this paper, we focus on privacy preservation in multi-individual brain visual decoding. To this end, we introduce a novel framework called FedMinds, which utilizes federated learning to protect individuals' privacy during model training. In addition, we deploy individual adapters for each subject, thus allowing personalized visual decoding. We conduct experiments on the authoritative NSD datasets to evaluate the performance of the proposed framework. The results demonstrate that our framework achieves high-precision visual decoding along with privacy protection.
format Preprint
id arxiv_https___arxiv_org_abs_2409_02044
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle FedMinds: Privacy-Preserving Personalized Brain Visual Decoding
Bao, Guangyin
Miao, Duoqian
Neurons and Cognition
Computer Vision and Pattern Recognition
Distributed, Parallel, and Cluster Computing
Image and Video Processing
Exploring the mysteries of the human brain is a long-term research topic in neuroscience. With the help of deep learning, decoding visual information from human brain activity fMRI has achieved promising performance. However, these decoding models require centralized storage of fMRI data to conduct training, leading to potential privacy security issues. In this paper, we focus on privacy preservation in multi-individual brain visual decoding. To this end, we introduce a novel framework called FedMinds, which utilizes federated learning to protect individuals' privacy during model training. In addition, we deploy individual adapters for each subject, thus allowing personalized visual decoding. We conduct experiments on the authoritative NSD datasets to evaluate the performance of the proposed framework. The results demonstrate that our framework achieves high-precision visual decoding along with privacy protection.
title FedMinds: Privacy-Preserving Personalized Brain Visual Decoding
topic Neurons and Cognition
Computer Vision and Pattern Recognition
Distributed, Parallel, and Cluster Computing
Image and Video Processing
url https://arxiv.org/abs/2409.02044