Generating Visual Stimuli from EEG Recordings using Transformer-encoder based EEG encoder and GAN

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Mishra, Rahul, Bhavsar, Arnav
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912127432785920
author Mishra, Rahul
Bhavsar, Arnav
author_facet Mishra, Rahul
Bhavsar, Arnav
contents In this study, we tackle a modern research challenge within the field of perceptual brain decoding, which revolves around synthesizing images from EEG signals using an adversarial deep learning framework. The specific objective is to recreate images belonging to various object categories by leveraging EEG recordings obtained while subjects view those images. To achieve this, we employ a Transformer-encoder based EEG encoder to produce EEG encodings, which serve as inputs to the generator component of the GAN network. Alongside the adversarial loss, we also incorporate perceptual loss to enhance the quality of the generated images.
format Preprint
id arxiv_https___arxiv_org_abs_2402_10115
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Generating Visual Stimuli from EEG Recordings using Transformer-encoder based EEG encoder and GAN
Mishra, Rahul
Bhavsar, Arnav
Artificial Intelligence
Machine Learning
Signal Processing
Neurons and Cognition
In this study, we tackle a modern research challenge within the field of perceptual brain decoding, which revolves around synthesizing images from EEG signals using an adversarial deep learning framework. The specific objective is to recreate images belonging to various object categories by leveraging EEG recordings obtained while subjects view those images. To achieve this, we employ a Transformer-encoder based EEG encoder to produce EEG encodings, which serve as inputs to the generator component of the GAN network. Alongside the adversarial loss, we also incorporate perceptual loss to enhance the quality of the generated images.
title Generating Visual Stimuli from EEG Recordings using Transformer-encoder based EEG encoder and GAN
topic Artificial Intelligence
Machine Learning
Signal Processing
Neurons and Cognition
url https://arxiv.org/abs/2402.10115