Cover Image

Modality-Agnostic fMRI Decoding of Vision and Language

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Nikolaus, Mitja, Mozafari, Milad, Asher, Nicholas, Reddy, Leila, VanRullen, Rufin
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Learning to Chain Operations by Routing Information Through a Global Workspace
by: Chateau-Laurent, Hugo, et al.
Published: (2025)

Leveraging Self-Supervised Instance Contrastive Learning for Radar Object Detection
by: Decourt, Colin, et al.
Published: (2024)

A recurrent CNN for online object detection on raw radar frames
by: Decourt, Colin, et al.
Published: (2022)

Decoding fMRI Data into Captions using Prefix Language Modeling
by: Shen, Vyacheslav, et al.
Published: (2025)

Enhancing deep neural networks through complex-valued representations and Kuramoto synchronization dynamics
by: Muzellec, Sabine, et al.
Published: (2025)

AI Consciousness and Existential Risk
by: VanRullen, Rufin
Published: (2025)

Latent Representation Matters: Human-like Sketches in One-shot Drawing Tasks
by: Boutin, Victor, et al.
Published: (2024)

BrainChat: Decoding Semantic Information from fMRI using Vision-language Pretrained Models
by: Huang, Wanaiu
Published: (2024)

Saliency strikes back: How filtering out high frequencies improves white-box explanations
by: Muzellec, Sabine, et al.
Published: (2023)

Tracking objects that change in appearance with phase synchrony
by: Muzellec, Sabine, et al.
Published: (2024)

Towards Neural Foundation Models for Vision: Aligning EEG, MEG, and fMRI Representations for Decoding, Encoding, and Modality Conversion
by: Ferrante, Matteo, et al.
Published: (2024)

Deep Neural Encoder-Decoder Model to Relate fMRI Brain Activity with Naturalistic Stimuli
by: David, Florian, et al.
Published: (2025)

Dynadiff: Single-stage Decoding of Images from Continuously Evolving fMRI
by: Careil, Marlène, et al.
Published: (2025)

A Survey on fMRI-based Brain Decoding for Reconstructing Multimodal Stimuli
by: Liu, Pengyu, et al.
Published: (2025)

MindShot: Multi-Shot Video Reconstruction from fMRI with LLM Decoding
by: Zeng, Wenwen, et al.
Published: (2025)

VoxelFormer: Parameter-Efficient Multi-Subject Visual Decoding from fMRI
by: Le, Chenqian, et al.
Published: (2025)

StableMind: Source-Free Cross-Subject fMRI Decoding with Regularized Adaptation
by: Guo, Jintao, et al.
Published: (2026)

Duala: Dual-Level Alignment of Subjects and Stimuli for Cross-Subject fMRI Decoding
by: Li, Shumeng, et al.
Published: (2026)

TROI: Cross-Subject Pretraining with Sparse Voxel Selection for Enhanced fMRI Visual Decoding
by: Wang, Ziyu, et al.
Published: (2025)

A Survey of fMRI to Image Reconstruction
by: Guo, Weiyu, et al.
Published: (2025)

ViSpec: Accelerating Vision-Language Models with Vision-Aware Speculative Decoding
by: Kang, Jialiang, et al.
Published: (2025)

Uncovering Brain-Like Hierarchical Patterns in Vision-Language Models through fMRI-Based Neural Encoding
by: Ren, Yudan, et al.
Published: (2025)

Modality-Specialized Synergizers for Interleaved Vision-Language Generalists
by: Xu, Zhiyang, et al.
Published: (2024)

Deciphering Cross-Modal Alignment in Large Vision-Language Models with Modality Integration Rate
by: Huang, Qidong, et al.
Published: (2024)

DecoFuse: Decomposing and Fusing the "What", "Where", and "How" for Brain-Inspired fMRI-to-Video Decoding
by: Li, Chong, et al.
Published: (2025)

fMRI-Diffusion: Generating fMRI Time Series Via a Temporal Transformer Diffusion Model for Major Depressive Disorder Diagnosis
by: Hasan, Muhammad Asif, et al.
Published: (2026)

Brainformer: Mimic Human Visual Brain Functions to Machine Vision Models via fMRI
by: Nguyen, Xuan-Bac, et al.
Published: (2023)

GeoDANO: Geometric VLM with Domain Agnostic Vision Encoder
by: Cho, Seunghyuk, et al.
Published: (2025)

Decoding Visual Experience and Mapping Semantics through Whole-Brain Analysis Using fMRI Foundation Models
by: Wang, Yanchen, et al.
Published: (2024)

Cross-Modal Obfuscation for Jailbreak Attacks on Large Vision-Language Models
by: Jiang, Lei, et al.
Published: (2025)

LoMo: Local Modality Substitution for Deeper Vision-Language Fusion
by: Han, Feng, et al.
Published: (2026)

Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models
by: Zhu, Tinghui, et al.
Published: (2024)

Seeing Through the Brain: New Insights from Decoding Visual Stimuli with fMRI
by: Huang, Zheng, et al.
Published: (2025)

Do Vision-Language Models Truly Perform Vision Reasoning? A Rigorous Study of the Modality Gap
by: Xu, Yige, et al.
Published: (2026)

Scaffolding Coordinates to Promote Vision-Language Coordination in Large Multi-Modal Models
by: Lei, Xuanyu, et al.
Published: (2024)

Summarization of Multimodal Presentations with Vision-Language Models: Study of the Effect of Modalities and Structure
by: Gigant, Théo, et al.
Published: (2025)

MindAligner: Explicit Brain Functional Alignment for Cross-Subject Visual Decoding from Limited fMRI Data
by: Dai, Yuqin, et al.
Published: (2025)

Making Your Dreams A Reality: Decoding the Dreams into a Coherent Video Story from fMRI Signals
by: Fu, Yanwei, et al.
Published: (2025)

Mitigating Hallucinations in Large Vision-Language Models with Internal Fact-based Contrastive Decoding
by: Wang, Chao, et al.
Published: (2025)

Self-Correcting Decoding with Generative Feedback for Mitigating Hallucinations in Large Vision-Language Models
by: Zhang, Ce, et al.
Published: (2025)