Copertina

BrainChat: Decoding Semantic Information from fMRI using Vision-language Pretrained Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autore principale:	Huang, Wanaiu
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computer Vision and Pattern Recognition Artificial Intelligence Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Decoding fMRI Data into Captions using Prefix Language Modeling
di: Shen, Vyacheslav, et al.
Pubblicazione: (2025)

Seeing Through the Brain: New Insights from Decoding Visual Stimuli with fMRI
di: Huang, Zheng, et al.
Pubblicazione: (2025)

MindFormer: Semantic Alignment of Multi-Subject fMRI for Brain Decoding
di: Han, Inhwa, et al.
Pubblicazione: (2024)

Modality-Agnostic fMRI Decoding of Vision and Language
di: Nikolaus, Mitja, et al.
Pubblicazione: (2024)

From Flat to Round: Redefining Brain Decoding with Surface-Based fMRI and Cortex Structure
di: Yu, Sijin, et al.
Pubblicazione: (2025)

Towards Neural Foundation Models for Vision: Aligning EEG, MEG, and fMRI Representations for Decoding, Encoding, and Modality Conversion
di: Ferrante, Matteo, et al.
Pubblicazione: (2024)

VIBE: Video-Input Brain Encoder for fMRI Response Modeling
di: Schad, Daniel Carlström, et al.
Pubblicazione: (2025)

Brain-IT: Image Reconstruction from fMRI via Brain-Interaction Transformer
di: Beliy, Roman, et al.
Pubblicazione: (2025)

Brain-CLIPLM: Decoding Compressed Semantic Representations in EEG for Language Reconstruction
di: Yang, Xiaoli, et al.
Pubblicazione: (2026)

MoRE-Brain: Routed Mixture of Experts for Interpretable and Generalizable Cross-Subject fMRI Visual Decoding
di: Wei, Yuxiang, et al.
Pubblicazione: (2025)

BrainCast: A Spatio-Temporal Forecasting Model for Whole-Brain fMRI Time Series Prediction
di: Gao, Yunlong, et al.
Pubblicazione: (2026)

UMBRAE: Unified Multimodal Brain Decoding
di: Xia, Weihao, et al.
Pubblicazione: (2024)

VLMQ: Token Saliency-Driven Post-Training Quantization for Vision-language Models
di: Xue, Yufei, et al.
Pubblicazione: (2025)

Revisit What You See: Revealing Visual Semantics in Vision Tokens to Guide LVLM Decoding
di: Cho, Beomsik, et al.
Pubblicazione: (2025)

Pattern-Aware Diffusion Synthesis of fMRI/dMRI with Tissue and Microstructural Refinement
di: Shen, Xiongri, et al.
Pubblicazione: (2025)

Back to the Barn with LLAMAs: Evolving Pretrained LLM Backbones in Finetuning Vision Language Models
di: Horawalavithana, Sameera, et al.
Pubblicazione: (2026)

Mixture of Decoding: An Attention-Inspired Adaptive Decoding Strategy to Mitigate Hallucinations in Large Vision-Language Models
di: Chen, Xinlong, et al.
Pubblicazione: (2025)

Neurons: Emulating the Human Visual Cortex Improves Fidelity and Interpretability in fMRI-to-Video Reconstruction
di: Wang, Haonan, et al.
Pubblicazione: (2025)

MMICL: Empowering Vision-language Model with Multi-Modal In-Context Learning
di: Zhao, Haozhe, et al.
Pubblicazione: (2023)

Moving Beyond Diffusion: Hierarchy-to-Hierarchy Autoregression for fMRI-to-Image Reconstruction
di: Zhang, Xu, et al.
Pubblicazione: (2025)

Ada-FCN: Adaptive Frequency-Coupled Network for fMRI-Based Brain Disorder Classification
di: Xun, Yue, et al.
Pubblicazione: (2025)

Mitigating Hallucinations in Large Vision-Language Models via Summary-Guided Decoding
di: Min, Kyungmin, et al.
Pubblicazione: (2024)

Delve into Visual Contrastive Decoding for Hallucination Mitigation of Large Vision-Language Models
di: Lee, Yi-Lun, et al.
Pubblicazione: (2024)

Vision-and-Language Navigation Generative Pretrained Transformer
di: Hanlin, Wen
Pubblicazione: (2024)

Mordal: Automated Pretrained Model Selection for Vision Language Models
di: He, Shiqi, et al.
Pubblicazione: (2025)

Modeling Caption Diversity in Contrastive Vision-Language Pretraining
di: Lavoie, Samuel, et al.
Pubblicazione: (2024)

A Novel Dual-Stream Framework for dMRI Tractography Streamline Classification with Joint dMRI and fMRI Data
di: Yan, Haotian, et al.
Pubblicazione: (2025)

Advancing General Multimodal Capability of Vision-language Models with Pyramid-descent Visual Position Encoding
di: Chen, Zhanpeng, et al.
Pubblicazione: (2025)

Mitigating Hallucinations in Large Vision-Language Models (LVLMs) via Language-Contrastive Decoding (LCD)
di: Manevich, Avshalom, et al.
Pubblicazione: (2024)

Decoding Visual Experience and Mapping Semantics through Whole-Brain Analysis Using fMRI Foundation Models
di: Wang, Yanchen, et al.
Pubblicazione: (2024)

IQAGPT: Image Quality Assessment with Vision-language and ChatGPT Models
di: Chen, Zhihao, et al.
Pubblicazione: (2023)

Mitigating Hallucinations in Large Vision-Language Models with Instruction Contrastive Decoding
di: Wang, Xintong, et al.
Pubblicazione: (2024)

Region-Aware Reconstruction Strategy for Pre-training fMRI Foundation Model
di: Doodipala, Ruthwik Reddy, et al.
Pubblicazione: (2025)

Few-Shot Deployment of Pretrained MRI Transformers in Brain Imaging Tasks
di: Li, Mengyu, et al.
Pubblicazione: (2025)

Renaissance: Investigating the Pretraining of Vision-Language Encoders
di: Fields, Clayton, et al.
Pubblicazione: (2024)

NeuralDiffuser: Neuroscience-inspired Diffusion Guidance for fMRI Visual Reconstruction
di: Li, Haoyu, et al.
Pubblicazione: (2024)

Prompt Your Brain: Scaffold Prompt Tuning for Efficient Adaptation of fMRI Pre-trained Model
di: Dong, Zijian, et al.
Pubblicazione: (2024)

Superpixel Semantics Representation and Pre-training for Vision-Language Task
di: Zhang, Siyu, et al.
Pubblicazione: (2023)

A Survey on fMRI-based Brain Decoding for Reconstructing Multimodal Stimuli
di: Liu, Pengyu, et al.
Pubblicazione: (2025)

To Sink or Not to Sink: Visual Information Pathways in Large Vision-Language Models
di: Luo, Jiayun, et al.
Pubblicazione: (2025)