Imagen de Portada

Surprisal from Larger Transformer-based Language Models Predicts fMRI Data More Poorly

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Lin, Yi-Chien, Schuler, William
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Vectors from Larger Language Models Predict Human Reading Time and fMRI Data More Poorly when Dimensionality Expansion is Controlled
por: Lin, Yi-Chien, et al.
Publicado: (2025)

The Impact of Token Granularity on the Predictive Power of Language Model Surprisal
por: Oh, Byung-Doh, et al.
Publicado: (2024)

Language Reconstruction with Brain Predictive Coding from fMRI Data
por: Yin, Congchi, et al.
Publicado: (2024)

The Inverse Scaling Effect of Pre-Trained Language Model Surprisal Is Not Due to Data Leakage
por: Oh, Byung-Doh, et al.
Publicado: (2025)

fMRI-LM: Towards a Universal Foundation Model for Language-Aligned fMRI Understanding
por: Wei, Yuxiang, et al.
Publicado: (2025)

Surprising Efficacy of Fine-Tuned Transformers for Fact-Checking over Larger Language Models
por: Setty, Vinay
Publicado: (2024)

Decoding fMRI Data into Captions using Prefix Language Modeling
por: Shen, Vyacheslav, et al.
Publicado: (2025)

Frequency Explains the Inverse Correlation of Large Language Models' Size, Training Data Amount, and Surprisal's Fit to Reading Times
por: Oh, Byung-Doh, et al.
Publicado: (2024)

Modality-Agnostic fMRI Decoding of Vision and Language
por: Nikolaus, Mitja, et al.
Publicado: (2024)

Evidence from fMRI Supports a Two-Phase Abstraction Process in Language Models
por: Cheng, Emily, et al.
Publicado: (2024)

Do Large Language Models Think Like the Brain? Sentence-Level Evidences from Layer-Wise Embeddings and fMRI
por: Lei, Yu, et al.
Publicado: (2025)

Scaling laws for language encoding models in fMRI
por: Antonello, Richard, et al.
Publicado: (2023)

Naturalistic Language-related Movie-Watching fMRI Task for Detecting Neurocognitive Decline and Disorder
por: Wang, Yuejiao, et al.
Publicado: (2025)

Swin fMRI Transformer Predicts Early Neurodevelopmental Outcomes from Neonatal fMRI
por: Styll, Patrick, et al.
Publicado: (2024)

Optimizing fMRI Data Acquisition for Decoding Natural Speech with Limited Participants
por: Jalouzot, Louis, et al.
Publicado: (2025)

Decoding the Echoes of Vision from fMRI: Memory Disentangling for Past Semantic Information
por: Xia, Runze, et al.
Publicado: (2024)

EmoMind: Decoding Affective Captions from Human Brain fMRI
por: Mohammed, Bilal A., et al.
Publicado: (2026)

BP-GPT: Auditory Neural Decoding Using fMRI-prompted LLM
por: Chen, Xiaoyu, et al.
Publicado: (2025)

Open-vocabulary Auditory Neural Decoding Using fMRI-prompted LLM
por: Chen, Xiaoyu, et al.
Publicado: (2024)

BrainCodec: Neural fMRI codec for the decoding of cognitive brain states
por: Nishimura, Yuto, et al.
Publicado: (2024)

Testing the Predictions of Surprisal Theory in 11 Languages
por: Wilcox, Ethan Gotlieb, et al.
Publicado: (2023)

Smaller Language Models are capable of selecting Instruction-Tuning Training Data for Larger Language Models
por: Mekala, Dheeraj, et al.
Publicado: (2024)

fMRI predictors based on language models of increasing complexity recover brain left lateralization
por: Bonnasse-Gahot, Laurent, et al.
Publicado: (2024)

BrainChat: Decoding Semantic Information from fMRI using Vision-language Pretrained Models
por: Huang, Wanaiu
Publicado: (2024)

Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies
por: Tao, Chaofan, et al.
Publicado: (2024)

Leading Whitespaces of Language Models' Subword Vocabulary Pose a Confound for Calculating Word Probabilities
por: Oh, Byung-Doh, et al.
Publicado: (2024)

Fine-tuning language encoding models on slow fMRI improves prediction for fast ECoG
por: Vaidya, Aditya R., et al.
Publicado: (2026)

Clozing the Gap: Exploring Why Language Model Surprisal Outperforms Cloze Surprisal
por: Nair, Sathvik, et al.
Publicado: (2026)

Distill Not Only Data but Also Rewards: Can Smaller Language Models Surpass Larger Ones?
por: Zhang, Yudi, et al.
Publicado: (2025)

The Frequency Confound in Language-Model Surprisal and Metaphor Novelty
por: Momen, Omar, et al.
Publicado: (2026)

Linear Recency Bias During Training Improves Transformers' Fit to Reading Times
por: Clark, Christian, et al.
Publicado: (2024)

Estimating Brain Activity with High Spatial and Temporal Resolution using a Naturalistic MEG-fMRI Encoding Model
por: Jin, Beige Jerry, et al.
Publicado: (2025)

Omni-fMRI: A Universal Atlas-Free fMRI Foundation Model
por: Wang, Mo, et al.
Publicado: (2026)

Seamless Deception: Larger Language Models Are Better Knowledge Concealers
por: Ashok, Dhananjay, et al.
Publicado: (2026)

Language Models are Surprisingly Fragile to Drug Names in Biomedical Benchmarks
por: Gallifant, Jack, et al.
Publicado: (2024)

Surprise! Uniform Information Density Isn't the Whole Story: Predicting Surprisal Contours in Long-form Discourse
por: Tsipidi, Eleftheria, et al.
Publicado: (2024)

Confabulation: The Surprising Value of Large Language Model Hallucinations
por: Sui, Peiqi, et al.
Publicado: (2024)

Contrastive Learning of Emoji-based Representations for Resource-Poor Languages
por: Choudhary, Nurendra, et al.
Publicado: (2018)

fMRI-Diffusion: Generating fMRI Time Series Via a Temporal Transformer Diffusion Model for Major Depressive Disorder Diagnosis
por: Hasan, Muhammad Asif, et al.
Publicado: (2026)

Small Language Models Fine-tuned to Coordinate Larger Language Models improve Complex Reasoning
por: Juneja, Gurusha, et al.
Publicado: (2023)