Scaling and context steer LLMs along the same computational path as the human brain
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908683938562048 |
|---|---|
| author | Raugel, Joséphine d'Ascoli, Stéphane Rapin, Jérémy Wyart, Valentin King, Jean-Rémi |
| author_facet | Raugel, Joséphine d'Ascoli, Stéphane Rapin, Jérémy Wyart, Valentin King, Jean-Rémi |
| contents | Recent studies suggest that the representations learned by large language models (LLMs) are partially aligned to those of the human brain. However, whether and why this alignment score arises from a similar sequence of computations remains elusive. In this study, we explore this question by examining temporally-resolved brain signals of participants listening to 10 hours of an audiobook. We study these neural dynamics jointly with a benchmark encompassing 22 LLMs varying in size and architecture type. Our analyses confirm that LLMs and the brain generate representations in a similar order: specifically, activations in the initial layers of LLMs tend to best align with early brain responses, while the deeper layers of LLMs tend to best align with later brain responses. This brain-LLM alignment is consistent across transformers and recurrent architectures. However, its emergence depends on both model size and context length. Overall, this study sheds light on the sequential nature of computations and the factors underlying the partial convergence between biological and artificial neural networks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_01591 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Scaling and context steer LLMs along the same computational path as the human brain Raugel, Joséphine d'Ascoli, Stéphane Rapin, Jérémy Wyart, Valentin King, Jean-Rémi Machine Learning Neurons and Cognition Recent studies suggest that the representations learned by large language models (LLMs) are partially aligned to those of the human brain. However, whether and why this alignment score arises from a similar sequence of computations remains elusive. In this study, we explore this question by examining temporally-resolved brain signals of participants listening to 10 hours of an audiobook. We study these neural dynamics jointly with a benchmark encompassing 22 LLMs varying in size and architecture type. Our analyses confirm that LLMs and the brain generate representations in a similar order: specifically, activations in the initial layers of LLMs tend to best align with early brain responses, while the deeper layers of LLMs tend to best align with later brain responses. This brain-LLM alignment is consistent across transformers and recurrent architectures. However, its emergence depends on both model size and context length. Overall, this study sheds light on the sequential nature of computations and the factors underlying the partial convergence between biological and artificial neural networks. |
| title | Scaling and context steer LLMs along the same computational path as the human brain |
| topic | Machine Learning Neurons and Cognition |
| url | https://arxiv.org/abs/2512.01591 |