OmniMouse: Scaling properties of multi-modal, multi-task Brain Models on 150B Neural Tokens
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866913050641039360 |
|---|---|
| author | Willeke, Konstantin F. Turishcheva, Polina Gilbert, Alex Chakrabarty, Goirik Bedel, Hasan A. Fahey, Paul G. Qiu, Yongrong Weis, Marissa A. Vystrčilová, Michaela Muhammad, Taliah Ntanavara, Lydia Froebe, Rachel E. Ponder, Kayla Tan, Zheng Huan Orhan, Emin Cobos, Erick Sanborn, Sophia Franke, Katrin Sinz, Fabian H. Ecker, Alexander S. Tolias, Andreas S. |
| author_facet | Willeke, Konstantin F. Turishcheva, Polina Gilbert, Alex Chakrabarty, Goirik Bedel, Hasan A. Fahey, Paul G. Qiu, Yongrong Weis, Marissa A. Vystrčilová, Michaela Muhammad, Taliah Ntanavara, Lydia Froebe, Rachel E. Ponder, Kayla Tan, Zheng Huan Orhan, Emin Cobos, Erick Sanborn, Sophia Franke, Katrin Sinz, Fabian H. Ecker, Alexander S. Tolias, Andreas S. |
| contents | Scaling data and artificial neural networks has transformed AI, driving breakthroughs in language and vision. Whether similar principles apply to modeling brain activity remains unclear. Here we leveraged a dataset of 3.1 million neurons from the visual cortex of 73 mice across 323 sessions, totaling more than 150 billion neural tokens recorded during natural movies, images and parametric stimuli, and behavior. We train multi-modal, multi-task models that support three regimes flexibly at test time: neural prediction, behavioral decoding, neural forecasting, or any combination of the three. OmniMouse achieves state-of-the-art performance, outperforming specialized baselines across nearly all evaluation regimes. We find that performance scales reliably with more data, but gains from increasing model size saturate. This inverts the standard AI scaling story: in language and computer vision, massive datasets make parameter scaling the primary driver of progress, whereas in brain modeling -- even in the mouse visual cortex, a relatively simple system -- models remain data-limited despite vast recordings. The observation of systematic scaling raises the possibility of phase transitions in neural modeling, where larger and richer datasets might unlock qualitatively new capabilities, paralleling the emergent properties seen in large language models. Code available at https://github.com/enigma-brain/omnimouse. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_18827 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | OmniMouse: Scaling properties of multi-modal, multi-task Brain Models on 150B Neural Tokens Willeke, Konstantin F. Turishcheva, Polina Gilbert, Alex Chakrabarty, Goirik Bedel, Hasan A. Fahey, Paul G. Qiu, Yongrong Weis, Marissa A. Vystrčilová, Michaela Muhammad, Taliah Ntanavara, Lydia Froebe, Rachel E. Ponder, Kayla Tan, Zheng Huan Orhan, Emin Cobos, Erick Sanborn, Sophia Franke, Katrin Sinz, Fabian H. Ecker, Alexander S. Tolias, Andreas S. Neurons and Cognition Artificial Intelligence Scaling data and artificial neural networks has transformed AI, driving breakthroughs in language and vision. Whether similar principles apply to modeling brain activity remains unclear. Here we leveraged a dataset of 3.1 million neurons from the visual cortex of 73 mice across 323 sessions, totaling more than 150 billion neural tokens recorded during natural movies, images and parametric stimuli, and behavior. We train multi-modal, multi-task models that support three regimes flexibly at test time: neural prediction, behavioral decoding, neural forecasting, or any combination of the three. OmniMouse achieves state-of-the-art performance, outperforming specialized baselines across nearly all evaluation regimes. We find that performance scales reliably with more data, but gains from increasing model size saturate. This inverts the standard AI scaling story: in language and computer vision, massive datasets make parameter scaling the primary driver of progress, whereas in brain modeling -- even in the mouse visual cortex, a relatively simple system -- models remain data-limited despite vast recordings. The observation of systematic scaling raises the possibility of phase transitions in neural modeling, where larger and richer datasets might unlock qualitatively new capabilities, paralleling the emergent properties seen in large language models. Code available at https://github.com/enigma-brain/omnimouse. |
| title | OmniMouse: Scaling properties of multi-modal, multi-task Brain Models on 150B Neural Tokens |
| topic | Neurons and Cognition Artificial Intelligence |
| url | https://arxiv.org/abs/2604.18827 |