Neural population geometry and optimal coding of tasks with shared latent structure
Fuente:
arXiv
Guardado en:
| Autores principales: | , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866909166399913984 |
|---|---|
| author | Wakhloo, Albert J. Slatton, Will Chung, SueYeon |
| author_facet | Wakhloo, Albert J. Slatton, Will Chung, SueYeon |
| contents | Humans and animals can recognize latent structures in their environment and apply this information to efficiently navigate the world. However, it remains unclear what aspects of neural activity contribute to these computational capabilities. Here, we develop an analytical theory linking the geometry of a neural population's activity to the generalization performance of a linear readout on a set of tasks that depend on a common latent structure. We show that four geometric measures of the activity determine performance across tasks. Using this theory, we find that experimentally observed disentangled representations naturally emerge as an optimal solution to the multi-task learning problem. When data is scarce, these optimal neural codes compress less informative latent variables, and when data is abundant, they expand these variables in the state space. We validate our theory using macaque ventral stream recordings. Our results therefore tie population geometry to multi-task learning. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_16770 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Neural population geometry and optimal coding of tasks with shared latent structure Wakhloo, Albert J. Slatton, Will Chung, SueYeon Neurons and Cognition Disordered Systems and Neural Networks Statistical Mechanics Machine Learning Neural and Evolutionary Computing Humans and animals can recognize latent structures in their environment and apply this information to efficiently navigate the world. However, it remains unclear what aspects of neural activity contribute to these computational capabilities. Here, we develop an analytical theory linking the geometry of a neural population's activity to the generalization performance of a linear readout on a set of tasks that depend on a common latent structure. We show that four geometric measures of the activity determine performance across tasks. Using this theory, we find that experimentally observed disentangled representations naturally emerge as an optimal solution to the multi-task learning problem. When data is scarce, these optimal neural codes compress less informative latent variables, and when data is abundant, they expand these variables in the state space. We validate our theory using macaque ventral stream recordings. Our results therefore tie population geometry to multi-task learning. |
| title | Neural population geometry and optimal coding of tasks with shared latent structure |
| topic | Neurons and Cognition Disordered Systems and Neural Networks Statistical Mechanics Machine Learning Neural and Evolutionary Computing |
| url | https://arxiv.org/abs/2402.16770 |