In-context learning emerges in chemical reaction networks without attention
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909986741813248 |
|---|---|
| author | Floyd, Carlos Rios, Hector Manuel Lopez Dinner, Aaron R. Vaikuntanathan, Suriyanarayanan |
| author_facet | Floyd, Carlos Rios, Hector Manuel Lopez Dinner, Aaron R. Vaikuntanathan, Suriyanarayanan |
| contents | We investigate whether chemical processes can perform in-context learning (ICL), a mode of computation typically associated with transformer architectures. ICL allows a system to infer task-specific rules from a sequence of examples without relying solely on fixed parameters. Traditional ICL relies on a pairwise attention mechanism which is not obviously implementable in chemical systems. However, we show theoretically and numerically that chemical processes can achieve ICL through a mechanism we call subspace projection, in which the entire input vector is mapped onto comparison subspaces, with the dominant projection determining the computational output. We illustrate this mechanism analytically in small chemical systems and show numerically that performance is robust to input encoding and dynamical choices, with the number of tunable degrees of freedom in the input encoding as a key limitation. Our results provide a blueprint for realizing ICL in chemical or other physical media and suggest new directions for designing adaptive synthetic chemical systems and understanding possible biological computation in cells. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_06712 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | In-context learning emerges in chemical reaction networks without attention Floyd, Carlos Rios, Hector Manuel Lopez Dinner, Aaron R. Vaikuntanathan, Suriyanarayanan Disordered Systems and Neural Networks Statistical Mechanics Molecular Networks We investigate whether chemical processes can perform in-context learning (ICL), a mode of computation typically associated with transformer architectures. ICL allows a system to infer task-specific rules from a sequence of examples without relying solely on fixed parameters. Traditional ICL relies on a pairwise attention mechanism which is not obviously implementable in chemical systems. However, we show theoretically and numerically that chemical processes can achieve ICL through a mechanism we call subspace projection, in which the entire input vector is mapped onto comparison subspaces, with the dominant projection determining the computational output. We illustrate this mechanism analytically in small chemical systems and show numerically that performance is robust to input encoding and dynamical choices, with the number of tunable degrees of freedom in the input encoding as a key limitation. Our results provide a blueprint for realizing ICL in chemical or other physical media and suggest new directions for designing adaptive synthetic chemical systems and understanding possible biological computation in cells. |
| title | In-context learning emerges in chemical reaction networks without attention |
| topic | Disordered Systems and Neural Networks Statistical Mechanics Molecular Networks |
| url | https://arxiv.org/abs/2601.06712 |