Energy-information trade-off makes the cortical critical power law the optimal coding
Fuente:
arXiv
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909265344593920 |
|---|---|
| author | Tatsukawa, Tsuyoshi Teramae, Jun-nosuke |
| author_facet | Tatsukawa, Tsuyoshi Teramae, Jun-nosuke |
| contents | Stimulus responses of cortical neurons exhibit the critical power law, where the covariance eigenspectrum follows the power law with the exponent just at the edge of differentiability of the neural manifold. This criticality is conjectured to balance the expressivity and robustness of neural codes, because a non-differential fractal manifold spoils coding reliability. However, contrary to the conjecture, here we prove that the neural coding is not degraded even on the non-differentiable fractal manifold, where the coding is extremely sensitive to perturbations. Rather, we show that the trade-off between energetic cost and information always makes this critical power-law response the optimal neural coding. Direct construction of a maximum likelihood decoder of the power-law coding validates the theoretical prediction. By revealing the non-trivial nature of high-dimensional coding, the theory developed here will contribute to a deeper understanding of criticality and power laws in computation in biological and artificial neural networks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_16215 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Energy-information trade-off makes the cortical critical power law the optimal coding Tatsukawa, Tsuyoshi Teramae, Jun-nosuke Neurons and Cognition Stimulus responses of cortical neurons exhibit the critical power law, where the covariance eigenspectrum follows the power law with the exponent just at the edge of differentiability of the neural manifold. This criticality is conjectured to balance the expressivity and robustness of neural codes, because a non-differential fractal manifold spoils coding reliability. However, contrary to the conjecture, here we prove that the neural coding is not degraded even on the non-differentiable fractal manifold, where the coding is extremely sensitive to perturbations. Rather, we show that the trade-off between energetic cost and information always makes this critical power-law response the optimal neural coding. Direct construction of a maximum likelihood decoder of the power-law coding validates the theoretical prediction. By revealing the non-trivial nature of high-dimensional coding, the theory developed here will contribute to a deeper understanding of criticality and power laws in computation in biological and artificial neural networks. |
| title | Energy-information trade-off makes the cortical critical power law the optimal coding |
| topic | Neurons and Cognition |
| url | https://arxiv.org/abs/2407.16215 |