Saved in:
| Main Author: | |
|---|---|
| Format: | Recurso digital |
| Language: | |
| Published: |
Zenodo
2025
|
| Online Access: | https://doi.org/10.5281/zenodo.18003638 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866901379813998592 |
|---|---|
| author | smith, alex |
| author_facet | smith, alex |
| contents | <h2><strong>Abstract</strong></h2> <p>We propose a post-training framework for inducing <strong>self-organized criticality (SOC)</strong> in large language models by tuning <strong>meta-cognitive control loops</strong> governing chain-of-thought generation, reflection, and context feedback. Rather than enforcing criticality at the level of neural activations or weights, we show that SOC can emerge behaviorally when slow adaptive parameters regulate fast inference dynamics. We define order parameters for reasoning depth, recursion, and self-revision, and describe a feedback protocol that drives their distributions toward scale-free statistics without task-specific tuning. This approach offers a principled mechanism for dynamically allocating cognitive effort, balancing robustness and adaptability, and may explain why near-critical regimes appear favorable for general intelligence.</p> <h2><strong>Core Thesis</strong></h2> <blockquote><strong>Criticality should be engineered at the level of meta-cognitive dynamics, not raw inference.</strong></blockquote> <p>Key claim:</p> <ul> <li> <p>LLMs already possess rich internal representational structure.</p> </li> <li> <p>What they lack is a <strong>self-organizing control regime</strong> that allocates reasoning depth adaptively.</p> </li> <li> <p>Self-organized criticality naturally emerges when:</p> <ul> <li> <p>Fast generative processes are regulated by</p> </li> <li> <p>Slow adaptive feedback variables</p> </li> <li> <p>Without external fine-tuning.</p> </li> </ul> </li> </ul> <p>This mirrors SOC in physical, biological, and cognitive systems.</p> |
| format | Recurso digital |
| id | zenodo_https___doi_org_10_5281_zenodo_18003638 |
| institution | Zenodo |
| language | |
| publishDate | 2025 |
| publisher | Zenodo |
| record_format | zenodo |
| spellingShingle | Self-Organized Criticality in Meta-Cognitive Control Loops of Large Language Models smith, alex <h2><strong>Abstract</strong></h2> <p>We propose a post-training framework for inducing <strong>self-organized criticality (SOC)</strong> in large language models by tuning <strong>meta-cognitive control loops</strong> governing chain-of-thought generation, reflection, and context feedback. Rather than enforcing criticality at the level of neural activations or weights, we show that SOC can emerge behaviorally when slow adaptive parameters regulate fast inference dynamics. We define order parameters for reasoning depth, recursion, and self-revision, and describe a feedback protocol that drives their distributions toward scale-free statistics without task-specific tuning. This approach offers a principled mechanism for dynamically allocating cognitive effort, balancing robustness and adaptability, and may explain why near-critical regimes appear favorable for general intelligence.</p> <h2><strong>Core Thesis</strong></h2> <blockquote><strong>Criticality should be engineered at the level of meta-cognitive dynamics, not raw inference.</strong></blockquote> <p>Key claim:</p> <ul> <li> <p>LLMs already possess rich internal representational structure.</p> </li> <li> <p>What they lack is a <strong>self-organizing control regime</strong> that allocates reasoning depth adaptively.</p> </li> <li> <p>Self-organized criticality naturally emerges when:</p> <ul> <li> <p>Fast generative processes are regulated by</p> </li> <li> <p>Slow adaptive feedback variables</p> </li> <li> <p>Without external fine-tuning.</p> </li> </ul> </li> </ul> <p>This mirrors SOC in physical, biological, and cognitive systems.</p> |
| title | Self-Organized Criticality in Meta-Cognitive Control Loops of Large Language Models |
| url | https://doi.org/10.5281/zenodo.18003638 |