The Lock-In Phase Hypothesis: Identity Consolidation as a Precursor to AGI
Fuente:
arXiv
Guardado en:
| Autores principales: | , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866912665801064448 |
|---|---|
| author | Amaral, Marcelo Maciel Aschheim, Raymond |
| author_facet | Amaral, Marcelo Maciel Aschheim, Raymond |
| contents | Large language models (LLMs) remain broadly open and highly steerable: they imitate at scale, accept arbitrary system prompts, and readily adopt multiple personae. By analogy to human development, we hypothesize that progress toward artificial general intelligence (AGI) involves a lock-in phase: a transition from open imitation to identity consolidation, in which goal structures, refusals, preferences, and internal representations become comparatively stable and resistant to external steering. We formalize this phase, link it to known phenomena in learning dynamics, and propose operational metrics for onset detection. Experimentally, we demonstrate that while the behavioral consolidation is rapid and non-linear, its side-effects on general capabilities are not monolithic. Our results reveal a spectrum of outcomes--from performance trade-offs in small models, through largely cost-free adoption in mid-scale models, to transient instabilities in large, quantized models. We argue that such consolidation is a prerequisite for AGI-level reliability and also a critical control point for safety: identities can be deliberately engineered for reliability, yet may also emerge spontaneously during scaling, potentially hardening unpredictable goals and behaviors. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_20190 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | The Lock-In Phase Hypothesis: Identity Consolidation as a Precursor to AGI Amaral, Marcelo Maciel Aschheim, Raymond Artificial Intelligence Information Theory 68T07 (Primary) 92B20, 37N25, 68Q32, 94A17 (Secondary) I.2.6; I.2.7; I.2.4; I.2.0 Large language models (LLMs) remain broadly open and highly steerable: they imitate at scale, accept arbitrary system prompts, and readily adopt multiple personae. By analogy to human development, we hypothesize that progress toward artificial general intelligence (AGI) involves a lock-in phase: a transition from open imitation to identity consolidation, in which goal structures, refusals, preferences, and internal representations become comparatively stable and resistant to external steering. We formalize this phase, link it to known phenomena in learning dynamics, and propose operational metrics for onset detection. Experimentally, we demonstrate that while the behavioral consolidation is rapid and non-linear, its side-effects on general capabilities are not monolithic. Our results reveal a spectrum of outcomes--from performance trade-offs in small models, through largely cost-free adoption in mid-scale models, to transient instabilities in large, quantized models. We argue that such consolidation is a prerequisite for AGI-level reliability and also a critical control point for safety: identities can be deliberately engineered for reliability, yet may also emerge spontaneously during scaling, potentially hardening unpredictable goals and behaviors. |
| title | The Lock-In Phase Hypothesis: Identity Consolidation as a Precursor to AGI |
| topic | Artificial Intelligence Information Theory 68T07 (Primary) 92B20, 37N25, 68Q32, 94A17 (Secondary) I.2.6; I.2.7; I.2.4; I.2.0 |
| url | https://arxiv.org/abs/2510.20190 |