What Does it Mean for a Neural Network to Learn a "World Model"?
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911081615589376 |
|---|---|
| author | Li, Kenneth Viégas, Fernanda Wattenberg, Martin |
| author_facet | Li, Kenneth Viégas, Fernanda Wattenberg, Martin |
| contents | We propose a set of precise criteria for saying a neural net learns and uses a "world model." The goal is to give an operational meaning to terms that are often used informally, in order to provide a common language for experimental investigation. We focus specifically on the idea of representing a latent "state space" of the world, leaving modeling the effect of actions to future work. Our definition is based on ideas from the linear probing literature, and formalizes the notion of a computation that factors through a representation of the data generation process. An essential addition to the definition is a set of conditions to check that such a "world model" is not a trivial consequence of the neural net's data or task. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_21513 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | What Does it Mean for a Neural Network to Learn a "World Model"? Li, Kenneth Viégas, Fernanda Wattenberg, Martin Artificial Intelligence Computation and Language We propose a set of precise criteria for saying a neural net learns and uses a "world model." The goal is to give an operational meaning to terms that are often used informally, in order to provide a common language for experimental investigation. We focus specifically on the idea of representing a latent "state space" of the world, leaving modeling the effect of actions to future work. Our definition is based on ideas from the linear probing literature, and formalizes the notion of a computation that factors through a representation of the data generation process. An essential addition to the definition is a set of conditions to check that such a "world model" is not a trivial consequence of the neural net's data or task. |
| title | What Does it Mean for a Neural Network to Learn a "World Model"? |
| topic | Artificial Intelligence Computation and Language |
| url | https://arxiv.org/abs/2507.21513 |