AGWM: Affordance-Grounded World Models for Environments with Compositional Prerequisites
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917469813211136 |
|---|---|
| author | Zhang, Qinshi Deng, Weipeng Jiang, Zhihan Qu, Jiaming Li, Qianren Xu, Weitao LC, Ray |
| author_facet | Zhang, Qinshi Deng, Weipeng Jiang, Zhihan Qu, Jiaming Li, Qianren Xu, Weitao LC, Ray |
| contents | In model-based learning, the agent learns behaviors by simulating trajectories based on world model predictions. Standard world models typically learn a stationary transition function that maps states and actions to next states, when an action and an outcome frequently co-occur in training data, the model tends to internalize this correlation as a general causal rule while ignoring action preconditions. In interactive environments, however, agent actions can reshape the future affordance space. At each timestep, an action may becomes executable only after its prerequisites are met, or non-executable when they are destroyed. We term such events structure-changing events (SC events). As a result, a conventional world model often fails to determine whether a given action is executable in the current state, especially in multi-step predictions. Each imagined step is conditioned on an incorrect affordance state, and therefore the prediction error compounds over the rollout horizon. In this paper, we propose AGWM (Affordance-Grounded World Model), which learns an abstract affordance structure represented as a DAG of prerequisite dependencies to explicitly track the dynamic executability of actions. Experiments on game-based simulated environments demonstrate the effectiveness of our method by achieving lower multi-step prediction error, better generalization to novel configurations, and improved interpretability. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2605_06841 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | AGWM: Affordance-Grounded World Models for Environments with Compositional Prerequisites Zhang, Qinshi Deng, Weipeng Jiang, Zhihan Qu, Jiaming Li, Qianren Xu, Weitao LC, Ray Artificial Intelligence Machine Learning I.2.6; I.2.8 In model-based learning, the agent learns behaviors by simulating trajectories based on world model predictions. Standard world models typically learn a stationary transition function that maps states and actions to next states, when an action and an outcome frequently co-occur in training data, the model tends to internalize this correlation as a general causal rule while ignoring action preconditions. In interactive environments, however, agent actions can reshape the future affordance space. At each timestep, an action may becomes executable only after its prerequisites are met, or non-executable when they are destroyed. We term such events structure-changing events (SC events). As a result, a conventional world model often fails to determine whether a given action is executable in the current state, especially in multi-step predictions. Each imagined step is conditioned on an incorrect affordance state, and therefore the prediction error compounds over the rollout horizon. In this paper, we propose AGWM (Affordance-Grounded World Model), which learns an abstract affordance structure represented as a DAG of prerequisite dependencies to explicitly track the dynamic executability of actions. Experiments on game-based simulated environments demonstrate the effectiveness of our method by achieving lower multi-step prediction error, better generalization to novel configurations, and improved interpretability. |
| title | AGWM: Affordance-Grounded World Models for Environments with Compositional Prerequisites |
| topic | Artificial Intelligence Machine Learning I.2.6; I.2.8 |
| url | https://arxiv.org/abs/2605.06841 |