Coding Agent Is Good As World Simulator

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Hongyu, Wang, Jingquan, Zou, Bocheng, Serban, Radu, Negrut, Dan
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910272784957440
author Wang, Hongyu
Wang, Jingquan
Zou, Bocheng
Serban, Radu
Negrut, Dan
author_facet Wang, Hongyu
Wang, Jingquan
Zou, Bocheng
Serban, Radu
Negrut, Dan
contents World models have emerged as a powerful paradigm for building interactive simulation environments, with recent video-based approaches demonstrating impressive progress in generating visually plausible dynamics. However, because these models typically infer dynamics from video and represent them in latent states, they do not explicitly enforce physical constraints. As a result, the generated video rollouts are not physically plausible, exhibiting unstable contacts, distorted shapes, or inconsistent motion. In this paper, we present an agentic framework constructing physics-based world models through executable simulation code. The framework coordinates planning, code generation, visual review, and physics analysis agents. The planning agent converts the natural language prompt into a structured scene plan, the code agent implements it as executable simulation code, and the visual review agent provide visual feedback while the physics analysis agent checks physical consistency. The code is iteratively revised based on the feedback until the simulation matches the prompt reqirements and physical constraints. Experimental results show that our framework outperforms advanced video-based models in physical accuracy, instruction fidelity and visual quality, which could be applied to various scenarios including driving simulation and embodied robot tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2605_14398
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Coding Agent Is Good As World Simulator
Wang, Hongyu
Wang, Jingquan
Zou, Bocheng
Serban, Radu
Negrut, Dan
Artificial Intelligence
World models have emerged as a powerful paradigm for building interactive simulation environments, with recent video-based approaches demonstrating impressive progress in generating visually plausible dynamics. However, because these models typically infer dynamics from video and represent them in latent states, they do not explicitly enforce physical constraints. As a result, the generated video rollouts are not physically plausible, exhibiting unstable contacts, distorted shapes, or inconsistent motion. In this paper, we present an agentic framework constructing physics-based world models through executable simulation code. The framework coordinates planning, code generation, visual review, and physics analysis agents. The planning agent converts the natural language prompt into a structured scene plan, the code agent implements it as executable simulation code, and the visual review agent provide visual feedback while the physics analysis agent checks physical consistency. The code is iteratively revised based on the feedback until the simulation matches the prompt reqirements and physical constraints. Experimental results show that our framework outperforms advanced video-based models in physical accuracy, instruction fidelity and visual quality, which could be applied to various scenarios including driving simulation and embodied robot tasks.
title Coding Agent Is Good As World Simulator
topic Artificial Intelligence
url https://arxiv.org/abs/2605.14398