STABLE: Simulation-Ready Tabletop Layout Generation via a Semantics-Physics Dual System

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Luo, Zhen, Yang, Yixuan, Xu, Xudong, Hao, Jinkun, Lyu, Zhaoyang, Zheng, Feng, Pang, Jiangmiao, Fu, Yanwei
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866916027335442432
author Luo, Zhen
Yang, Yixuan
Xu, Xudong
Hao, Jinkun
Lyu, Zhaoyang
Zheng, Feng
Pang, Jiangmiao
Fu, Yanwei
author_facet Luo, Zhen
Yang, Yixuan
Xu, Xudong
Hao, Jinkun
Lyu, Zhaoyang
Zheng, Feng
Pang, Jiangmiao
Fu, Yanwei
contents Generating simulation-ready tabletop scenes from task instructions is an intriguing and promising research direction in the field of Embodied AI. However, existing task-to-scene generation methods rely exclusively on large language models (LLMs) to predict scene layouts, inevitably yielding object collisions or floating due to LLMs' inherent limitations in 3D spatial reasoning. In this paper, we present STABLE, a semantics-physics dual-system tailored for simulation-ready tabletop scene generation. STABLE consists of two complementary modules: (i) a Semantic Reasoner, a fine-tuned LLM trained on a structured tabletop scene dataset to generate coarse layouts from input task instructions, and (ii) a Physics Corrector, a physics-aware flow-based denoising model that outputs pose updates to refine layouts, which ensures the physical plausibility of scenes while preserves semantic alignment with task instructions. STABLE adopts a progressive generation paradigm: by alternating between the Semantic Reasoner and Physics Corrector, it incrementally expands the scene from task-critical objects to background objects. Experiments demonstrate that STABLE successfully generates simulation-ready tabletop scenes that strictly conform to task instructions and significantly enhances the physical validity of scenes over prior art.
format Preprint
id arxiv_https___arxiv_org_abs_2605_16137
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle STABLE: Simulation-Ready Tabletop Layout Generation via a Semantics-Physics Dual System
Luo, Zhen
Yang, Yixuan
Xu, Xudong
Hao, Jinkun
Lyu, Zhaoyang
Zheng, Feng
Pang, Jiangmiao
Fu, Yanwei
Computer Vision and Pattern Recognition
Robotics
Generating simulation-ready tabletop scenes from task instructions is an intriguing and promising research direction in the field of Embodied AI. However, existing task-to-scene generation methods rely exclusively on large language models (LLMs) to predict scene layouts, inevitably yielding object collisions or floating due to LLMs' inherent limitations in 3D spatial reasoning. In this paper, we present STABLE, a semantics-physics dual-system tailored for simulation-ready tabletop scene generation. STABLE consists of two complementary modules: (i) a Semantic Reasoner, a fine-tuned LLM trained on a structured tabletop scene dataset to generate coarse layouts from input task instructions, and (ii) a Physics Corrector, a physics-aware flow-based denoising model that outputs pose updates to refine layouts, which ensures the physical plausibility of scenes while preserves semantic alignment with task instructions. STABLE adopts a progressive generation paradigm: by alternating between the Semantic Reasoner and Physics Corrector, it incrementally expands the scene from task-critical objects to background objects. Experiments demonstrate that STABLE successfully generates simulation-ready tabletop scenes that strictly conform to task instructions and significantly enhances the physical validity of scenes over prior art.
title STABLE: Simulation-Ready Tabletop Layout Generation via a Semantics-Physics Dual System
topic Computer Vision and Pattern Recognition
Robotics
url https://arxiv.org/abs/2605.16137