Visual Foresight for Robotic Stow: A Diffusion-Based World Model from Sparse Snapshots
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2026
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866917274406879232 |
|---|---|
| author | Zhang, Lijun Chacko, Nikhil Nilsson, Petter Xu, Ruinian Thakar, Shantanu Lou, Bai Sawhney, Harpreet Zhang, Zhebin Agrawal, Mudit Chandrashekhar, Bhavana Parness, Aaron |
| author_facet | Zhang, Lijun Chacko, Nikhil Nilsson, Petter Xu, Ruinian Thakar, Shantanu Lou, Bai Sawhney, Harpreet Zhang, Zhebin Agrawal, Mudit Chandrashekhar, Bhavana Parness, Aaron |
| contents | Automated warehouses execute millions of stow operations, where robots place objects into storage bins. For these systems it is valuable to anticipate how a bin will look from the current observations and the planned stow behavior before real execution. We propose FOREST, a stow-intent-conditioned world model that represents bin states as item-aligned instance masks and uses a latent diffusion transformer to predict the post-stow configuration from the observed context. Our evaluation shows that FOREST substantially improves the geometric agreement between predicted and true post-stow layouts compared with heuristic baselines. We further evaluate the predicted post-stow layouts in two downstream tasks, in which replacing the real post-stow masks with FOREST predictions causes only modest performance loss in load-quality assessment and multi-stow reasoning, indicating that our model can provide useful foresight signals for warehouse planning. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_13347 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Visual Foresight for Robotic Stow: A Diffusion-Based World Model from Sparse Snapshots Zhang, Lijun Chacko, Nikhil Nilsson, Petter Xu, Ruinian Thakar, Shantanu Lou, Bai Sawhney, Harpreet Zhang, Zhebin Agrawal, Mudit Chandrashekhar, Bhavana Parness, Aaron Computer Vision and Pattern Recognition Artificial Intelligence Robotics Automated warehouses execute millions of stow operations, where robots place objects into storage bins. For these systems it is valuable to anticipate how a bin will look from the current observations and the planned stow behavior before real execution. We propose FOREST, a stow-intent-conditioned world model that represents bin states as item-aligned instance masks and uses a latent diffusion transformer to predict the post-stow configuration from the observed context. Our evaluation shows that FOREST substantially improves the geometric agreement between predicted and true post-stow layouts compared with heuristic baselines. We further evaluate the predicted post-stow layouts in two downstream tasks, in which replacing the real post-stow masks with FOREST predictions causes only modest performance loss in load-quality assessment and multi-stow reasoning, indicating that our model can provide useful foresight signals for warehouse planning. |
| title | Visual Foresight for Robotic Stow: A Diffusion-Based World Model from Sparse Snapshots |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence Robotics |
| url | https://arxiv.org/abs/2602.13347 |