Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2509.21790 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912607776014336 |
|---|---|
| author | Shang, Yu Jin, Lei Ma, Yiding Zhang, Xin Gao, Chen Wu, Wei Li, Yong |
| author_facet | Shang, Yu Jin, Lei Ma, Yiding Zhang, Xin Gao, Chen Wu, Wei Li, Yong |
| contents | Video-based world models hold significant potential for generating high-quality embodied manipulation data. However, current video generation methods struggle to achieve stable long-horizon generation: classical diffusion-based approaches often suffer from temporal inconsistency and visual drift over multiple rollouts, while autoregressive methods tend to compromise on visual detail. To solve this, we introduce LongScape, a hybrid framework that adaptively combines intra-chunk diffusion denoising with inter-chunk autoregressive causal generation. Our core innovation is an action-guided, variable-length chunking mechanism that partitions video based on the semantic context of robotic actions. This ensures each chunk represents a complete, coherent action, enabling the model to flexibly generate diverse dynamics. We further introduce a Context-aware Mixture-of-Experts (CMoE) framework that adaptively activates specialized experts for each chunk during generation, guaranteeing high visual quality and seamless chunk transitions. Extensive experimental results demonstrate that our method achieves stable and consistent long-horizon generation over extended rollouts. Our code is available at: https://github.com/tsinghua-fib-lab/Longscape. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_21790 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | LongScape: Advancing Long-Horizon Embodied World Models with Context-Aware MoE Shang, Yu Jin, Lei Ma, Yiding Zhang, Xin Gao, Chen Wu, Wei Li, Yong Computer Vision and Pattern Recognition Video-based world models hold significant potential for generating high-quality embodied manipulation data. However, current video generation methods struggle to achieve stable long-horizon generation: classical diffusion-based approaches often suffer from temporal inconsistency and visual drift over multiple rollouts, while autoregressive methods tend to compromise on visual detail. To solve this, we introduce LongScape, a hybrid framework that adaptively combines intra-chunk diffusion denoising with inter-chunk autoregressive causal generation. Our core innovation is an action-guided, variable-length chunking mechanism that partitions video based on the semantic context of robotic actions. This ensures each chunk represents a complete, coherent action, enabling the model to flexibly generate diverse dynamics. We further introduce a Context-aware Mixture-of-Experts (CMoE) framework that adaptively activates specialized experts for each chunk during generation, guaranteeing high visual quality and seamless chunk transitions. Extensive experimental results demonstrate that our method achieves stable and consistent long-horizon generation over extended rollouts. Our code is available at: https://github.com/tsinghua-fib-lab/Longscape. |
| title | LongScape: Advancing Long-Horizon Embodied World Models with Context-Aware MoE |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2509.21790 |