Can Test-Time Scaling Improve World Foundation Model?
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909729589035008 |
|---|---|
| author | Cong, Wenyan Zhu, Hanqing Wang, Peihao Liu, Bangya Xu, Dejia Wang, Kevin Pan, David Z. Wang, Yan Fan, Zhiwen Wang, Zhangyang |
| author_facet | Cong, Wenyan Zhu, Hanqing Wang, Peihao Liu, Bangya Xu, Dejia Wang, Kevin Pan, David Z. Wang, Yan Fan, Zhiwen Wang, Zhangyang |
| contents | World foundation models, which simulate the physical world by predicting future states from current observations and inputs, have become central to many applications in physical intelligence, including autonomous driving and robotics. However, these models require substantial computational resources for pretraining and are further constrained by available data during post-training. As such, scaling computation at test time emerges as both a critical and practical alternative to traditional model enlargement or re-training. In this work, we introduce SWIFT, a test-time scaling framework tailored for WFMs. SWIFT integrates our extensible WFM evaluation toolkit with process-level inference strategies, including fast tokenization, probability-based Top-K pruning, and efficient beam search. Empirical results on the COSMOS model demonstrate that test-time scaling exists even in a compute-optimal way. Our findings reveal that test-time scaling laws hold for WFMs and that SWIFT provides a scalable and effective pathway for improving WFM inference without retraining or increasing model size. Project page: https://scalingwfm.github.io/. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_24320 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Can Test-Time Scaling Improve World Foundation Model? Cong, Wenyan Zhu, Hanqing Wang, Peihao Liu, Bangya Xu, Dejia Wang, Kevin Pan, David Z. Wang, Yan Fan, Zhiwen Wang, Zhangyang Computer Vision and Pattern Recognition World foundation models, which simulate the physical world by predicting future states from current observations and inputs, have become central to many applications in physical intelligence, including autonomous driving and robotics. However, these models require substantial computational resources for pretraining and are further constrained by available data during post-training. As such, scaling computation at test time emerges as both a critical and practical alternative to traditional model enlargement or re-training. In this work, we introduce SWIFT, a test-time scaling framework tailored for WFMs. SWIFT integrates our extensible WFM evaluation toolkit with process-level inference strategies, including fast tokenization, probability-based Top-K pruning, and efficient beam search. Empirical results on the COSMOS model demonstrate that test-time scaling exists even in a compute-optimal way. Our findings reveal that test-time scaling laws hold for WFMs and that SWIFT provides a scalable and effective pathway for improving WFM inference without retraining or increasing model size. Project page: https://scalingwfm.github.io/. |
| title | Can Test-Time Scaling Improve World Foundation Model? |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2503.24320 |