LIVE: Long-horizon Interactive Video World Modeling

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Huang, Junchao, Ye, Ziyang, Hu, Xinting, He, Tianyu, Zhang, Guiyu, Shi, Shaoshuai, Bian, Jiang, Jiang, Li
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911419767717888
author Huang, Junchao
Ye, Ziyang
Hu, Xinting
He, Tianyu
Zhang, Guiyu
Shi, Shaoshuai
Bian, Jiang
Jiang, Li
author_facet Huang, Junchao
Ye, Ziyang
Hu, Xinting
He, Tianyu
Zhang, Guiyu
Shi, Shaoshuai
Bian, Jiang
Jiang, Li
contents Autoregressive video world models predict future visual observations conditioned on actions. While effective over short horizons, these models often struggle with long-horizon generation, as small prediction errors accumulate over time. Prior methods alleviate this by introducing pre-trained teacher models and sequence-level distribution matching, which incur additional computational cost and fail to prevent error propagation beyond the training horizon. In this work, we propose LIVE, a Long-horizon Interactive Video world modEl that enforces bounded error accumulation via a novel cycle-consistency objective, thereby eliminating the need for teacher-based distillation. Specifically, LIVE first performs a forward rollout from ground-truth frames and then applies a reverse generation process to reconstruct the initial state. The diffusion loss is subsequently computed on the reconstructed terminal state, providing an explicit constraint on long-horizon error propagation. Moreover, we provide an unified view that encompasses different approaches and introduce progressive training curriculum to stabilize training. Experiments demonstrate that LIVE achieves state-of-the-art performance on long-horizon benchmarks, generating stable, high-quality videos far beyond training rollout lengths.
format Preprint
id arxiv_https___arxiv_org_abs_2602_03747
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle LIVE: Long-horizon Interactive Video World Modeling
Huang, Junchao
Ye, Ziyang
Hu, Xinting
He, Tianyu
Zhang, Guiyu
Shi, Shaoshuai
Bian, Jiang
Jiang, Li
Computer Vision and Pattern Recognition
Autoregressive video world models predict future visual observations conditioned on actions. While effective over short horizons, these models often struggle with long-horizon generation, as small prediction errors accumulate over time. Prior methods alleviate this by introducing pre-trained teacher models and sequence-level distribution matching, which incur additional computational cost and fail to prevent error propagation beyond the training horizon. In this work, we propose LIVE, a Long-horizon Interactive Video world modEl that enforces bounded error accumulation via a novel cycle-consistency objective, thereby eliminating the need for teacher-based distillation. Specifically, LIVE first performs a forward rollout from ground-truth frames and then applies a reverse generation process to reconstruct the initial state. The diffusion loss is subsequently computed on the reconstructed terminal state, providing an explicit constraint on long-horizon error propagation. Moreover, we provide an unified view that encompasses different approaches and introduce progressive training curriculum to stabilize training. Experiments demonstrate that LIVE achieves state-of-the-art performance on long-horizon benchmarks, generating stable, high-quality videos far beyond training rollout lengths.
title LIVE: Long-horizon Interactive Video World Modeling
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2602.03747