MoRe: Motion-aware Feed-forward 4D Reconstruction Transformer

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Fang, Juntong, Chen, Zequn, Zhang, Weiqi, Di, Donglin, Zhang, Xuancheng, Yang, Chengmin, Liu, Yu-Shen
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911492285136896
author Fang, Juntong
Chen, Zequn
Zhang, Weiqi
Di, Donglin
Zhang, Xuancheng
Yang, Chengmin
Liu, Yu-Shen
author_facet Fang, Juntong
Chen, Zequn
Zhang, Weiqi
Di, Donglin
Zhang, Xuancheng
Yang, Chengmin
Liu, Yu-Shen
contents Reconstructing dynamic 4D scenes remains challenging due to the presence of moving objects that corrupt camera pose estimation. Existing optimization methods alleviate this issue with additional supervision, but they are mostly computationally expensive and impractical in real-time applications. To address these limitations, we propose MoRe, a feedforward 4D reconstruction network that efficiently recovers dynamic 3D scenes from monocular videos. Built upon a strong static reconstruction backbone, MoRe employs an attention-forcing strategy to disentangle dynamic motion from static structure. To further enhance robustness, we fine-tune the model on large-scale, diverse datasets encompassing both dynamic and static scenes. Moreover, our grouped causal attention captures temporal dependencies and adapts to varying token lengths across frames, ensuring temporally coherent geometry reconstruction. Extensive experiments on multiple benchmarks demonstrate that MoRe achieves high-quality dynamic reconstructions with exceptional efficiency.
format Preprint
id arxiv_https___arxiv_org_abs_2603_05078
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle MoRe: Motion-aware Feed-forward 4D Reconstruction Transformer
Fang, Juntong
Chen, Zequn
Zhang, Weiqi
Di, Donglin
Zhang, Xuancheng
Yang, Chengmin
Liu, Yu-Shen
Computer Vision and Pattern Recognition
Reconstructing dynamic 4D scenes remains challenging due to the presence of moving objects that corrupt camera pose estimation. Existing optimization methods alleviate this issue with additional supervision, but they are mostly computationally expensive and impractical in real-time applications. To address these limitations, we propose MoRe, a feedforward 4D reconstruction network that efficiently recovers dynamic 3D scenes from monocular videos. Built upon a strong static reconstruction backbone, MoRe employs an attention-forcing strategy to disentangle dynamic motion from static structure. To further enhance robustness, we fine-tune the model on large-scale, diverse datasets encompassing both dynamic and static scenes. Moreover, our grouped causal attention captures temporal dependencies and adapts to varying token lengths across frames, ensuring temporally coherent geometry reconstruction. Extensive experiments on multiple benchmarks demonstrate that MoRe achieves high-quality dynamic reconstructions with exceptional efficiency.
title MoRe: Motion-aware Feed-forward 4D Reconstruction Transformer
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2603.05078