MorphGS: Morphology-Adaptive Articulated 3D Motion Transfer from Videos

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Kim, Taeyeon, Na, Youngju, Lee, Jumin, Lee, Sebin, Sung, Minhyuk, Yoon, Sung-Eui
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866918389026390016
author Kim, Taeyeon
Na, Youngju
Lee, Jumin
Lee, Sebin
Sung, Minhyuk
Yoon, Sung-Eui
author_facet Kim, Taeyeon
Na, Youngju
Lee, Jumin
Lee, Sebin
Sung, Minhyuk
Yoon, Sung-Eui
contents Transferring articulated motion from monocular videos to rigged 3D characters is challenging due to pose ambiguity in 2D observations and morphological differences between source and target. Existing approaches often follow a reconstruct-then-retarget paradigm, tying transfer quality to intermediate 3D reconstruction and limiting applicability to categories with parametric templates. We propose MorphGS, a framework that formulates motion retargeting as a target-driven analysis-by-synthesis problem, directly optimizing target morphology and pose through image-space supervision. A rig-coupled morphology parameterization factorizes character identity from time-varying joint rotations, while dense 2D-3D correspondences and synthesized views provide complementary structural and multi-view guidance. Experiments on synthetic benchmarks and in-the-wild videos show consistent improvements over baselines.
format Preprint
id arxiv_https___arxiv_org_abs_2601_02716
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle MorphGS: Morphology-Adaptive Articulated 3D Motion Transfer from Videos
Kim, Taeyeon
Na, Youngju
Lee, Jumin
Lee, Sebin
Sung, Minhyuk
Yoon, Sung-Eui
Computer Vision and Pattern Recognition
Transferring articulated motion from monocular videos to rigged 3D characters is challenging due to pose ambiguity in 2D observations and morphological differences between source and target. Existing approaches often follow a reconstruct-then-retarget paradigm, tying transfer quality to intermediate 3D reconstruction and limiting applicability to categories with parametric templates. We propose MorphGS, a framework that formulates motion retargeting as a target-driven analysis-by-synthesis problem, directly optimizing target morphology and pose through image-space supervision. A rig-coupled morphology parameterization factorizes character identity from time-varying joint rotations, while dense 2D-3D correspondences and synthesized views provide complementary structural and multi-view guidance. Experiments on synthetic benchmarks and in-the-wild videos show consistent improvements over baselines.
title MorphGS: Morphology-Adaptive Articulated 3D Motion Transfer from Videos
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2601.02716