Cover Image

Learning from Massive Human Videos for Universal Humanoid Pose Control

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Mao, Jiageng, Zhao, Siheng, Song, Siqi, Shi, Tianheng, Ye, Junjie, Zhang, Mingtong, Geng, Haoran, Malik, Jitendra, Guizilini, Vitor, Wang, Yue
Format:	Preprint
Published:	2024
Subjects:	Robotics Artificial Intelligence Computation and Language Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

D-REX: Differentiable Real-to-Sim-to-Real Engine for Learning Dexterous Grasping
by: Lou, Haozhe, et al.
Published: (2026)

DreamPlan: Efficient Reinforcement Fine-Tuning of Vision-Language Planners via Video World Models
by: Jia, Emily Yue-Ting, et al.
Published: (2026)

PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understanding
by: Chow, Wei, et al.
Published: (2025)

Robot Learning from Any Images
by: Zhao, Siheng, et al.
Published: (2025)

RAM: Retrieval-Based Affordance Transfer for Generalizable Zero-Shot Robotic Manipulation
by: Kuang, Yuxuan, et al.
Published: (2024)

A Language Agent for Autonomous Driving
by: Mao, Jiageng, et al.
Published: (2023)

AnchorDream: Repurposing Video Diffusion for Embodiment-Aware Robot Data Synthesis
by: Ye, Junjie, et al.
Published: (2025)

Towards Realistic Scene Generation with LiDAR Diffusion Models
by: Ran, Haoxi, et al.
Published: (2024)

X-Humanoid: Robotize Human Videos to Generate Humanoid Videos at Scale
by: Yang, Pei, et al.
Published: (2025)

Humanoid Everyday: A Comprehensive Robotic Dataset for Open-World Humanoid Manipulation
by: Zhao, Zhenyu, et al.
Published: (2025)

Large Video Planner Enables Generalizable Robot Control
by: Chen, Boyuan, et al.
Published: (2025)

Humanoid Locomotion as Next Token Prediction
by: Radosavovic, Ilija, et al.
Published: (2024)

SIRE: SE(3) Intrinsic Rigidity Embeddings
by: Smith, Cameron, et al.
Published: (2025)

Visual Imitation Enables Contextual Humanoid Control
by: Allshire, Arthur, et al.
Published: (2025)

Fiducial Exoskeletons: Image-Centric Robot State Estimation
by: Smith, Cameron, et al.
Published: (2026)

SeFA-Policy: Fast and Accurate Visuomotor Policy Learning with Selective Flow Alignment
by: Xue, Rong, et al.
Published: (2025)

DisPose: Disentangling Pose Guidance for Controllable Human Image Animation
by: Li, Hongxiang, et al.
Published: (2024)

Learning Temporally Consistent Video Depth from Video Diffusion Priors
by: Shao, Jiahao, et al.
Published: (2024)

Human-level 3D shape perception emerges from multi-view learning
by: Bonnen, Tyler, et al.
Published: (2026)

Large Reward Models: Generalizable Online Robot Reward Generation with Vision-Language Models
by: Wu, Yanru, et al.
Published: (2026)

Sim-to-Real Reinforcement Learning for Vision-Based Dexterous Manipulation on Humanoids
by: Lin, Toru, et al.
Published: (2025)

Self-Supervised Geometry-Guided Initialization for Robust Monocular Visual Odometry
by: Kanai, Takayuki, et al.
Published: (2024)

Adaptive Human Trajectory Prediction via Latent Corridors
by: Thakkar, Neerja, et al.
Published: (2023)

Robot Learning from a Physical World Model
by: Mao, Jiageng, et al.
Published: (2025)

Reconstructing Hand-Held Objects in 3D from Images and Videos
by: Wu, Jane, et al.
Published: (2024)

Rodrigues Network for Learning Robot Actions
by: Zhang, Jialiang, et al.
Published: (2025)

RoboDream: Compositional World Models for Scalable Robot Data Synthesis
by: Ye, Junjie, et al.
Published: (2026)

Humanoid-VLA: Towards Universal Humanoid Control with Visual Integration
by: Ding, Pengxiang, et al.
Published: (2025)

SUGAR: A Scalable Human-Video-Driven Generalizable Humanoid Loco-Manipulation Learning Framework
by: Wu, Tianshu, et al.
Published: (2026)

PoseGen: In-Context LoRA Finetuning for Pose-Controllable Long Human Video Generation
by: He, Jingxuan, et al.
Published: (2025)

From Generated Human Videos to Physically Plausible Robot Trajectories
by: Ni, James, et al.
Published: (2025)

GRIN: Zero-Shot Metric Depth with Pixel-Level Diffusion
by: Guizilini, Vitor, et al.
Published: (2024)

Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videos
by: Ma, Yue, et al.
Published: (2023)

Learning an Implicit Physics Model for Image-based Fluid Simulation
by: Jia, Emily Yue-Ting, et al.
Published: (2025)

PoseCrafter: Extreme Pose Estimation with Hybrid Video Synthesis
by: Mao, Qing, et al.
Published: (2025)

PoseTraj: Pose-Aware Trajectory Control in Video Diffusion
by: Ji, Longbin, et al.
Published: (2025)

AvatarPose: Avatar-guided 3D Pose Estimation of Close Human Interaction from Sparse Multi-view Videos
by: Lu, Feichi, et al.
Published: (2024)

ECHO: Edge-Cloud Humanoid Orchestration for Language-to-Motion Control
by: Jia, Haozhe, et al.
Published: (2026)

PDF-HR: Pose Distance Fields for Humanoid Robots
by: Gu, Yi, et al.
Published: (2026)

HumanDiT: Pose-Guided Diffusion Transformer for Long-form Human Motion Video Generation
by: Gan, Qijun, et al.
Published: (2025)