Cover Image

KUDA: Keypoints to Unify Dynamics Learning and Visual Prompting for Open-Vocabulary Robotic Manipulation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Liu, Zixian, Zhang, Mingtong, Li, Yunzhu
Format:	Preprint
Published:	2025
Subjects:	Robotics Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Dynamic 3D Gaussian Tracking for Graph-Based Neural Dynamics Modeling
by: Zhang, Mingtong, et al.
Published: (2024)

ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulation
by: Huang, Wenlong, et al.
Published: (2024)

MOKA: Open-World Robotic Manipulation through Mark-Based Visual Prompting
by: Liu, Fangchen, et al.
Published: (2024)

A Real-to-Sim-to-Real Approach to Robotic Manipulation with VLM-Generated Iterative Keypoint Rewards
by: Patel, Shivansh, et al.
Published: (2025)

Localized Graph-Based Neural Dynamics Models for Terrain Manipulation
by: Liu, Chaoqi, et al.
Published: (2025)

FlexiTac: A Low-Cost, Open-Source, Scalable Tactile Sensing Solution for Robotic Systems
by: Huang, Binghao, et al.
Published: (2026)

HomeRobot: Open-Vocabulary Mobile Manipulation
by: Yenamandra, Sriram, et al.
Published: (2023)

Learning Coordinated Bimanual Manipulation Policies using State Diffusion and Inverse Dynamics Models
by: Chen, Haonan, et al.
Published: (2025)

Toward Generalist Neural Motion Planners for Robotic Manipulators: Challenges and Opportunities
by: Soleymanzadeh, Davood, et al.
Published: (2026)

SKIL: Semantic Keypoint Imitation Learning for Generalizable Data-efficient Manipulation
by: Wang, Shengjie, et al.
Published: (2025)

Touch in the Wild: Learning Fine-Grained Manipulation with a Portable Visuo-Tactile Gripper
by: Zhu, Xinyue, et al.
Published: (2025)

CLASP: General-Purpose Clothes Manipulation with Semantic Keypoints
by: Deng, Yuhong, et al.
Published: (2025)

Open-Vocabulary Action Localization with Iterative Visual Prompting
by: Wake, Naoki, et al.
Published: (2024)

General-purpose Clothes Manipulation with Semantic Keypoints
by: Deng, Yuhong, et al.
Published: (2024)

BINDER: Instantly Adaptive Mobile Manipulation with Open-Vocabulary Commands
by: Cho, Seongwon, et al.
Published: (2025)

AFFORD2ACT: Affordance-Guided Automatic Keypoint Selection for Generalizable and Lightweight Robotic Manipulation
by: Singh, Anukriti, et al.
Published: (2025)

Visual Prompting for Robotic Manipulation with Annotation-Guided Pick-and-Place Using ACT
by: Muttaqien, Muhammad A., et al.
Published: (2025)

IMPASTO: Integrating Model-Based Planning with Learned Dynamics Models for Robotic Oil Painting Reproduction
by: Wang, Yingke, et al.
Published: (2026)

Open-Vocabulary Spatio-Temporal Scene Graph for Robot Perception and Teleoperation Planning
by: Wang, Yi, et al.
Published: (2025)

Efficient Sensorimotor Learning for Open-world Robot Manipulation
by: Zhu, Yifeng
Published: (2025)

Learning Structural Latent Points for Efficient Visual Representations in Robotic Manipulation
by: Jiang, Yicheng, et al.
Published: (2026)

Keypoint-based Diffusion for Robotic Motion Planning on the NICOL Robot
by: Clasmeier, Lennart, et al.
Published: (2025)

HiFi-CS: Towards Open Vocabulary Visual Grounding For Robotic Grasping Using Vision-Language Models
by: Bhat, Vineet, et al.
Published: (2024)

Hierarchical Audio-Visual-Proprioceptive Fusion for Precise Robotic Manipulation
by: Li, Siyuan, et al.
Published: (2026)

Robotic Manipulation by Imitating Generated Videos Without Physical Demonstrations
by: Patel, Shivansh, et al.
Published: (2025)

3D-ViTac: Learning Fine-Grained Manipulation with Visuo-Tactile Sensing
by: Huang, Binghao, et al.
Published: (2024)

Affordance-Guided Coarse-to-Fine Exploration for Base Placement in Open-Vocabulary Mobile Manipulation
by: Lin, Tzu-Jung, et al.
Published: (2025)

Tool-as-Interface: Learning Robot Policies from Observing Human Tool Use
by: Chen, Haonan, et al.
Published: (2025)

Lifelong Language-Conditioned Robotic Manipulation Learning
by: Wang, Xudong, et al.
Published: (2026)

Visual Prompt Guided Unified Pushing Policy
by: Bui, Hieu, et al.
Published: (2026)

SKT: Integrating State-Aware Keypoint Trajectories with Vision-Language Models for Robotic Garment Manipulation
by: Li, Xin, et al.
Published: (2024)

SkiP: When to Skip and When to Refine for Efficient Robot Manipulation
by: Dai, Mingtong, et al.
Published: (2026)

Scaling Manipulation Learning with Visual Kinematic Chain Prediction
by: Zhang, Xinyu, et al.
Published: (2024)

Robots of the Lost Arc: Self-Supervised Learning to Dynamically Manipulate Fixed-Endpoint Cables
by: Zhang, Harry, et al.
Published: (2020)

ManipDreamer: Boosting Robotic Manipulation World Model with Action Tree and Visual Guidance
by: Li, Ying, et al.
Published: (2025)

EmbodiedMAE: A Unified 3D Multi-Modal Representation for Robot Manipulation
by: Dong, Zibin, et al.
Published: (2025)

Robot Air Hockey: A Manipulation Testbed for Robot Learning with Reinforcement Learning
by: Chuck, Caleb, et al.
Published: (2024)

Mastering Robot Manipulation with Multimodal Prompts through Pretraining and Multi-task Fine-tuning
by: Li, Jiachen, et al.
Published: (2023)

VacuumVLA: Boosting VLA Capabilities via a Unified Suction and Gripping Tool for Complex Robotic Manipulation
by: Zhou, Hui, et al.
Published: (2025)

OpenObject-NAV: Open-Vocabulary Object-Oriented Navigation Based on Dynamic Carrier-Relationship Scene Graph
by: Tang, Yujie, et al.
Published: (2024)