Cover Image

Keypoint Abstraction using Large Models for Object-Relative Imitation Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Fang, Xiaolin, Huang, Bo-Ruei, Mao, Jiayuan, Shone, Jasmine, Tenenbaum, Joshua B., Lozano-Pérez, Tomás, Kaelbling, Leslie Pack
Format:	Preprint
Published:	2024
Subjects:	Robotics Artificial Intelligence Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Embodied Uncertainty-Aware Object Segmentation
by: Fang, Xiaolin, et al.
Published: (2024)

One-Shot Manipulation Strategy Learning by Making Contact Analogies
by: Liu, Yuyao, et al.
Published: (2024)

What Planning Problems Can A Relational Neural Network Solve?
by: Mao, Jiayuan, et al.
Published: (2023)

"Set It Up!": Functional Object Arrangement with Compositional Generative Models
by: Xu, Yiqing, et al.
Published: (2024)

"Set It Up": Functional Object Arrangement with Compositional Generative Models (Journal Version)
by: Xu, Yiqing, et al.
Published: (2025)

Rational Inverse Reasoning
by: Zandonati, Ben, et al.
Published: (2025)

Partially Observable Task and Motion Planning with Uncertainty and Risk Awareness
by: Curtis, Aidan, et al.
Published: (2024)

Streaming Flow Policy: Simplifying diffusion/flow-matching policies by treating action trajectories as flow trajectories
by: Jiang, Sunshine, et al.
Published: (2025)

Predicate Invention for Bilevel Planning
by: Silver, Tom, et al.
Published: (2022)

SceneComplete: Open-World 3D Scene Completion in Cluttered Real World Environments for Robot Manipulation
by: Agarwal, Aditya, et al.
Published: (2024)

Guiding Long-Horizon Task and Motion Planning with Vision Language Models
by: Yang, Zhutian, et al.
Published: (2024)

DiMSam: Diffusion Models as Samplers for Task and Motion Planning under Partial Observability
by: Fang, Xiaolin, et al.
Published: (2023)

Trust the PRoC3S: Solving Long-Horizon Robotics Problems with LLMs and Constraint Satisfaction
by: Curtis, Aidan, et al.
Published: (2024)

Towards Practical Finite Sample Bounds for Motion Planning in TAMP
by: Shaw, Seiji, et al.
Published: (2024)

Combining Planning and Diffusion for Mobility with Unknown Dynamics
by: Ravan, Yajvan, et al.
Published: (2024)

Bi-Level Belief Space Search for Compliant Part Mating Under Uncertainty
by: Chintalapudi, Sahit, et al.
Published: (2024)

Which Reconstruction Model Should a Robot Use? Routing Image-to-3D Models for Cost-Aware Robotic Manipulation
by: Anand, Akash, et al.
Published: (2026)

Out-of-Distribution Recovery with Object-Centric Keypoint Inverse Policy for Visuomotor Imitation Learning
by: Gao, George Jiayuan, et al.
Published: (2024)

Open-World Task and Motion Planning via Vision-Language Model Generated Constraints
by: Kumar, Nishanth, et al.
Published: (2024)

Learning to Bridge the Gap: Efficient Novelty Recovery with Planning and Reinforcement Learning
by: Li, Alicia, et al.
Published: (2024)

Differentiable GPU-Parallelized Task and Motion Planning
by: Shen, William, et al.
Published: (2024)

Guided Exploration for Efficient Relational Model Learning
by: Feng, Annie, et al.
Published: (2025)

From Pixels to Predicates: Learning Symbolic World Models via Pretrained Vision-Language Models
by: Athalye, Ashay, et al.
Published: (2024)

Practice Makes Perfect: Planning to Learn Skill Parameter Policies
by: Kumar, Nishanth, et al.
Published: (2024)

TiPToP: A Modular Open-Vocabulary Planning System for Robotic Manipulation
by: Shen, William, et al.
Published: (2026)

Functional Risk Minimization
by: Alet, Ferran, et al.
Published: (2024)

Neuro-Symbolic Concepts
by: Mao, Jiayuan, et al.
Published: (2025)

LLM-Guided Probabilistic Program Induction for POMDP Model Estimation
by: Curtis, Aidan, et al.
Published: (2025)

GCS*: Forward Heuristic Search on Implicit Graphs of Convex Sets
by: Chia, Shao Yuan Chew, et al.
Published: (2024)

Compositional Generative Modeling: A Single Model is Not All You Need
by: Du, Yilun, et al.
Published: (2024)

Learning Planning Abstractions from Language
by: Liu, Weiyu, et al.
Published: (2024)

On the Generalization Capabilities, Design Choices and Limitations of Keypoint Imitation Learning
by: Lips, Thomas, et al.
Published: (2026)

Seeing is Believing: Belief-Space Planning with Foundation Models as Uncertainty Estimators
by: Zhao, Linfeng, et al.
Published: (2025)

Distilled Feature Fields Enable Few-Shot Language-Guided Manipulation
by: Shen, William, et al.
Published: (2023)

Flow-based Domain Randomization for Learning and Sequencing Robotic Skills
by: Curtis, Aidan, et al.
Published: (2025)

Bi-KVIL: Keypoints-based Visual Imitation Learning of Bimanual Manipulation Tasks
by: Gao, Jianfeng, et al.
Published: (2024)

Visuo-Tactile Keypoint Correspondences for Object Manipulation
by: Kim, Jeong-Jung, et al.
Published: (2024)

SKIL: Semantic Keypoint Imitation Learning for Generalizable Data-efficient Manipulation
by: Wang, Shengjie, et al.
Published: (2025)

Keypoint Action Tokens Enable In-Context Imitation Learning in Robotics
by: Di Palo, Norman, et al.
Published: (2024)

Gentle Object Retraction in Dense Clutter Using Multimodal Force Sensing and Imitation Learning
by: Brouwer, Dane, et al.
Published: (2025)