Task-Oriented Human Grasp Synthesis via Context- and Task-Aware Diffusers

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Liu, An-Lun, Chao, Yu-Wei, Chen, Yi-Ting
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909690029408256
author Liu, An-Lun
Chao, Yu-Wei
Chen, Yi-Ting
author_facet Liu, An-Lun
Chao, Yu-Wei
Chen, Yi-Ting
contents In this paper, we study task-oriented human grasp synthesis, a new grasp synthesis task that demands both task and context awareness. At the core of our method is the task-aware contact maps. Unlike traditional contact maps that only reason about the manipulated object and its relation with the hand, our enhanced maps take into account scene and task information. This comprehensive map is critical for hand-object interaction, enabling accurate grasping poses that align with the task. We propose a two-stage pipeline that first constructs a task-aware contact map informed by the scene and task. In the subsequent stage, we use this contact map to synthesize task-oriented human grasps. We introduce a new dataset and a metric for the proposed task to evaluate our approach. Our experiments validate the importance of modeling both scene and task, demonstrating significant improvements over existing methods in both grasp quality and task performance. See our project page for more details: https://hcis-lab.github.io/TOHGS/
format Preprint
id arxiv_https___arxiv_org_abs_2507_11287
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Task-Oriented Human Grasp Synthesis via Context- and Task-Aware Diffusers
Liu, An-Lun
Chao, Yu-Wei
Chen, Yi-Ting
Computer Vision and Pattern Recognition
Robotics
In this paper, we study task-oriented human grasp synthesis, a new grasp synthesis task that demands both task and context awareness. At the core of our method is the task-aware contact maps. Unlike traditional contact maps that only reason about the manipulated object and its relation with the hand, our enhanced maps take into account scene and task information. This comprehensive map is critical for hand-object interaction, enabling accurate grasping poses that align with the task. We propose a two-stage pipeline that first constructs a task-aware contact map informed by the scene and task. In the subsequent stage, we use this contact map to synthesize task-oriented human grasps. We introduce a new dataset and a metric for the proposed task to evaluate our approach. Our experiments validate the importance of modeling both scene and task, demonstrating significant improvements over existing methods in both grasp quality and task performance. See our project page for more details: https://hcis-lab.github.io/TOHGS/
title Task-Oriented Human Grasp Synthesis via Context- and Task-Aware Diffusers
topic Computer Vision and Pattern Recognition
Robotics
url https://arxiv.org/abs/2507.11287