EvolvingGrasp: Evolutionary Grasp Generation via Efficient Preference Alignment

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhu, Yufei, Zhong, Yiming, Yang, Zemin, Cong, Peishan, Yu, Jingyi, Zhu, Xinge, Ma, Yuexin
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912282024345600
author Zhu, Yufei
Zhong, Yiming
Yang, Zemin
Cong, Peishan
Yu, Jingyi
Zhu, Xinge
Ma, Yuexin
author_facet Zhu, Yufei
Zhong, Yiming
Yang, Zemin
Cong, Peishan
Yu, Jingyi
Zhu, Xinge
Ma, Yuexin
contents Dexterous robotic hands often struggle to generalize effectively in complex environments due to the limitations of models trained on low-diversity data. However, the real world presents an inherently unbounded range of scenarios, making it impractical to account for every possible variation. A natural solution is to enable robots learning from experience in complex environments, an approach akin to evolution, where systems improve through continuous feedback, learning from both failures and successes, and iterating toward optimal performance. Motivated by this, we propose EvolvingGrasp, an evolutionary grasp generation method that continuously enhances grasping performance through efficient preference alignment. Specifically, we introduce Handpose wise Preference Optimization (HPO), which allows the model to continuously align with preferences from both positive and negative feedback while progressively refining its grasping strategies. To further enhance efficiency and reliability during online adjustments, we incorporate a Physics-aware Consistency Model within HPO, which accelerates inference, reduces the number of timesteps needed for preference finetuning, and ensures physical plausibility throughout the process. Extensive experiments across four benchmark datasets demonstrate state of the art performance of our method in grasp success rate and sampling efficiency. Our results validate that EvolvingGrasp enables evolutionary grasp generation, ensuring robust, physically feasible, and preference-aligned grasping in both simulation and real scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2503_14329
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle EvolvingGrasp: Evolutionary Grasp Generation via Efficient Preference Alignment
Zhu, Yufei
Zhong, Yiming
Yang, Zemin
Cong, Peishan
Yu, Jingyi
Zhu, Xinge
Ma, Yuexin
Computer Vision and Pattern Recognition
Dexterous robotic hands often struggle to generalize effectively in complex environments due to the limitations of models trained on low-diversity data. However, the real world presents an inherently unbounded range of scenarios, making it impractical to account for every possible variation. A natural solution is to enable robots learning from experience in complex environments, an approach akin to evolution, where systems improve through continuous feedback, learning from both failures and successes, and iterating toward optimal performance. Motivated by this, we propose EvolvingGrasp, an evolutionary grasp generation method that continuously enhances grasping performance through efficient preference alignment. Specifically, we introduce Handpose wise Preference Optimization (HPO), which allows the model to continuously align with preferences from both positive and negative feedback while progressively refining its grasping strategies. To further enhance efficiency and reliability during online adjustments, we incorporate a Physics-aware Consistency Model within HPO, which accelerates inference, reduces the number of timesteps needed for preference finetuning, and ensures physical plausibility throughout the process. Extensive experiments across four benchmark datasets demonstrate state of the art performance of our method in grasp success rate and sampling efficiency. Our results validate that EvolvingGrasp enables evolutionary grasp generation, ensuring robust, physically feasible, and preference-aligned grasping in both simulation and real scenarios.
title EvolvingGrasp: Evolutionary Grasp Generation via Efficient Preference Alignment
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.14329