Find the Fruit: Zero-Shot Sim2Real RL for Occlusion-Aware Plant Manipulation
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866917287135543296 |
|---|---|
| author | Subedi, Nitesh Yang, Hsin-Jung Jha, Devesh K. Sarkar, Soumik |
| author_facet | Subedi, Nitesh Yang, Hsin-Jung Jha, Devesh K. Sarkar, Soumik |
| contents | Autonomous harvesting in the open presents a complex manipulation problem. In most scenarios, an autonomous system has to deal with significant occlusion and require interaction in the presence of large structural uncertainties (every plant is different). Perceptual and modeling uncertainty make design of reliable manipulation controllers for harvesting challenging, resulting in poor performance during deployment. We present a sim2real reinforcement learning (RL) framework for occlusion-aware plant manipulation, where a policy is learned entirely in simulation to reposition stems and leaves to reveal target fruit(s). In our proposed approach, we decouple high-level kinematic planning from low-level compliant control which simplifies the sim2real transfer. This decomposition allows the learned policy to generalize across multiple plants with different stiffness and morphology. In experiments with multiple real-world plant setups, our system achieves up to 86.7% success in exposing target fruits, demonstrating robustness to occlusion variation and structural uncertainty. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_16547 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Find the Fruit: Zero-Shot Sim2Real RL for Occlusion-Aware Plant Manipulation Subedi, Nitesh Yang, Hsin-Jung Jha, Devesh K. Sarkar, Soumik Robotics Artificial Intelligence Autonomous harvesting in the open presents a complex manipulation problem. In most scenarios, an autonomous system has to deal with significant occlusion and require interaction in the presence of large structural uncertainties (every plant is different). Perceptual and modeling uncertainty make design of reliable manipulation controllers for harvesting challenging, resulting in poor performance during deployment. We present a sim2real reinforcement learning (RL) framework for occlusion-aware plant manipulation, where a policy is learned entirely in simulation to reposition stems and leaves to reveal target fruit(s). In our proposed approach, we decouple high-level kinematic planning from low-level compliant control which simplifies the sim2real transfer. This decomposition allows the learned policy to generalize across multiple plants with different stiffness and morphology. In experiments with multiple real-world plant setups, our system achieves up to 86.7% success in exposing target fruits, demonstrating robustness to occlusion variation and structural uncertainty. |
| title | Find the Fruit: Zero-Shot Sim2Real RL for Occlusion-Aware Plant Manipulation |
| topic | Robotics Artificial Intelligence |
| url | https://arxiv.org/abs/2505.16547 |