Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2022
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2203.02069 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914990134394880 |
|---|---|
| author | Ikeda, Takuya Tanishige, Suomi Amma, Ayako Sudano, Michael Audren, Hervé Nishiwaki, Koichi |
| author_facet | Ikeda, Takuya Tanishige, Suomi Amma, Ayako Sudano, Michael Audren, Hervé Nishiwaki, Koichi |
| contents | In recent years, synthetic data has been widely used in the training of 6D pose estimation networks, in part because it automatically provides perfect annotation at low cost. However, there are still non-trivial domain gaps, such as differences in textures/materials, between synthetic and real data. These gaps have a measurable impact on performance. To solve this problem, we introduce a simulation to reality (sim2real) instance-level style transfer for 6D pose estimation network training. Our approach transfers the style of target objects individually, from synthetic to real, without human intervention. This improves the quality of synthetic data for training pose estimation networks. We also propose a complete pipeline from data collection to the training of a pose estimation network and conduct extensive evaluation on a real-world robotic platform. Our evaluation shows significant improvement achieved by our method in both pose estimation performance and the realism of images adapted by the style transfer. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2203_02069 |
| institution | arXiv |
| publishDate | 2022 |
| record_format | arxiv |
| spellingShingle | Sim2Real Instance-Level Style Transfer for 6D Pose Estimation Ikeda, Takuya Tanishige, Suomi Amma, Ayako Sudano, Michael Audren, Hervé Nishiwaki, Koichi Computer Vision and Pattern Recognition Robotics In recent years, synthetic data has been widely used in the training of 6D pose estimation networks, in part because it automatically provides perfect annotation at low cost. However, there are still non-trivial domain gaps, such as differences in textures/materials, between synthetic and real data. These gaps have a measurable impact on performance. To solve this problem, we introduce a simulation to reality (sim2real) instance-level style transfer for 6D pose estimation network training. Our approach transfers the style of target objects individually, from synthetic to real, without human intervention. This improves the quality of synthetic data for training pose estimation networks. We also propose a complete pipeline from data collection to the training of a pose estimation network and conduct extensive evaluation on a real-world robotic platform. Our evaluation shows significant improvement achieved by our method in both pose estimation performance and the realism of images adapted by the style transfer. |
| title | Sim2Real Instance-Level Style Transfer for 6D Pose Estimation |
| topic | Computer Vision and Pattern Recognition Robotics |
| url | https://arxiv.org/abs/2203.02069 |