GarmentTracking: Category-Level Garment Pose Tracking
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912326976798720 |
|---|---|
| author | Xue, Han Xu, Wenqiang Zhang, Jieyi Tang, Tutian Li, Yutong Du, Wenxin Ye, Ruolin Lu, Cewu |
| author_facet | Xue, Han Xu, Wenqiang Zhang, Jieyi Tang, Tutian Li, Yutong Du, Wenxin Ye, Ruolin Lu, Cewu |
| contents | Garments are important to humans. A visual system that can estimate and track the complete garment pose can be useful for many downstream tasks and real-world applications. In this work, we present a complete package to address the category-level garment pose tracking task: (1) A recording system VR-Garment, with which users can manipulate virtual garment models in simulation through a VR interface. (2) A large-scale dataset VR-Folding, with complex garment pose configurations in manipulation like flattening and folding. (3) An end-to-end online tracking framework GarmentTracking, which predicts complete garment pose both in canonical space and task space given a point cloud sequence. Extensive experiments demonstrate that the proposed GarmentTracking achieves great performance even when the garment has large non-rigid deformation. It outperforms the baseline approach on both speed and accuracy. We hope our proposed solution can serve as a platform for future research. Codes and datasets are available in https://garment-tracking.robotflow.ai. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2303_13913 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | GarmentTracking: Category-Level Garment Pose Tracking Xue, Han Xu, Wenqiang Zhang, Jieyi Tang, Tutian Li, Yutong Du, Wenxin Ye, Ruolin Lu, Cewu Computer Vision and Pattern Recognition Robotics Garments are important to humans. A visual system that can estimate and track the complete garment pose can be useful for many downstream tasks and real-world applications. In this work, we present a complete package to address the category-level garment pose tracking task: (1) A recording system VR-Garment, with which users can manipulate virtual garment models in simulation through a VR interface. (2) A large-scale dataset VR-Folding, with complex garment pose configurations in manipulation like flattening and folding. (3) An end-to-end online tracking framework GarmentTracking, which predicts complete garment pose both in canonical space and task space given a point cloud sequence. Extensive experiments demonstrate that the proposed GarmentTracking achieves great performance even when the garment has large non-rigid deformation. It outperforms the baseline approach on both speed and accuracy. We hope our proposed solution can serve as a platform for future research. Codes and datasets are available in https://garment-tracking.robotflow.ai. |
| title | GarmentTracking: Category-Level Garment Pose Tracking |
| topic | Computer Vision and Pattern Recognition Robotics |
| url | https://arxiv.org/abs/2303.13913 |