UniFS: Universal Few-shot Instance Perception with Point Representations
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929426902548480 |
|---|---|
| author | Jin, Sheng Yao, Ruijie Xu, Lumin Liu, Wentao Qian, Chen Wu, Ji Luo, Ping |
| author_facet | Jin, Sheng Yao, Ruijie Xu, Lumin Liu, Wentao Qian, Chen Wu, Ji Luo, Ping |
| contents | Instance perception tasks (object detection, instance segmentation, pose estimation, counting) play a key role in industrial applications of visual models. As supervised learning methods suffer from high labeling cost, few-shot learning methods which effectively learn from a limited number of labeled examples are desired. Existing few-shot learning methods primarily focus on a restricted set of tasks, presumably due to the challenges involved in designing a generic model capable of representing diverse tasks in a unified manner. In this paper, we propose UniFS, a universal few-shot instance perception model that unifies a wide range of instance perception tasks by reformulating them into a dynamic point representation learning framework. Additionally, we propose Structure-Aware Point Learning (SAPL) to exploit the higher-order structural relationship among points to further enhance representation learning. Our approach makes minimal assumptions about the tasks, yet it achieves competitive results compared to highly specialized and well optimized specialist models. Codes and data are available at https://github.com/jin-s13/UniFS. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_19401 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | UniFS: Universal Few-shot Instance Perception with Point Representations Jin, Sheng Yao, Ruijie Xu, Lumin Liu, Wentao Qian, Chen Wu, Ji Luo, Ping Computer Vision and Pattern Recognition Instance perception tasks (object detection, instance segmentation, pose estimation, counting) play a key role in industrial applications of visual models. As supervised learning methods suffer from high labeling cost, few-shot learning methods which effectively learn from a limited number of labeled examples are desired. Existing few-shot learning methods primarily focus on a restricted set of tasks, presumably due to the challenges involved in designing a generic model capable of representing diverse tasks in a unified manner. In this paper, we propose UniFS, a universal few-shot instance perception model that unifies a wide range of instance perception tasks by reformulating them into a dynamic point representation learning framework. Additionally, we propose Structure-Aware Point Learning (SAPL) to exploit the higher-order structural relationship among points to further enhance representation learning. Our approach makes minimal assumptions about the tasks, yet it achieves competitive results compared to highly specialized and well optimized specialist models. Codes and data are available at https://github.com/jin-s13/UniFS. |
| title | UniFS: Universal Few-shot Instance Perception with Point Representations |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2404.19401 |