Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2412.13173 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929635478994944 |
|---|---|
| author | Li, Siqi Chen, Xiaoxue Cheng, Haoyu Zhou, Guyue Zhao, Hao Tian, Guanzhong |
| author_facet | Li, Siqi Chen, Xiaoxue Cheng, Haoyu Zhou, Guyue Zhao, Hao Tian, Guanzhong |
| contents | Detecting the openable parts of articulated objects is crucial for downstream applications in intelligent robotics, such as pulling a drawer. This task poses a multitasking challenge due to the necessity of understanding object categories and motion. Most existing methods are either category-specific or trained on specific datasets, lacking generalization to unseen environments and objects. In this paper, we propose a Transformer-based Openable Part Detection (OPD) framework named Multi-feature Openable Part Detection (MOPD) that incorporates perceptual grouping and geometric priors, outperforming previous methods in performance. In the first stage of the framework, we introduce a perceptual grouping feature model that provides perceptual grouping feature priors for openable part detection, enhancing detection results through a cross-attention mechanism. In the second stage, a geometric understanding feature model offers geometric feature priors for predicting motion parameters. Compared to existing methods, our proposed approach shows better performance in both detection and motion parameter prediction. Codes and models are publicly available at https://github.com/lisiqi-zju/MOPD |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_13173 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Locate n' Rotate: Two-stage Openable Part Detection with Foundation Model Priors Li, Siqi Chen, Xiaoxue Cheng, Haoyu Zhou, Guyue Zhao, Hao Tian, Guanzhong Computer Vision and Pattern Recognition Detecting the openable parts of articulated objects is crucial for downstream applications in intelligent robotics, such as pulling a drawer. This task poses a multitasking challenge due to the necessity of understanding object categories and motion. Most existing methods are either category-specific or trained on specific datasets, lacking generalization to unseen environments and objects. In this paper, we propose a Transformer-based Openable Part Detection (OPD) framework named Multi-feature Openable Part Detection (MOPD) that incorporates perceptual grouping and geometric priors, outperforming previous methods in performance. In the first stage of the framework, we introduce a perceptual grouping feature model that provides perceptual grouping feature priors for openable part detection, enhancing detection results through a cross-attention mechanism. In the second stage, a geometric understanding feature model offers geometric feature priors for predicting motion parameters. Compared to existing methods, our proposed approach shows better performance in both detection and motion parameter prediction. Codes and models are publicly available at https://github.com/lisiqi-zju/MOPD |
| title | Locate n' Rotate: Two-stage Openable Part Detection with Foundation Model Priors |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2412.13173 |