GroundingSuite: Measuring Complex Multi-Granular Pixel Grounding
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866916844321898496 |
|---|---|
| author | Hu, Rui Zhu, Lianghui Zhang, Yuxuan Cheng, Tianheng Liu, Lei Liu, Heng Ran, Longjin Chen, Xiaoxin Liu, Wenyu Wang, Xinggang |
| author_facet | Hu, Rui Zhu, Lianghui Zhang, Yuxuan Cheng, Tianheng Liu, Lei Liu, Heng Ran, Longjin Chen, Xiaoxin Liu, Wenyu Wang, Xinggang |
| contents | Pixel grounding, encompassing tasks such as Referring Expression Segmentation (RES), has garnered considerable attention due to its immense potential for bridging the gap between vision and language modalities. However, advancements in this domain are currently constrained by limitations inherent in existing datasets, including limited object categories, insufficient textual diversity, and a scarcity of high-quality annotations. To mitigate these limitations, we introduce GroundingSuite, which comprises: (1) an automated data annotation framework leveraging multiple Vision-Language Model (VLM) agents; (2) a large-scale training dataset encompassing 9.56 million diverse referring expressions and their corresponding segmentations; and (3) a meticulously curated evaluation benchmark consisting of 3,800 images. The GroundingSuite training dataset facilitates substantial performance improvements, enabling models trained on it to achieve state-of-the-art results. Specifically, a cIoU of 68.9 on gRefCOCO and a gIoU of 55.3 on RefCOCOm. Moreover, the GroundingSuite annotation framework demonstrates superior efficiency compared to the current leading data annotation method, i.e., $4.5 \times$ faster than GLaMM. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_10596 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | GroundingSuite: Measuring Complex Multi-Granular Pixel Grounding Hu, Rui Zhu, Lianghui Zhang, Yuxuan Cheng, Tianheng Liu, Lei Liu, Heng Ran, Longjin Chen, Xiaoxin Liu, Wenyu Wang, Xinggang Computer Vision and Pattern Recognition Pixel grounding, encompassing tasks such as Referring Expression Segmentation (RES), has garnered considerable attention due to its immense potential for bridging the gap between vision and language modalities. However, advancements in this domain are currently constrained by limitations inherent in existing datasets, including limited object categories, insufficient textual diversity, and a scarcity of high-quality annotations. To mitigate these limitations, we introduce GroundingSuite, which comprises: (1) an automated data annotation framework leveraging multiple Vision-Language Model (VLM) agents; (2) a large-scale training dataset encompassing 9.56 million diverse referring expressions and their corresponding segmentations; and (3) a meticulously curated evaluation benchmark consisting of 3,800 images. The GroundingSuite training dataset facilitates substantial performance improvements, enabling models trained on it to achieve state-of-the-art results. Specifically, a cIoU of 68.9 on gRefCOCO and a gIoU of 55.3 on RefCOCOm. Moreover, the GroundingSuite annotation framework demonstrates superior efficiency compared to the current leading data annotation method, i.e., $4.5 \times$ faster than GLaMM. |
| title | GroundingSuite: Measuring Complex Multi-Granular Pixel Grounding |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2503.10596 |