Enregistré dans:
| Auteurs principaux: | , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | https://arxiv.org/abs/2405.10300 |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866914818718433280 |
|---|---|
| author | Ren, Tianhe Jiang, Qing Liu, Shilong Zeng, Zhaoyang Liu, Wenlong Gao, Han Huang, Hongjie Ma, Zhengyu Jiang, Xiaoke Chen, Yihao Xiong, Yuda Zhang, Hao Li, Feng Tang, Peijun Yu, Kent Zhang, Lei |
| author_facet | Ren, Tianhe Jiang, Qing Liu, Shilong Zeng, Zhaoyang Liu, Wenlong Gao, Han Huang, Hongjie Ma, Zhengyu Jiang, Xiaoke Chen, Yihao Xiong, Yuda Zhang, Hao Li, Feng Tang, Peijun Yu, Kent Zhang, Lei |
| contents | This paper introduces Grounding DINO 1.5, a suite of advanced open-set object detection models developed by IDEA Research, which aims to advance the "Edge" of open-set object detection. The suite encompasses two models: Grounding DINO 1.5 Pro, a high-performance model designed for stronger generalization capability across a wide range of scenarios, and Grounding DINO 1.5 Edge, an efficient model optimized for faster speed demanded in many applications requiring edge deployment. The Grounding DINO 1.5 Pro model advances its predecessor by scaling up the model architecture, integrating an enhanced vision backbone, and expanding the training dataset to over 20 million images with grounding annotations, thereby achieving a richer semantic understanding. The Grounding DINO 1.5 Edge model, while designed for efficiency with reduced feature scales, maintains robust detection capabilities by being trained on the same comprehensive dataset. Empirical results demonstrate the effectiveness of Grounding DINO 1.5, with the Grounding DINO 1.5 Pro model attaining a 54.3 AP on the COCO detection benchmark and a 55.7 AP on the LVIS-minival zero-shot transfer benchmark, setting new records for open-set object detection. Furthermore, the Grounding DINO 1.5 Edge model, when optimized with TensorRT, achieves a speed of 75.2 FPS while attaining a zero-shot performance of 36.2 AP on the LVIS-minival benchmark, making it more suitable for edge computing scenarios. Model examples and demos with API will be released at https://github.com/IDEA-Research/Grounding-DINO-1.5-API |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_10300 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Grounding DINO 1.5: Advance the "Edge" of Open-Set Object Detection Ren, Tianhe Jiang, Qing Liu, Shilong Zeng, Zhaoyang Liu, Wenlong Gao, Han Huang, Hongjie Ma, Zhengyu Jiang, Xiaoke Chen, Yihao Xiong, Yuda Zhang, Hao Li, Feng Tang, Peijun Yu, Kent Zhang, Lei Computer Vision and Pattern Recognition This paper introduces Grounding DINO 1.5, a suite of advanced open-set object detection models developed by IDEA Research, which aims to advance the "Edge" of open-set object detection. The suite encompasses two models: Grounding DINO 1.5 Pro, a high-performance model designed for stronger generalization capability across a wide range of scenarios, and Grounding DINO 1.5 Edge, an efficient model optimized for faster speed demanded in many applications requiring edge deployment. The Grounding DINO 1.5 Pro model advances its predecessor by scaling up the model architecture, integrating an enhanced vision backbone, and expanding the training dataset to over 20 million images with grounding annotations, thereby achieving a richer semantic understanding. The Grounding DINO 1.5 Edge model, while designed for efficiency with reduced feature scales, maintains robust detection capabilities by being trained on the same comprehensive dataset. Empirical results demonstrate the effectiveness of Grounding DINO 1.5, with the Grounding DINO 1.5 Pro model attaining a 54.3 AP on the COCO detection benchmark and a 55.7 AP on the LVIS-minival zero-shot transfer benchmark, setting new records for open-set object detection. Furthermore, the Grounding DINO 1.5 Edge model, when optimized with TensorRT, achieves a speed of 75.2 FPS while attaining a zero-shot performance of 36.2 AP on the LVIS-minival benchmark, making it more suitable for edge computing scenarios. Model examples and demos with API will be released at https://github.com/IDEA-Research/Grounding-DINO-1.5-API |
| title | Grounding DINO 1.5: Advance the "Edge" of Open-Set Object Detection |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2405.10300 |