Mcity Data Engine: Iterative Model Improvement Through Open-Vocabulary Data Selection
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866912501901295616 |
|---|---|
| author | Bogdoll, Daniel Ananta, Rajanikant Patnaik Giridharan, Abeyankar Moore, Isabel Stevens, Gregory Liu, Henry X. |
| author_facet | Bogdoll, Daniel Ananta, Rajanikant Patnaik Giridharan, Abeyankar Moore, Isabel Stevens, Gregory Liu, Henry X. |
| contents | With an ever-increasing availability of data, it has become more and more challenging to select and label appropriate samples for the training of machine learning models. It is especially difficult to detect long-tail classes of interest in large amounts of unlabeled data. This holds especially true for Intelligent Transportation Systems (ITS), where vehicle fleets and roadside perception systems generate an abundance of raw data. While industrial, proprietary data engines for such iterative data selection and model training processes exist, researchers and the open-source community suffer from a lack of an openly available system. We present the Mcity Data Engine, which provides modules for the complete data-based development cycle, beginning at the data acquisition phase and ending at the model deployment stage. The Mcity Data Engine focuses on rare and novel classes through an open-vocabulary data selection process. All code is publicly available on GitHub under an MIT license: https://github.com/mcity/mcity_data_engine |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_21614 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Mcity Data Engine: Iterative Model Improvement Through Open-Vocabulary Data Selection Bogdoll, Daniel Ananta, Rajanikant Patnaik Giridharan, Abeyankar Moore, Isabel Stevens, Gregory Liu, Henry X. Computer Vision and Pattern Recognition With an ever-increasing availability of data, it has become more and more challenging to select and label appropriate samples for the training of machine learning models. It is especially difficult to detect long-tail classes of interest in large amounts of unlabeled data. This holds especially true for Intelligent Transportation Systems (ITS), where vehicle fleets and roadside perception systems generate an abundance of raw data. While industrial, proprietary data engines for such iterative data selection and model training processes exist, researchers and the open-source community suffer from a lack of an openly available system. We present the Mcity Data Engine, which provides modules for the complete data-based development cycle, beginning at the data acquisition phase and ending at the model deployment stage. The Mcity Data Engine focuses on rare and novel classes through an open-vocabulary data selection process. All code is publicly available on GitHub under an MIT license: https://github.com/mcity/mcity_data_engine |
| title | Mcity Data Engine: Iterative Model Improvement Through Open-Vocabulary Data Selection |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2504.21614 |