Auto-Annotation Quality Prediction for Semi-Supervised Learning with Ensembles
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2019
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929274207862784 |
|---|---|
| author | Simon, Dror Farber, Miriam Goldenberg, Roman |
| author_facet | Simon, Dror Farber, Miriam Goldenberg, Roman |
| contents | Auto-annotation by ensemble of models is an efficient method of learning on unlabeled data. Wrong or inaccurate annotations generated by the ensemble may lead to performance degradation of the trained model. To deal with this problem we propose filtering the auto-labeled data using a trained model that predicts the quality of the annotation from the degree of consensus between ensemble models. Using semantic segmentation as an example, we show the advantage of the proposed auto-annotation filtering over training on data contaminated with inaccurate labels.
Moreover, our experimental results show that in the case of semantic segmentation, the performance of a state-of-the-art model can be achieved by training it with only a fraction (30$\%$) of the original manually labeled data set, and replacing the rest with the auto-annotated, quality filtered labels. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_1910_13988 |
| institution | arXiv |
| publishDate | 2019 |
| record_format | arxiv |
| spellingShingle | Auto-Annotation Quality Prediction for Semi-Supervised Learning with Ensembles Simon, Dror Farber, Miriam Goldenberg, Roman Computer Vision and Pattern Recognition Machine Learning I.2.10; I.2.6 Auto-annotation by ensemble of models is an efficient method of learning on unlabeled data. Wrong or inaccurate annotations generated by the ensemble may lead to performance degradation of the trained model. To deal with this problem we propose filtering the auto-labeled data using a trained model that predicts the quality of the annotation from the degree of consensus between ensemble models. Using semantic segmentation as an example, we show the advantage of the proposed auto-annotation filtering over training on data contaminated with inaccurate labels. Moreover, our experimental results show that in the case of semantic segmentation, the performance of a state-of-the-art model can be achieved by training it with only a fraction (30$\%$) of the original manually labeled data set, and replacing the rest with the auto-annotated, quality filtered labels. |
| title | Auto-Annotation Quality Prediction for Semi-Supervised Learning with Ensembles |
| topic | Computer Vision and Pattern Recognition Machine Learning I.2.10; I.2.6 |
| url | https://arxiv.org/abs/1910.13988 |