DynClean: Training Dynamics-based Label Cleaning for Distantly-Supervised Named Entity Recognition
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866917978871693312 |
|---|---|
| author | Zhang, Qi Pan, Huitong Chen, Zhijia Latecki, Longin Jan Caragea, Cornelia Dragut, Eduard |
| author_facet | Zhang, Qi Pan, Huitong Chen, Zhijia Latecki, Longin Jan Caragea, Cornelia Dragut, Eduard |
| contents | Distantly Supervised Named Entity Recognition (DS-NER) has attracted attention due to its scalability and ability to automatically generate labeled data. However, distant annotation introduces many mislabeled instances, limiting its performance. Most of the existing work attempt to solve this problem by developing intricate models to learn from the noisy labels. An alternative approach is to attempt to clean the labeled data, thus increasing the quality of distant labels. This approach has received little attention for NER. In this paper, we propose a training dynamics-based label cleaning approach, which leverages the behavior of a model as training progresses to characterize the distantly annotated samples. We also introduce an automatic threshold estimation strategy to locate the errors in distant labels. Extensive experimental results demonstrate that: (1) models trained on our cleaned DS-NER datasets, which were refined by directly removing identified erroneous annotations, achieve significant improvements in F1-score, ranging from 3.18% to 8.95%; and (2) our method outperforms numerous advanced DS-NER approaches across four datasets. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_04616 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | DynClean: Training Dynamics-based Label Cleaning for Distantly-Supervised Named Entity Recognition Zhang, Qi Pan, Huitong Chen, Zhijia Latecki, Longin Jan Caragea, Cornelia Dragut, Eduard Computation and Language Distantly Supervised Named Entity Recognition (DS-NER) has attracted attention due to its scalability and ability to automatically generate labeled data. However, distant annotation introduces many mislabeled instances, limiting its performance. Most of the existing work attempt to solve this problem by developing intricate models to learn from the noisy labels. An alternative approach is to attempt to clean the labeled data, thus increasing the quality of distant labels. This approach has received little attention for NER. In this paper, we propose a training dynamics-based label cleaning approach, which leverages the behavior of a model as training progresses to characterize the distantly annotated samples. We also introduce an automatic threshold estimation strategy to locate the errors in distant labels. Extensive experimental results demonstrate that: (1) models trained on our cleaned DS-NER datasets, which were refined by directly removing identified erroneous annotations, achieve significant improvements in F1-score, ranging from 3.18% to 8.95%; and (2) our method outperforms numerous advanced DS-NER approaches across four datasets. |
| title | DynClean: Training Dynamics-based Label Cleaning for Distantly-Supervised Named Entity Recognition |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2504.04616 |