A Similarity-Based Oversampling Method for Multi-label Imbalanced Text Data
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866910758205390848 |
|---|---|
| author | Karaman, Ismail Hakki Koksal, Gulser Eriskin, Levent Salihoglu, Salih |
| author_facet | Karaman, Ismail Hakki Koksal, Gulser Eriskin, Levent Salihoglu, Salih |
| contents | In real-world applications, as data availability increases, obtaining labeled data for machine learning (ML) projects remains challenging due to the high costs and intensive efforts required for data annotation. Many ML projects, particularly those focused on multi-label classification, also grapple with data imbalance issues, where certain classes may lack sufficient data to train effective classifiers. This study introduces and examines a novel oversampling method for multi-label text classification, designed to address performance challenges associated with data imbalance. The proposed method identifies potential new samples from unlabeled data by leveraging similarity measures between instances. By iteratively searching the unlabeled dataset, the method locates instances similar to those in underrepresented classes and evaluates their contribution to classifier performance enhancement. Instances that demonstrate performance improvement are then added to the labeled dataset. Experimental results indicate that the proposed approach effectively enhances classifier performance post-oversampling. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_01013 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A Similarity-Based Oversampling Method for Multi-label Imbalanced Text Data Karaman, Ismail Hakki Koksal, Gulser Eriskin, Levent Salihoglu, Salih Machine Learning Artificial Intelligence In real-world applications, as data availability increases, obtaining labeled data for machine learning (ML) projects remains challenging due to the high costs and intensive efforts required for data annotation. Many ML projects, particularly those focused on multi-label classification, also grapple with data imbalance issues, where certain classes may lack sufficient data to train effective classifiers. This study introduces and examines a novel oversampling method for multi-label text classification, designed to address performance challenges associated with data imbalance. The proposed method identifies potential new samples from unlabeled data by leveraging similarity measures between instances. By iteratively searching the unlabeled dataset, the method locates instances similar to those in underrepresented classes and evaluates their contribution to classifier performance enhancement. Instances that demonstrate performance improvement are then added to the labeled dataset. Experimental results indicate that the proposed approach effectively enhances classifier performance post-oversampling. |
| title | A Similarity-Based Oversampling Method for Multi-label Imbalanced Text Data |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2411.01013 |