Leveraging Variation Theory in Counterfactual Data Augmentation for Optimized Active Learning
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866913869086064640 |
|---|---|
| author | Gebreegziabher, Simret Araya Ai, Kuangshi Zhang, Zheng Glassman, Elena L. Li, Toby Jia-Jun |
| author_facet | Gebreegziabher, Simret Araya Ai, Kuangshi Zhang, Zheng Glassman, Elena L. Li, Toby Jia-Jun |
| contents | Active Learning (AL) allows models to learn interactively from user feedback. This paper introduces a counterfactual data augmentation approach to AL, particularly addressing the selection of datapoints for user querying, a pivotal concern in enhancing data efficiency. Our approach is inspired by Variation Theory, a theory of human concept learning that emphasizes the essential features of a concept by focusing on what stays the same and what changes. Instead of just querying with existing datapoints, our approach synthesizes artificial datapoints that highlight potential key similarities and differences among labels using a neuro-symbolic pipeline combining large language models (LLMs) and rule-based models. Through an experiment in the example domain of text classification, we show that our approach achieves significantly higher performance when there are fewer annotated data. As the annotated training data gets larger the impact of the generated data starts to diminish showing its capability to address the cold start problem in AL. This research sheds light on integrating theories of human learning into the optimization of AL. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_03819 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Leveraging Variation Theory in Counterfactual Data Augmentation for Optimized Active Learning Gebreegziabher, Simret Araya Ai, Kuangshi Zhang, Zheng Glassman, Elena L. Li, Toby Jia-Jun Machine Learning Computation and Language Human-Computer Interaction Active Learning (AL) allows models to learn interactively from user feedback. This paper introduces a counterfactual data augmentation approach to AL, particularly addressing the selection of datapoints for user querying, a pivotal concern in enhancing data efficiency. Our approach is inspired by Variation Theory, a theory of human concept learning that emphasizes the essential features of a concept by focusing on what stays the same and what changes. Instead of just querying with existing datapoints, our approach synthesizes artificial datapoints that highlight potential key similarities and differences among labels using a neuro-symbolic pipeline combining large language models (LLMs) and rule-based models. Through an experiment in the example domain of text classification, we show that our approach achieves significantly higher performance when there are fewer annotated data. As the annotated training data gets larger the impact of the generated data starts to diminish showing its capability to address the cold start problem in AL. This research sheds light on integrating theories of human learning into the optimization of AL. |
| title | Leveraging Variation Theory in Counterfactual Data Augmentation for Optimized Active Learning |
| topic | Machine Learning Computation and Language Human-Computer Interaction |
| url | https://arxiv.org/abs/2408.03819 |