Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | https://arxiv.org/abs/2502.05923 |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909485491027968 |
|---|---|
| author | M., Yashwanth Singh, Vaibhav Maheshwari, Ayush Krishna, Amrith Ramakrishnan, Ganesh |
| author_facet | M., Yashwanth Singh, Vaibhav Maheshwari, Ayush Krishna, Amrith Ramakrishnan, Ganesh |
| contents | We propose ARISE, a framework that iteratively induces rules and generates synthetic data for text classification. We combine synthetic data generation and automatic rule induction, via bootstrapping, to iteratively filter the generated rules and data. We induce rules via inductive generalisation of syntactic n-grams, enabling us to capture a complementary source of supervision. These rules alone lead to performance gains in both, in-context learning (ICL) and fine-tuning (FT) settings. Similarly, use of augmented data from ARISE alone improves the performance for a model, outperforming configurations that rely on complex methods like contrastive learning. Further, our extensive experiments on various datasets covering three full-shot, eight few-shot and seven multilingual variant settings demonstrate that the rules and data we generate lead to performance improvements across these diverse domains and languages. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_05923 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | ARISE: Iterative Rule Induction and Synthetic Data Generation for Text Classification M., Yashwanth Singh, Vaibhav Maheshwari, Ayush Krishna, Amrith Ramakrishnan, Ganesh Computation and Language We propose ARISE, a framework that iteratively induces rules and generates synthetic data for text classification. We combine synthetic data generation and automatic rule induction, via bootstrapping, to iteratively filter the generated rules and data. We induce rules via inductive generalisation of syntactic n-grams, enabling us to capture a complementary source of supervision. These rules alone lead to performance gains in both, in-context learning (ICL) and fine-tuning (FT) settings. Similarly, use of augmented data from ARISE alone improves the performance for a model, outperforming configurations that rely on complex methods like contrastive learning. Further, our extensive experiments on various datasets covering three full-shot, eight few-shot and seven multilingual variant settings demonstrate that the rules and data we generate lead to performance improvements across these diverse domains and languages. |
| title | ARISE: Iterative Rule Induction and Synthetic Data Generation for Text Classification |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2502.05923 |