Retrieval-Augmented Feature Generation for Domain-Specific Classification
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866911256384897024 |
|---|---|
| author | Zhang, Xinhao Zhang, Jinghan Mo, Fengran Chandra, Dakshak Keerthi Chen, Yu-Zhong Xie, Fei Liu, Kunpeng |
| author_facet | Zhang, Xinhao Zhang, Jinghan Mo, Fengran Chandra, Dakshak Keerthi Chen, Yu-Zhong Xie, Fei Liu, Kunpeng |
| contents | Feature generation can significantly enhance learning outcomes, particularly for tasks with limited data. An effective way to improve feature generation is to expand the current feature space using existing features and enriching the informational content. However, generating new, interpretable features usually requires domain-specific knowledge on top of the existing features. In this paper, we introduce a Retrieval-Augmented Feature Generation method, RAFG, to generate useful and explainable features specific to domain classification tasks. To increase the interpretability of the generated features, we conduct knowledge retrieval among the existing features in the domain to identify potential feature associations. These associations are expected to help generate useful features. Moreover, we develop a framework based on large language models (LLMs) for feature generation with reasoning to verify the quality of the features during their generation process. Experiments across several datasets in medical, economic, and geographic domains show that our RAFG method can produce high-quality, meaningful features and significantly improve classification performance compared with baseline methods. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_11177 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Retrieval-Augmented Feature Generation for Domain-Specific Classification Zhang, Xinhao Zhang, Jinghan Mo, Fengran Chandra, Dakshak Keerthi Chen, Yu-Zhong Xie, Fei Liu, Kunpeng Computation and Language Feature generation can significantly enhance learning outcomes, particularly for tasks with limited data. An effective way to improve feature generation is to expand the current feature space using existing features and enriching the informational content. However, generating new, interpretable features usually requires domain-specific knowledge on top of the existing features. In this paper, we introduce a Retrieval-Augmented Feature Generation method, RAFG, to generate useful and explainable features specific to domain classification tasks. To increase the interpretability of the generated features, we conduct knowledge retrieval among the existing features in the domain to identify potential feature associations. These associations are expected to help generate useful features. Moreover, we develop a framework based on large language models (LLMs) for feature generation with reasoning to verify the quality of the features during their generation process. Experiments across several datasets in medical, economic, and geographic domains show that our RAFG method can produce high-quality, meaningful features and significantly improve classification performance compared with baseline methods. |
| title | Retrieval-Augmented Feature Generation for Domain-Specific Classification |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2406.11177 |