Dynamic and Adaptive Feature Generation with LLM
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915717374279680 |
|---|---|
| author | Zhang, Xinhao Zhang, Jinghan Rekabdar, Banafsheh Zhou, Yuanchun Wang, Pengfei Liu, Kunpeng |
| author_facet | Zhang, Xinhao Zhang, Jinghan Rekabdar, Banafsheh Zhou, Yuanchun Wang, Pengfei Liu, Kunpeng |
| contents | The representation of feature space is a crucial environment where data points get vectorized and embedded for subsequent modeling. Thus the efficacy of machine learning (ML) algorithms is closely related to the quality of feature engineering. As one of the most important techniques, feature generation transforms raw data into an optimized feature space conducive to model training and further refines the space. Despite the advancements in automated feature engineering and feature generation, current methodologies often suffer from three fundamental issues: lack of explainability, limited applicability, and inflexible strategy. These shortcomings frequently hinder and limit the deployment of ML models across varied scenarios. Our research introduces a novel approach adopting large language models (LLMs) and feature-generating prompts to address these challenges. We propose a dynamic and adaptive feature generation method that enhances the interpretability of the feature generation process. Our approach broadens the applicability across various data types and tasks and offers advantages over strategic flexibility. A broad range of experiments showcases that our approach is significantly superior to existing methods. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_03505 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Dynamic and Adaptive Feature Generation with LLM Zhang, Xinhao Zhang, Jinghan Rekabdar, Banafsheh Zhou, Yuanchun Wang, Pengfei Liu, Kunpeng Machine Learning Artificial Intelligence The representation of feature space is a crucial environment where data points get vectorized and embedded for subsequent modeling. Thus the efficacy of machine learning (ML) algorithms is closely related to the quality of feature engineering. As one of the most important techniques, feature generation transforms raw data into an optimized feature space conducive to model training and further refines the space. Despite the advancements in automated feature engineering and feature generation, current methodologies often suffer from three fundamental issues: lack of explainability, limited applicability, and inflexible strategy. These shortcomings frequently hinder and limit the deployment of ML models across varied scenarios. Our research introduces a novel approach adopting large language models (LLMs) and feature-generating prompts to address these challenges. We propose a dynamic and adaptive feature generation method that enhances the interpretability of the feature generation process. Our approach broadens the applicability across various data types and tasks and offers advantages over strategic flexibility. A broad range of experiments showcases that our approach is significantly superior to existing methods. |
| title | Dynamic and Adaptive Feature Generation with LLM |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2406.03505 |