Human-LLM Collaborative Feature Engineering for Tabular Data
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2026
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866914289054384128 |
|---|---|
| author | Li, Zhuoyan Bansal, Aditya Li, Jinzhao He, Shishuang Lu, Zhuoran Zhang, Mutian Liu, Qin Yang, Yiwei Jain, Swati Yin, Ming Li, Yunyao |
| author_facet | Li, Zhuoyan Bansal, Aditya Li, Jinzhao He, Shishuang Lu, Zhuoran Zhang, Mutian Liu, Qin Yang, Yiwei Jain, Swati Yin, Ming Li, Yunyao |
| contents | Large language models (LLMs) are increasingly used to automate feature engineering in tabular learning. Given task-specific information, LLMs can propose diverse feature transformation operations to enhance downstream model performance. However, current approaches typically assign the LLM as a black-box optimizer, responsible for both proposing and selecting operations based solely on its internal heuristics, which often lack calibrated estimations of operation utility and consequently lead to repeated exploration of low-yield operations without a principled strategy for prioritizing promising directions. In this paper, we propose a human-LLM collaborative feature engineering framework for tabular learning. We begin by decoupling the transformation operation proposal and selection processes, where LLMs are used solely to generate operation candidates, while the selection is guided by explicitly modeling the utility and uncertainty of each proposed operation. Since accurate utility estimation can be difficult especially in the early rounds of feature engineering, we design a mechanism within the framework that selectively elicits and incorporates human expert preference feedback, comparing which operations are more promising, into the selection process to help identify more effective operations. Our evaluations on both the synthetic study and the real user study demonstrate that the proposed framework improves feature engineering performance across a variety of tabular datasets and reduces users' cognitive load during the feature engineering process. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_21060 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Human-LLM Collaborative Feature Engineering for Tabular Data Li, Zhuoyan Bansal, Aditya Li, Jinzhao He, Shishuang Lu, Zhuoran Zhang, Mutian Liu, Qin Yang, Yiwei Jain, Swati Yin, Ming Li, Yunyao Machine Learning Computation and Language Human-Computer Interaction Large language models (LLMs) are increasingly used to automate feature engineering in tabular learning. Given task-specific information, LLMs can propose diverse feature transformation operations to enhance downstream model performance. However, current approaches typically assign the LLM as a black-box optimizer, responsible for both proposing and selecting operations based solely on its internal heuristics, which often lack calibrated estimations of operation utility and consequently lead to repeated exploration of low-yield operations without a principled strategy for prioritizing promising directions. In this paper, we propose a human-LLM collaborative feature engineering framework for tabular learning. We begin by decoupling the transformation operation proposal and selection processes, where LLMs are used solely to generate operation candidates, while the selection is guided by explicitly modeling the utility and uncertainty of each proposed operation. Since accurate utility estimation can be difficult especially in the early rounds of feature engineering, we design a mechanism within the framework that selectively elicits and incorporates human expert preference feedback, comparing which operations are more promising, into the selection process to help identify more effective operations. Our evaluations on both the synthetic study and the real user study demonstrate that the proposed framework improves feature engineering performance across a variety of tabular datasets and reduces users' cognitive load during the feature engineering process. |
| title | Human-LLM Collaborative Feature Engineering for Tabular Data |
| topic | Machine Learning Computation and Language Human-Computer Interaction |
| url | https://arxiv.org/abs/2601.21060 |