Table Transformers for Imputing Textual Attributes
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866912099344580608 |
|---|---|
| author | Wei, Ting-Ruen Wang, Yuan Inoue, Yoshitaka Wu, Hsin-Tai Fang, Yi |
| author_facet | Wei, Ting-Ruen Wang, Yuan Inoue, Yoshitaka Wu, Hsin-Tai Fang, Yi |
| contents | Missing data in tabular dataset is a common issue as the performance of downstream tasks usually depends on the completeness of the training dataset. Previous missing data imputation methods focus on numeric and categorical columns, but we propose a novel end-to-end approach called Table Transformers for Imputing Textual Attributes (TTITA) based on the transformer to impute unstructured textual columns using other columns in the table. We conduct extensive experiments on three datasets, and our approach shows competitive performance outperforming baseline models such as recurrent neural networks and Llama2. The performance improvement is more significant when the target sequence has a longer length. Additionally, we incorporate multi-task learning to simultaneously impute for heterogeneous columns, boosting the performance for text imputation. We also qualitatively compare with ChatGPT for realistic applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_02128 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Table Transformers for Imputing Textual Attributes Wei, Ting-Ruen Wang, Yuan Inoue, Yoshitaka Wu, Hsin-Tai Fang, Yi Computation and Language Missing data in tabular dataset is a common issue as the performance of downstream tasks usually depends on the completeness of the training dataset. Previous missing data imputation methods focus on numeric and categorical columns, but we propose a novel end-to-end approach called Table Transformers for Imputing Textual Attributes (TTITA) based on the transformer to impute unstructured textual columns using other columns in the table. We conduct extensive experiments on three datasets, and our approach shows competitive performance outperforming baseline models such as recurrent neural networks and Llama2. The performance improvement is more significant when the target sequence has a longer length. Additionally, we incorporate multi-task learning to simultaneously impute for heterogeneous columns, boosting the performance for text imputation. We also qualitatively compare with ChatGPT for realistic applications. |
| title | Table Transformers for Imputing Textual Attributes |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2408.02128 |