HeGTa: Leveraging Heterogeneous Graph-enhanced Large Language Models for Few-shot Complex Table Understanding
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866913612460720128 |
|---|---|
| author | Jin, Rihui Li, Yu Qi, Guilin Hu, Nan Li, Yuan-Fang Chen, Jiaoyan Wang, Jianan Chen, Yongrui Min, Dehai Bi, Sheng |
| author_facet | Jin, Rihui Li, Yu Qi, Guilin Hu, Nan Li, Yuan-Fang Chen, Jiaoyan Wang, Jianan Chen, Yongrui Min, Dehai Bi, Sheng |
| contents | Table understanding (TU) has achieved promising advancements, but it faces the challenges of the scarcity of manually labeled tables and the presence of complex table structures.To address these challenges, we propose HGT, a framework with a heterogeneous graph (HG)-enhanced large language model (LLM) to tackle few-shot TU tasks.It leverages the LLM by aligning the table semantics with the LLM's parametric knowledge through soft prompts and instruction turning and deals with complex tables by a multi-task pre-training scheme involving three novel multi-granularity self-supervised HG pre-training objectives.We empirically demonstrate the effectiveness of HGT, showing that it outperforms the SOTA for few-shot complex TU on several benchmarks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_19723 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | HeGTa: Leveraging Heterogeneous Graph-enhanced Large Language Models for Few-shot Complex Table Understanding Jin, Rihui Li, Yu Qi, Guilin Hu, Nan Li, Yuan-Fang Chen, Jiaoyan Wang, Jianan Chen, Yongrui Min, Dehai Bi, Sheng Computation and Language Artificial Intelligence Databases Multimedia Table understanding (TU) has achieved promising advancements, but it faces the challenges of the scarcity of manually labeled tables and the presence of complex table structures.To address these challenges, we propose HGT, a framework with a heterogeneous graph (HG)-enhanced large language model (LLM) to tackle few-shot TU tasks.It leverages the LLM by aligning the table semantics with the LLM's parametric knowledge through soft prompts and instruction turning and deals with complex tables by a multi-task pre-training scheme involving three novel multi-granularity self-supervised HG pre-training objectives.We empirically demonstrate the effectiveness of HGT, showing that it outperforms the SOTA for few-shot complex TU on several benchmarks. |
| title | HeGTa: Leveraging Heterogeneous Graph-enhanced Large Language Models for Few-shot Complex Table Understanding |
| topic | Computation and Language Artificial Intelligence Databases Multimedia |
| url | https://arxiv.org/abs/2403.19723 |