RACOON: An LLM-based Framework for Retrieval-Augmented Column Type Annotation with a Knowledge Graph
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909374166859776 |
|---|---|
| author | Wei, Lindsey Linxi Xiao, Guorui Balazinska, Magdalena |
| author_facet | Wei, Lindsey Linxi Xiao, Guorui Balazinska, Magdalena |
| contents | As an important component of data exploration and integration, Column Type Annotation (CTA) aims to label columns of a table with one or more semantic types. With the recent development of Large Language Models (LLMs), researchers have started to explore the possibility of using LLMs for CTA, leveraging their strong zero-shot capabilities. In this paper, we build on this promising work and improve on LLM-based methods for CTA by showing how to use a Knowledge Graph (KG) to augment the context information provided to the LLM. Our approach, called RACOON, combines both pre-trained parametric and non-parametric knowledge during generation to improve LLMs' performance on CTA. Our experiments show that RACOON achieves up to a 0.21 micro F-1 improvement compared against vanilla LLM inference. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_14556 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | RACOON: An LLM-based Framework for Retrieval-Augmented Column Type Annotation with a Knowledge Graph Wei, Lindsey Linxi Xiao, Guorui Balazinska, Magdalena Databases Artificial Intelligence As an important component of data exploration and integration, Column Type Annotation (CTA) aims to label columns of a table with one or more semantic types. With the recent development of Large Language Models (LLMs), researchers have started to explore the possibility of using LLMs for CTA, leveraging their strong zero-shot capabilities. In this paper, we build on this promising work and improve on LLM-based methods for CTA by showing how to use a Knowledge Graph (KG) to augment the context information provided to the LLM. Our approach, called RACOON, combines both pre-trained parametric and non-parametric knowledge during generation to improve LLMs' performance on CTA. Our experiments show that RACOON achieves up to a 0.21 micro F-1 improvement compared against vanilla LLM inference. |
| title | RACOON: An LLM-based Framework for Retrieval-Augmented Column Type Annotation with a Knowledge Graph |
| topic | Databases Artificial Intelligence |
| url | https://arxiv.org/abs/2409.14556 |