An LLM Agent-Based Complex Semantic Table Annotation Approach

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Geng, Yilin, Wang, Shujing, Wang, Chuan, He, Keqing, Lv, Yanfei, Wang, Ying, Feng, Zaiwen, Bai, Xiaoying
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915449400197120
author Geng, Yilin
Wang, Shujing
Wang, Chuan
He, Keqing
Lv, Yanfei
Wang, Ying
Feng, Zaiwen
Bai, Xiaoying
author_facet Geng, Yilin
Wang, Shujing
Wang, Chuan
He, Keqing
Lv, Yanfei
Wang, Ying
Feng, Zaiwen
Bai, Xiaoying
contents The Semantic Table Annotation (STA) task, which includes Column Type Annotation (CTA) and Cell Entity Annotation (CEA), maps table contents to ontology entities and plays important roles in various semantic applications. However, complex tables often pose challenges such as semantic loss of column names or cell values, strict ontological hierarchy requirements, homonyms, spelling errors, and abbreviations, which hinder annotation accuracy. To address these issues, this paper proposes an LLM-based agent approach for CTA and CEA. We design and implement five external tools with tailored prompts based on the ReAct framework, enabling the STA agent to dynamically select suitable annotation strategies depending on table characteristics. Experiments are conducted on the Tough Tables and BiodivTab datasets from the SemTab challenge, which contain the aforementioned challenges. Our method outperforms existing approaches across various metrics. Furthermore, by leveraging Levenshtein distance to reduce redundant annotations, we achieve a 70% reduction in time costs and a 60% reduction in LLM token usage, providing an efficient and cost-effective solution for STA.
format Preprint
id arxiv_https___arxiv_org_abs_2508_12868
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle An LLM Agent-Based Complex Semantic Table Annotation Approach
Geng, Yilin
Wang, Shujing
Wang, Chuan
He, Keqing
Lv, Yanfei
Wang, Ying
Feng, Zaiwen
Bai, Xiaoying
Computation and Language
Databases
The Semantic Table Annotation (STA) task, which includes Column Type Annotation (CTA) and Cell Entity Annotation (CEA), maps table contents to ontology entities and plays important roles in various semantic applications. However, complex tables often pose challenges such as semantic loss of column names or cell values, strict ontological hierarchy requirements, homonyms, spelling errors, and abbreviations, which hinder annotation accuracy. To address these issues, this paper proposes an LLM-based agent approach for CTA and CEA. We design and implement five external tools with tailored prompts based on the ReAct framework, enabling the STA agent to dynamically select suitable annotation strategies depending on table characteristics. Experiments are conducted on the Tough Tables and BiodivTab datasets from the SemTab challenge, which contain the aforementioned challenges. Our method outperforms existing approaches across various metrics. Furthermore, by leveraging Levenshtein distance to reduce redundant annotations, we achieve a 70% reduction in time costs and a 60% reduction in LLM token usage, providing an efficient and cost-effective solution for STA.
title An LLM Agent-Based Complex Semantic Table Annotation Approach
topic Computation and Language
Databases
url https://arxiv.org/abs/2508.12868