Developing PUGG for Polish: A Modern Approach to KBQA, MRC, and IR Dataset Construction
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866909279797116928 |
|---|---|
| author | Sawczyn, Albert Viarenich, Katsiaryna Wojtasik, Konrad Domogała, Aleksandra Oleksy, Marcin Piasecki, Maciej Kajdanowicz, Tomasz |
| author_facet | Sawczyn, Albert Viarenich, Katsiaryna Wojtasik, Konrad Domogała, Aleksandra Oleksy, Marcin Piasecki, Maciej Kajdanowicz, Tomasz |
| contents | Advancements in AI and natural language processing have revolutionized machine-human language interactions, with question answering (QA) systems playing a pivotal role. The knowledge base question answering (KBQA) task, utilizing structured knowledge graphs (KG), allows for handling extensive knowledge-intensive questions. However, a significant gap exists in KBQA datasets, especially for low-resource languages. Many existing construction pipelines for these datasets are outdated and inefficient in human labor, and modern assisting tools like Large Language Models (LLM) are not utilized to reduce the workload. To address this, we have designed and implemented a modern, semi-automated approach for creating datasets, encompassing tasks such as KBQA, Machine Reading Comprehension (MRC), and Information Retrieval (IR), tailored explicitly for low-resource environments. We executed this pipeline and introduced the PUGG dataset, the first Polish KBQA dataset, and novel datasets for MRC and IR. Additionally, we provide a comprehensive implementation, insightful findings, detailed statistics, and evaluation of baseline models. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_02337 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Developing PUGG for Polish: A Modern Approach to KBQA, MRC, and IR Dataset Construction Sawczyn, Albert Viarenich, Katsiaryna Wojtasik, Konrad Domogała, Aleksandra Oleksy, Marcin Piasecki, Maciej Kajdanowicz, Tomasz Artificial Intelligence Computation and Language Machine Learning Advancements in AI and natural language processing have revolutionized machine-human language interactions, with question answering (QA) systems playing a pivotal role. The knowledge base question answering (KBQA) task, utilizing structured knowledge graphs (KG), allows for handling extensive knowledge-intensive questions. However, a significant gap exists in KBQA datasets, especially for low-resource languages. Many existing construction pipelines for these datasets are outdated and inefficient in human labor, and modern assisting tools like Large Language Models (LLM) are not utilized to reduce the workload. To address this, we have designed and implemented a modern, semi-automated approach for creating datasets, encompassing tasks such as KBQA, Machine Reading Comprehension (MRC), and Information Retrieval (IR), tailored explicitly for low-resource environments. We executed this pipeline and introduced the PUGG dataset, the first Polish KBQA dataset, and novel datasets for MRC and IR. Additionally, we provide a comprehensive implementation, insightful findings, detailed statistics, and evaluation of baseline models. |
| title | Developing PUGG for Polish: A Modern Approach to KBQA, MRC, and IR Dataset Construction |
| topic | Artificial Intelligence Computation and Language Machine Learning |
| url | https://arxiv.org/abs/2408.02337 |