LLM-Based Information Extraction to Support Scientific Literature Research and Publication Workflows

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Ateia, Samy, Kruschwitz, Udo, Scholz, Melanie, Koschmider, Agnes, Almohaishi, Moayad
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866912631394140160
author Ateia, Samy
Kruschwitz, Udo
Scholz, Melanie
Koschmider, Agnes
Almohaishi, Moayad
author_facet Ateia, Samy
Kruschwitz, Udo
Scholz, Melanie
Koschmider, Agnes
Almohaishi, Moayad
contents The increasing volume of scholarly publications requires advanced tools for efficient knowledge discovery and management. This paper introduces ongoing work on a system using Large Language Models (LLMs) for the semantic extraction of key concepts from scientific documents. Our research, conducted within the German National Research Data Infrastructure for and with Computer Science (NFDIxCS) project, seeks to support FAIR (Findable, Accessible, Interoperable, and Reusable) principles in scientific publishing. We outline our explorative work, which uses in-context learning with various LLMs to extract concepts from papers, initially focusing on the Business Process Management (BPM) domain. A key advantage of this approach is its potential for rapid domain adaptation, often requiring few or even zero examples to define extraction targets for new scientific fields. We conducted technical evaluations to compare the performance of commercial and open-source LLMs and created an online demo application to collect feedback from an initial user-study. Additionally, we gathered insights from the computer science research community through user stories collected during a dedicated workshop, actively guiding the ongoing development of our future services. These services aim to support structured literature reviews, concept-based information retrieval, and integration of extracted knowledge into existing knowledge graphs.
format Preprint
id arxiv_https___arxiv_org_abs_2510_04749
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle LLM-Based Information Extraction to Support Scientific Literature Research and Publication Workflows
Ateia, Samy
Kruschwitz, Udo
Scholz, Melanie
Koschmider, Agnes
Almohaishi, Moayad
Digital Libraries
The increasing volume of scholarly publications requires advanced tools for efficient knowledge discovery and management. This paper introduces ongoing work on a system using Large Language Models (LLMs) for the semantic extraction of key concepts from scientific documents. Our research, conducted within the German National Research Data Infrastructure for and with Computer Science (NFDIxCS) project, seeks to support FAIR (Findable, Accessible, Interoperable, and Reusable) principles in scientific publishing. We outline our explorative work, which uses in-context learning with various LLMs to extract concepts from papers, initially focusing on the Business Process Management (BPM) domain. A key advantage of this approach is its potential for rapid domain adaptation, often requiring few or even zero examples to define extraction targets for new scientific fields. We conducted technical evaluations to compare the performance of commercial and open-source LLMs and created an online demo application to collect feedback from an initial user-study. Additionally, we gathered insights from the computer science research community through user stories collected during a dedicated workshop, actively guiding the ongoing development of our future services. These services aim to support structured literature reviews, concept-based information retrieval, and integration of extracted knowledge into existing knowledge graphs.
title LLM-Based Information Extraction to Support Scientific Literature Research and Publication Workflows
topic Digital Libraries
url https://arxiv.org/abs/2510.04749