A Domain-Specific Curated Benchmark for Entity and Document-Level Relation Extraction

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Martinelli, Marco, Marchesin, Stefano, Bonato, Vanessa, Di Nunzio, Giorgio Maria, Ferro, Nicola, Irrera, Ornella, Menotti, Laura, Vezzani, Federica, Silvello, Gianmaria
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866918322144018432
author Martinelli, Marco
Marchesin, Stefano
Bonato, Vanessa
Di Nunzio, Giorgio Maria
Ferro, Nicola
Irrera, Ornella
Menotti, Laura
Vezzani, Federica
Silvello, Gianmaria
author_facet Martinelli, Marco
Marchesin, Stefano
Bonato, Vanessa
Di Nunzio, Giorgio Maria
Ferro, Nicola
Irrera, Ornella
Menotti, Laura
Vezzani, Federica
Silvello, Gianmaria
contents Information Extraction (IE), encompassing Named Entity Recognition (NER), Named Entity Linking (NEL), and Relation Extraction (RE), is critical for transforming the rapidly growing volume of scientific publications into structured, actionable knowledge. This need is especially evident in fast-evolving biomedical fields such as the gut-brain axis, where research investigates complex interactions between the gut microbiota and brain-related disorders. Existing biomedical IE benchmarks, however, are often narrow in scope and rely heavily on distantly supervised or automatically generated annotations, limiting their utility for advancing robust IE methods. We introduce GutBrainIE, a benchmark based on more than 1,600 PubMed abstracts, manually annotated by biomedical and terminological experts with fine-grained entities, concept-level links, and relations. While grounded in the gut-brain axis, the benchmark's rich schema, multiple tasks, and combination of highly curated and weakly supervised data make it broadly applicable to the development and evaluation of biomedical IE systems across domains.
format Preprint
id arxiv_https___arxiv_org_abs_2602_04320
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle A Domain-Specific Curated Benchmark for Entity and Document-Level Relation Extraction
Martinelli, Marco
Marchesin, Stefano
Bonato, Vanessa
Di Nunzio, Giorgio Maria
Ferro, Nicola
Irrera, Ornella
Menotti, Laura
Vezzani, Federica
Silvello, Gianmaria
Computation and Language
H.3; J.3
Information Extraction (IE), encompassing Named Entity Recognition (NER), Named Entity Linking (NEL), and Relation Extraction (RE), is critical for transforming the rapidly growing volume of scientific publications into structured, actionable knowledge. This need is especially evident in fast-evolving biomedical fields such as the gut-brain axis, where research investigates complex interactions between the gut microbiota and brain-related disorders. Existing biomedical IE benchmarks, however, are often narrow in scope and rely heavily on distantly supervised or automatically generated annotations, limiting their utility for advancing robust IE methods. We introduce GutBrainIE, a benchmark based on more than 1,600 PubMed abstracts, manually annotated by biomedical and terminological experts with fine-grained entities, concept-level links, and relations. While grounded in the gut-brain axis, the benchmark's rich schema, multiple tasks, and combination of highly curated and weakly supervised data make it broadly applicable to the development and evaluation of biomedical IE systems across domains.
title A Domain-Specific Curated Benchmark for Entity and Document-Level Relation Extraction
topic Computation and Language
H.3; J.3
url https://arxiv.org/abs/2602.04320