A Library Perspective on Supervised Text Processing in Digital Libraries: An Investigation in the Biomedical Domain
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910705520738304 |
|---|---|
| author | Kroll, Hermann Sackhoff, Pascal Thang, Bill Matthias Ksouri, Maha Balke, Wolf-Tilo |
| author_facet | Kroll, Hermann Sackhoff, Pascal Thang, Bill Matthias Ksouri, Maha Balke, Wolf-Tilo |
| contents | Digital libraries that maintain extensive textual collections may want to further enrich their content for certain downstream applications, e.g., building knowledge graphs, semantic enrichment of documents, or implementing novel access paths. All of these applications require some text processing, either to identify relevant entities, extract semantic relationships between them, or to classify documents into some categories. However, implementing reliable, supervised workflows can become quite challenging for a digital library because suitable training data must be crafted, and reliable models must be trained. While many works focus on achieving the highest accuracy on some benchmarks, we tackle the problem from a digital library practitioner. In other words, we also consider trade-offs between accuracy and application costs, dive into training data generation through distant supervision and large language models such as ChatGPT, LLama, and Olmo, and discuss how to design final pipelines. Therefore, we focus on relation extraction and text classification, using the showcase of eight biomedical benchmarks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_12752 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A Library Perspective on Supervised Text Processing in Digital Libraries: An Investigation in the Biomedical Domain Kroll, Hermann Sackhoff, Pascal Thang, Bill Matthias Ksouri, Maha Balke, Wolf-Tilo Digital Libraries Computation and Language H.4 Digital libraries that maintain extensive textual collections may want to further enrich their content for certain downstream applications, e.g., building knowledge graphs, semantic enrichment of documents, or implementing novel access paths. All of these applications require some text processing, either to identify relevant entities, extract semantic relationships between them, or to classify documents into some categories. However, implementing reliable, supervised workflows can become quite challenging for a digital library because suitable training data must be crafted, and reliable models must be trained. While many works focus on achieving the highest accuracy on some benchmarks, we tackle the problem from a digital library practitioner. In other words, we also consider trade-offs between accuracy and application costs, dive into training data generation through distant supervision and large language models such as ChatGPT, LLama, and Olmo, and discuss how to design final pipelines. Therefore, we focus on relation extraction and text classification, using the showcase of eight biomedical benchmarks. |
| title | A Library Perspective on Supervised Text Processing in Digital Libraries: An Investigation in the Biomedical Domain |
| topic | Digital Libraries Computation and Language H.4 |
| url | https://arxiv.org/abs/2411.12752 |