Datatractor: Metadata, automation, and registries for extractor interoperability in the chemical and materials sciences
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911017411280896 |
|---|---|
| author | Evans, Matthew L. Rignanese, Gian-Marco Elbert, David Kraus, Peter |
| author_facet | Evans, Matthew L. Rignanese, Gian-Marco Elbert, David Kraus, Peter |
| contents | Two key issues hindering the transition towards FAIR data science are the poor discoverability and inconsistent instructions for the use of data extractor tools, i.e., how we go from raw data files created by instruments, to accessible metadata and scientific insight. If the existing format conversion tools are hard to find, install, and use, their reimplementation will lead to a duplication of effort, and an increase in the associated maintenance burden is inevitable. The Datatractor framework presented in this work addresses these issues. First, by providing a curated registry of such extractor tools their discoverability will increase. Second, by describing them using a standardised but lightweight schema, their installation and use is machine-actionable. Finally, we provide a reference implementation for such data extraction. The Datatractor framework can be used to provide a public-facing data extraction service, or be incorporated into other research data management tools providing added value. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_18839 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Datatractor: Metadata, automation, and registries for extractor interoperability in the chemical and materials sciences Evans, Matthew L. Rignanese, Gian-Marco Elbert, David Kraus, Peter Data Analysis, Statistics and Probability Materials Science Two key issues hindering the transition towards FAIR data science are the poor discoverability and inconsistent instructions for the use of data extractor tools, i.e., how we go from raw data files created by instruments, to accessible metadata and scientific insight. If the existing format conversion tools are hard to find, install, and use, their reimplementation will lead to a duplication of effort, and an increase in the associated maintenance burden is inevitable. The Datatractor framework presented in this work addresses these issues. First, by providing a curated registry of such extractor tools their discoverability will increase. Second, by describing them using a standardised but lightweight schema, their installation and use is machine-actionable. Finally, we provide a reference implementation for such data extraction. The Datatractor framework can be used to provide a public-facing data extraction service, or be incorporated into other research data management tools providing added value. |
| title | Datatractor: Metadata, automation, and registries for extractor interoperability in the chemical and materials sciences |
| topic | Data Analysis, Statistics and Probability Materials Science |
| url | https://arxiv.org/abs/2410.18839 |