Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2301.11689 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911771645706240 |
|---|---|
| author | Gilligan, Luke P. J. Cobelli, Matteo Taufour, Valentin Sanvito, Stefano |
| author_facet | Gilligan, Luke P. J. Cobelli, Matteo Taufour, Valentin Sanvito, Stefano |
| contents | In recent times, transformer networks have achieved state-of-the-art performance in a wide range of natural language processing tasks. Here we present a workflow based on the fine-tuning of BERT models for different downstream tasks, which results in the automated extraction of structured information from unstructured natural language in scientific literature. Contrary to existing methods for the automated extraction of structured compound-property relations from similar sources, our workflow does not rely on the definition of intricate grammar rules. Hence, it can be adapted to a new task without requiring extensive implementation efforts and knowledge. We test our data-extraction workflow by automatically generating a database for Curie temperatures and one for band gaps. These are then compared with manually-curated datasets and with those obtained with a state-of-the-art rule-based method. Furthermore, in order to showcase the practical utility of the automatically extracted data in a material-design workflow, we employ them to construct machine-learning models to predict Curie temperatures and band gaps. In general we find that, although more noisy, automatically extracted datasets can grow fast in volume and that such volume partially compensates for the inaccuracy in downstream tasks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2301_11689 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | A rule-free workflow for the automated generation of databases from scientific literature Gilligan, Luke P. J. Cobelli, Matteo Taufour, Valentin Sanvito, Stefano Materials Science Computational Physics Data Analysis, Statistics and Probability In recent times, transformer networks have achieved state-of-the-art performance in a wide range of natural language processing tasks. Here we present a workflow based on the fine-tuning of BERT models for different downstream tasks, which results in the automated extraction of structured information from unstructured natural language in scientific literature. Contrary to existing methods for the automated extraction of structured compound-property relations from similar sources, our workflow does not rely on the definition of intricate grammar rules. Hence, it can be adapted to a new task without requiring extensive implementation efforts and knowledge. We test our data-extraction workflow by automatically generating a database for Curie temperatures and one for band gaps. These are then compared with manually-curated datasets and with those obtained with a state-of-the-art rule-based method. Furthermore, in order to showcase the practical utility of the automatically extracted data in a material-design workflow, we employ them to construct machine-learning models to predict Curie temperatures and band gaps. In general we find that, although more noisy, automatically extracted datasets can grow fast in volume and that such volume partially compensates for the inaccuracy in downstream tasks. |
| title | A rule-free workflow for the automated generation of databases from scientific literature |
| topic | Materials Science Computational Physics Data Analysis, Statistics and Probability |
| url | https://arxiv.org/abs/2301.11689 |