Collage: Decomposable Rapid Prototyping for Information Extraction on Scientific PDFs
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915356995485696 |
|---|---|
| author | Gururaja, Sireesh Zhang, Yueheng Tang, Guannan Zhang, Tianhao Murphy, Kevin Yi, Yu-Tsen Seo, Junwon Rollett, Anthony Strubell, Emma |
| author_facet | Gururaja, Sireesh Zhang, Yueheng Tang, Guannan Zhang, Tianhao Murphy, Kevin Yi, Yu-Tsen Seo, Junwon Rollett, Anthony Strubell, Emma |
| contents | Recent years in NLP have seen the continued development of domain-specific information extraction tools for scientific documents, alongside the release of increasingly multimodal pretrained transformer models. While the opportunity for scientists outside of NLP to evaluate and apply such systems to their own domains has never been clearer, these models are difficult to compare: they accept different input formats, are often black-box and give little insight into processing failures, and rarely handle PDF documents, the most common format of scientific publication. In this work, we present Collage, a tool designed for rapid prototyping, visualization, and evaluation of different information extraction models on scientific PDFs. Collage allows the use and evaluation of any HuggingFace token classifier, several LLMs, and multiple other task-specific models out of the box, and provides extensible software interfaces to accelerate experimentation with new models. Further, we enable both developers and users of NLP-based tools to inspect, debug, and better understand modeling pipelines by providing granular views of intermediate states of processing. We demonstrate our system in the context of information extraction to assist with literature review in materials science. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_23478 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Collage: Decomposable Rapid Prototyping for Information Extraction on Scientific PDFs Gururaja, Sireesh Zhang, Yueheng Tang, Guannan Zhang, Tianhao Murphy, Kevin Yi, Yu-Tsen Seo, Junwon Rollett, Anthony Strubell, Emma Computation and Language Human-Computer Interaction Recent years in NLP have seen the continued development of domain-specific information extraction tools for scientific documents, alongside the release of increasingly multimodal pretrained transformer models. While the opportunity for scientists outside of NLP to evaluate and apply such systems to their own domains has never been clearer, these models are difficult to compare: they accept different input formats, are often black-box and give little insight into processing failures, and rarely handle PDF documents, the most common format of scientific publication. In this work, we present Collage, a tool designed for rapid prototyping, visualization, and evaluation of different information extraction models on scientific PDFs. Collage allows the use and evaluation of any HuggingFace token classifier, several LLMs, and multiple other task-specific models out of the box, and provides extensible software interfaces to accelerate experimentation with new models. Further, we enable both developers and users of NLP-based tools to inspect, debug, and better understand modeling pipelines by providing granular views of intermediate states of processing. We demonstrate our system in the context of information extraction to assist with literature review in materials science. |
| title | Collage: Decomposable Rapid Prototyping for Information Extraction on Scientific PDFs |
| topic | Computation and Language Human-Computer Interaction |
| url | https://arxiv.org/abs/2410.23478 |