NLP Workbench: Efficient and Extensible Integration of State-of-the-art Text Mining Tools
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2023
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866929264257925120 |
|---|---|
| author | Yao, Peiran Kosmajac, Matej Waheed, Abeer Guzhva, Kostyantyn Hervieux, Natalie Barbosa, Denilson |
| author_facet | Yao, Peiran Kosmajac, Matej Waheed, Abeer Guzhva, Kostyantyn Hervieux, Natalie Barbosa, Denilson |
| contents | NLP Workbench is a web-based platform for text mining that allows non-expert users to obtain semantic understanding of large-scale corpora using state-of-the-art text mining models. The platform is built upon latest pre-trained models and open source systems from academia that provide semantic analysis functionalities, including but not limited to entity linking, sentiment analysis, semantic parsing, and relation extraction. Its extensible design enables researchers and developers to smoothly replace an existing model or integrate a new one. To improve efficiency, we employ a microservice architecture that facilitates allocation of acceleration hardware and parallelization of computation. This paper presents the architecture of NLP Workbench and discusses the challenges we faced in designing it. We also discuss diverse use cases of NLP Workbench and the benefits of using it over other approaches. The platform is under active development, with its source code released under the MIT license. A website and a short video demonstrating our platform are also available. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2303_01410 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | NLP Workbench: Efficient and Extensible Integration of State-of-the-art Text Mining Tools Yao, Peiran Kosmajac, Matej Waheed, Abeer Guzhva, Kostyantyn Hervieux, Natalie Barbosa, Denilson Computation and Language NLP Workbench is a web-based platform for text mining that allows non-expert users to obtain semantic understanding of large-scale corpora using state-of-the-art text mining models. The platform is built upon latest pre-trained models and open source systems from academia that provide semantic analysis functionalities, including but not limited to entity linking, sentiment analysis, semantic parsing, and relation extraction. Its extensible design enables researchers and developers to smoothly replace an existing model or integrate a new one. To improve efficiency, we employ a microservice architecture that facilitates allocation of acceleration hardware and parallelization of computation. This paper presents the architecture of NLP Workbench and discusses the challenges we faced in designing it. We also discuss diverse use cases of NLP Workbench and the benefits of using it over other approaches. The platform is under active development, with its source code released under the MIT license. A website and a short video demonstrating our platform are also available. |
| title | NLP Workbench: Efficient and Extensible Integration of State-of-the-art Text Mining Tools |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2303.01410 |