Assisted Data Annotation for Business Process Information Extraction from Textual Documents
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866916420685660160 |
|---|---|
| author | Neuberger, Julian van der Aa, Han Ackermann, Lars Buschek, Daniel Herrmann, Jannic Jablonski, Stefan |
| author_facet | Neuberger, Julian van der Aa, Han Ackermann, Lars Buschek, Daniel Herrmann, Jannic Jablonski, Stefan |
| contents | Machine-learning based generation of process models from natural language text process descriptions provides a solution for the time-intensive and expensive process discovery phase. Many organizations have to carry out this phase, before they can utilize business process management and its benefits. Yet, research towards this is severely restrained by an apparent lack of large and high-quality datasets. This lack of data can be attributed to, among other things, an absence of proper tool assistance for dataset creation, resulting in high workloads and inferior data quality. We explore two assistance features to support dataset creation, a recommendation system for identifying process information in the text and visualization of the current state of already identified process information as a graphical business process model. A controlled user study with 31 participants shows that assisting dataset creators with recommendations lowers all aspects of workload, up to $-51.0\%$, and significantly improves annotation quality, up to $+38.9\%$. We make all data and code available to encourage further research on additional novel assistance strategies. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_01356 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Assisted Data Annotation for Business Process Information Extraction from Textual Documents Neuberger, Julian van der Aa, Han Ackermann, Lars Buschek, Daniel Herrmann, Jannic Jablonski, Stefan Computation and Language Machine-learning based generation of process models from natural language text process descriptions provides a solution for the time-intensive and expensive process discovery phase. Many organizations have to carry out this phase, before they can utilize business process management and its benefits. Yet, research towards this is severely restrained by an apparent lack of large and high-quality datasets. This lack of data can be attributed to, among other things, an absence of proper tool assistance for dataset creation, resulting in high workloads and inferior data quality. We explore two assistance features to support dataset creation, a recommendation system for identifying process information in the text and visualization of the current state of already identified process information as a graphical business process model. A controlled user study with 31 participants shows that assisting dataset creators with recommendations lowers all aspects of workload, up to $-51.0\%$, and significantly improves annotation quality, up to $+38.9\%$. We make all data and code available to encourage further research on additional novel assistance strategies. |
| title | Assisted Data Annotation for Business Process Information Extraction from Textual Documents |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2410.01356 |