Generative User-Experience Research for Developing Domain-specific Natural Language Processing Applications

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Zhukova, Anastasia, von Sperl, Lukas, Matt, Christian E., Gipp, Bela
Formato: Preprint
Publicado: 2023
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866929493334032384
author Zhukova, Anastasia
von Sperl, Lukas
Matt, Christian E.
Gipp, Bela
author_facet Zhukova, Anastasia
von Sperl, Lukas
Matt, Christian E.
Gipp, Bela
contents User experience (UX) is a part of human-computer interaction (HCI) research and focuses on increasing intuitiveness, transparency, simplicity, and trust for the system users. Most UX research for machine learning (ML) or natural language processing (NLP) focuses on a data-driven methodology. It engages domain users mainly for usability evaluation. Moreover, more typical UX methods tailor the systems towards user usability, unlike learning about the user needs first. This paper proposes a new methodology for integrating generative UX research into developing domain NLP applications. Generative UX research employs domain users at the initial stages of prototype development, i.e., ideation and concept evaluation, and the last stage for evaluating system usefulness and user utility. The methodology emerged from and is evaluated on a case study about the full-cycle prototype development of a domain-specific semantic search for daily operations in the process industry. A key finding of our case study is that involving domain experts increases their interest and trust in the final NLP application. The combined UX+NLP research of the proposed method efficiently considers data- and user-driven opportunities and constraints, which can be crucial for developing NLP applications.
format Preprint
id arxiv_https___arxiv_org_abs_2306_16143
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Generative User-Experience Research for Developing Domain-specific Natural Language Processing Applications
Zhukova, Anastasia
von Sperl, Lukas
Matt, Christian E.
Gipp, Bela
Computation and Language
Artificial Intelligence
Human-Computer Interaction
User experience (UX) is a part of human-computer interaction (HCI) research and focuses on increasing intuitiveness, transparency, simplicity, and trust for the system users. Most UX research for machine learning (ML) or natural language processing (NLP) focuses on a data-driven methodology. It engages domain users mainly for usability evaluation. Moreover, more typical UX methods tailor the systems towards user usability, unlike learning about the user needs first. This paper proposes a new methodology for integrating generative UX research into developing domain NLP applications. Generative UX research employs domain users at the initial stages of prototype development, i.e., ideation and concept evaluation, and the last stage for evaluating system usefulness and user utility. The methodology emerged from and is evaluated on a case study about the full-cycle prototype development of a domain-specific semantic search for daily operations in the process industry. A key finding of our case study is that involving domain experts increases their interest and trust in the final NLP application. The combined UX+NLP research of the proposed method efficiently considers data- and user-driven opportunities and constraints, which can be crucial for developing NLP applications.
title Generative User-Experience Research for Developing Domain-specific Natural Language Processing Applications
topic Computation and Language
Artificial Intelligence
Human-Computer Interaction
url https://arxiv.org/abs/2306.16143