Practical Guidelines for the Selection and Evaluation of Natural Language Processing Techniques in Requirements Engineering

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Sabetzadeh, Mehrdad, Arora, Chetan
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914871761698816
author Sabetzadeh, Mehrdad
Arora, Chetan
author_facet Sabetzadeh, Mehrdad
Arora, Chetan
contents Natural Language Processing (NLP) is now a cornerstone of requirements automation. One compelling factor behind the growing adoption of NLP in Requirements Engineering (RE) is the prevalent use of natural language (NL) for specifying requirements in industry. NLP techniques are commonly used for automatically classifying requirements, extracting important information, e.g., domain models and glossary terms, and performing quality assurance tasks, such as ambiguity handling and completeness checking. With so many different NLP solution strategies available and the possibility of applying machine learning alongside, it can be challenging to choose the right strategy for a specific RE task and to evaluate the resulting solution in an empirically rigorous manner. In this chapter, we present guidelines for the selection of NLP techniques as well as for their evaluation in the context of RE. In particular, we discuss how to choose among different strategies such as traditional NLP, feature-based machine learning, and language-model-based methods. Our ultimate hope for this chapter is to serve as a stepping stone, assisting newcomers to NLP4RE in quickly initiating themselves into the NLP technologies most pertinent to the RE field.
format Preprint
id arxiv_https___arxiv_org_abs_2401_01508
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Practical Guidelines for the Selection and Evaluation of Natural Language Processing Techniques in Requirements Engineering
Sabetzadeh, Mehrdad
Arora, Chetan
Software Engineering
Natural Language Processing (NLP) is now a cornerstone of requirements automation. One compelling factor behind the growing adoption of NLP in Requirements Engineering (RE) is the prevalent use of natural language (NL) for specifying requirements in industry. NLP techniques are commonly used for automatically classifying requirements, extracting important information, e.g., domain models and glossary terms, and performing quality assurance tasks, such as ambiguity handling and completeness checking. With so many different NLP solution strategies available and the possibility of applying machine learning alongside, it can be challenging to choose the right strategy for a specific RE task and to evaluate the resulting solution in an empirically rigorous manner. In this chapter, we present guidelines for the selection of NLP techniques as well as for their evaluation in the context of RE. In particular, we discuss how to choose among different strategies such as traditional NLP, feature-based machine learning, and language-model-based methods. Our ultimate hope for this chapter is to serve as a stepping stone, assisting newcomers to NLP4RE in quickly initiating themselves into the NLP technologies most pertinent to the RE field.
title Practical Guidelines for the Selection and Evaluation of Natural Language Processing Techniques in Requirements Engineering
topic Software Engineering
url https://arxiv.org/abs/2401.01508