Effect of Requirements Analyst Experience on Elicitation Effectiveness: A Family of Empirical Studies

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Aranda, Alejandrina M., Dieste, Oscar, Panach, Jose I., Juristo, Natalia
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909293664534528
author Aranda, Alejandrina M.
Dieste, Oscar
Panach, Jose I.
Juristo, Natalia
author_facet Aranda, Alejandrina M.
Dieste, Oscar
Panach, Jose I.
Juristo, Natalia
contents Context. Nowadays there is a great deal of uncertainty surrounding the effects of experience on Requirements Engineering (RE). There is a widespread idea that experience improves analyst performance. However, there are empirical studies that demonstrate the exact opposite. Aim. Determine whether experience influences requirements analyst performance. Method. Quasi-experiments run with students and professionals. The experimental task was to elicit requirements using the open interview technique immediately followed by the consolidation of the elicited information in domains with which the analysts were and were not familiar. Results. In unfamiliar domains, interview, requirements, development, and professional experience does not influence analyst effectiveness. In familiar domains, effectiveness varies depending on the type of experience. Interview experience has a strong positive effect, whereas professional experience has a moderate negative effect. Requirements experience appears to have a moderately positive effect; however, the statistical power of the analysis is insufficient to be able to confirm this point. Development experience has no effect either way. Conclusion. Experience effects analyst effectiveness differently depending on the problem domain type (familiar, unfamiliar). Generally, experience does not account for all the observed variability, which means there are other influential factors.
format Preprint
id arxiv_https___arxiv_org_abs_2408_12538
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Effect of Requirements Analyst Experience on Elicitation Effectiveness: A Family of Empirical Studies
Aranda, Alejandrina M.
Dieste, Oscar
Panach, Jose I.
Juristo, Natalia
Software Engineering
Context. Nowadays there is a great deal of uncertainty surrounding the effects of experience on Requirements Engineering (RE). There is a widespread idea that experience improves analyst performance. However, there are empirical studies that demonstrate the exact opposite. Aim. Determine whether experience influences requirements analyst performance. Method. Quasi-experiments run with students and professionals. The experimental task was to elicit requirements using the open interview technique immediately followed by the consolidation of the elicited information in domains with which the analysts were and were not familiar. Results. In unfamiliar domains, interview, requirements, development, and professional experience does not influence analyst effectiveness. In familiar domains, effectiveness varies depending on the type of experience. Interview experience has a strong positive effect, whereas professional experience has a moderate negative effect. Requirements experience appears to have a moderately positive effect; however, the statistical power of the analysis is insufficient to be able to confirm this point. Development experience has no effect either way. Conclusion. Experience effects analyst effectiveness differently depending on the problem domain type (familiar, unfamiliar). Generally, experience does not account for all the observed variability, which means there are other influential factors.
title Effect of Requirements Analyst Experience on Elicitation Effectiveness: A Family of Empirical Studies
topic Software Engineering
url https://arxiv.org/abs/2408.12538