On the impact of semantic transparency on understanding and reviewing social goal models

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Santos, Mafalda, Gralha, Catarina, Goulão, Miguel, Araújo, João, Moreira, Ana
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866912695962304512
author Santos, Mafalda
Gralha, Catarina
Goulão, Miguel
Araújo, João
Moreira, Ana
author_facet Santos, Mafalda
Gralha, Catarina
Goulão, Miguel
Araújo, João
Moreira, Ana
contents Context: i* is one of the most influential languages in the Requirements Engineering research community. Perhaps due to its complexity and low adoption in industry, it became a natural candidate for studies aiming at improving its concrete syntax and the stakeholders' ability to correctly interpret i* models. Objectives: We evaluate the impact of semantic transparency on understanding and reviewing i* models, in the presence of a language key. Methods: We performed a quasi-experiment comparing the standard i* concrete syntax with an alternative that has an increased semantic transparency. We asked 57 novice participants to perform understanding and reviewing tasks on i* models, and measured their accuracy, speed and ease, using metrics of task success, time and effort, collected with eye-tracking and participants' feedback. Results: We found no evidence of improved accuracy or speed attributable to the alternative concrete syntax. Although participants' perceived ease was similar, they devoted significantly less visual effort to the model and the provided language key, when using the alternative concrete syntax. Conclusions: The context provided by the model and language key may mitigate the i* symbol recognition deficit reported in previous works. However, the alternative concrete syntax required a significantly lower visual effort.
format Preprint
id arxiv_https___arxiv_org_abs_2511_06110
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle On the impact of semantic transparency on understanding and reviewing social goal models
Santos, Mafalda
Gralha, Catarina
Goulão, Miguel
Araújo, João
Moreira, Ana
Software Engineering
Context: i* is one of the most influential languages in the Requirements Engineering research community. Perhaps due to its complexity and low adoption in industry, it became a natural candidate for studies aiming at improving its concrete syntax and the stakeholders' ability to correctly interpret i* models. Objectives: We evaluate the impact of semantic transparency on understanding and reviewing i* models, in the presence of a language key. Methods: We performed a quasi-experiment comparing the standard i* concrete syntax with an alternative that has an increased semantic transparency. We asked 57 novice participants to perform understanding and reviewing tasks on i* models, and measured their accuracy, speed and ease, using metrics of task success, time and effort, collected with eye-tracking and participants' feedback. Results: We found no evidence of improved accuracy or speed attributable to the alternative concrete syntax. Although participants' perceived ease was similar, they devoted significantly less visual effort to the model and the provided language key, when using the alternative concrete syntax. Conclusions: The context provided by the model and language key may mitigate the i* symbol recognition deficit reported in previous works. However, the alternative concrete syntax required a significantly lower visual effort.
title On the impact of semantic transparency on understanding and reviewing social goal models
topic Software Engineering
url https://arxiv.org/abs/2511.06110