Generating Privacy Stories From Software Documentation

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Baldwin, Wilder, Chintakuntla, Shashank, Parajuli, Shreyah, Pourghasemi, Ali, Shanz, Ryan, Ghanavati, Sepideh
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866916815061385216
author Baldwin, Wilder
Chintakuntla, Shashank
Parajuli, Shreyah
Pourghasemi, Ali
Shanz, Ryan
Ghanavati, Sepideh
author_facet Baldwin, Wilder
Chintakuntla, Shashank
Parajuli, Shreyah
Pourghasemi, Ali
Shanz, Ryan
Ghanavati, Sepideh
contents Research shows that analysts and developers consider privacy as a security concept or as an afterthought, which may lead to non-compliance and violation of users' privacy. Most current approaches, however, focus on extracting legal requirements from the regulations and evaluating the compliance of software and processes with them. In this paper, we develop a novel approach based on chain-of-thought prompting (CoT), in-context-learning (ICL), and Large Language Models (LLMs) to extract privacy behaviors from various software documents prior to and during software development, and then generate privacy requirements in the format of user stories. Our results show that most commonly used LLMs, such as GPT-4o and Llama 3, can identify privacy behaviors and generate privacy user stories with F1 scores exceeding 0.8. We also show that the performance of these models could be improved through parameter-tuning. Our findings provide insight into using and optimizing LLMs for generating privacy requirements given software documents created prior to or throughout the software development lifecycle.
format Preprint
id arxiv_https___arxiv_org_abs_2506_23014
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Generating Privacy Stories From Software Documentation
Baldwin, Wilder
Chintakuntla, Shashank
Parajuli, Shreyah
Pourghasemi, Ali
Shanz, Ryan
Ghanavati, Sepideh
Software Engineering
Artificial Intelligence
Research shows that analysts and developers consider privacy as a security concept or as an afterthought, which may lead to non-compliance and violation of users' privacy. Most current approaches, however, focus on extracting legal requirements from the regulations and evaluating the compliance of software and processes with them. In this paper, we develop a novel approach based on chain-of-thought prompting (CoT), in-context-learning (ICL), and Large Language Models (LLMs) to extract privacy behaviors from various software documents prior to and during software development, and then generate privacy requirements in the format of user stories. Our results show that most commonly used LLMs, such as GPT-4o and Llama 3, can identify privacy behaviors and generate privacy user stories with F1 scores exceeding 0.8. We also show that the performance of these models could be improved through parameter-tuning. Our findings provide insight into using and optimizing LLMs for generating privacy requirements given software documents created prior to or throughout the software development lifecycle.
title Generating Privacy Stories From Software Documentation
topic Software Engineering
Artificial Intelligence
url https://arxiv.org/abs/2506.23014