Enregistré dans:
Détails bibliographiques
Auteurs principaux: Malik, Garima, Cevik, Mucahit, Basar, Ayse, Parikh, Devang
Format: Preprint
Publié: 2022
Sujets:
Accès en ligne:https://arxiv.org/abs/2206.13690
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912482096840704
author Malik, Garima
Cevik, Mucahit
Basar, Ayse
Parikh, Devang
author_facet Malik, Garima
Cevik, Mucahit
Basar, Ayse
Parikh, Devang
contents Identifying conflicting requirements is a key challenge in software requirement engineering, often overlooked in automated solutions. Most existing approaches rely on handcrafted rules or struggle to generalize across different domains. In this paper, we introduce S3CDA, a two-phase algorithm designed to automatically detect conflicts in software requirements. Our method first identifies potentially conflicting requirement pairs using semantic similarity, and then validates them by analyzing overlapping domain-specific entities. We evaluate S3CDA on five diverse real-world datasets and compare it against popular large language models like GPT-4o, Llama-3, Sonnet-3.5 and Gemini-1.5. While LLMs show promise, especially on general datasets, S3CDA consistently performs better in domain-specific settings with higher performance. Our findings suggest that combining Natural Language Processing (NLP) techniques with domain-aware insights offers a practical and effective alternative for conflict detection in requirements.
format Preprint
id arxiv_https___arxiv_org_abs_2206_13690
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Supervised Semantic Similarity-based Conflict Detection Algorithm: S3CDA
Malik, Garima
Cevik, Mucahit
Basar, Ayse
Parikh, Devang
Software Engineering
Identifying conflicting requirements is a key challenge in software requirement engineering, often overlooked in automated solutions. Most existing approaches rely on handcrafted rules or struggle to generalize across different domains. In this paper, we introduce S3CDA, a two-phase algorithm designed to automatically detect conflicts in software requirements. Our method first identifies potentially conflicting requirement pairs using semantic similarity, and then validates them by analyzing overlapping domain-specific entities. We evaluate S3CDA on five diverse real-world datasets and compare it against popular large language models like GPT-4o, Llama-3, Sonnet-3.5 and Gemini-1.5. While LLMs show promise, especially on general datasets, S3CDA consistently performs better in domain-specific settings with higher performance. Our findings suggest that combining Natural Language Processing (NLP) techniques with domain-aware insights offers a practical and effective alternative for conflict detection in requirements.
title Supervised Semantic Similarity-based Conflict Detection Algorithm: S3CDA
topic Software Engineering
url https://arxiv.org/abs/2206.13690