Evaluating the Effectiveness of GPT-4 Turbo in Creating Defeaters for Assurance Cases
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866913217334214656 |
|---|---|
| author | Shahandashti, Kimya Khakzad Sivakumar, Mithila Mohajer, Mohammad Mahdi Belle, Alvine B. Wang, Song Lethbridge, Timothy C. |
| author_facet | Shahandashti, Kimya Khakzad Sivakumar, Mithila Mohajer, Mohammad Mahdi Belle, Alvine B. Wang, Song Lethbridge, Timothy C. |
| contents | Assurance cases (ACs) are structured arguments that support the verification of the correct implementation of systems' non-functional requirements, such as safety and security, thereby preventing system failures which could lead to catastrophic outcomes, including loss of lives. ACs facilitate the certification of systems in accordance with industrial standards, for example, DO-178C and ISO 26262. Identifying defeaters arguments that refute these ACs is essential for improving the robustness and confidence in ACs. To automate this task, we introduce a novel method that leverages the capabilities of GPT-4 Turbo, an advanced Large Language Model (LLM) developed by OpenAI, to identify defeaters within ACs formalized using the Eliminative Argumentation (EA) notation. Our initial evaluation gauges the model's proficiency in understanding and generating arguments within this framework. The findings indicate that GPT-4 Turbo excels in EA notation and is capable of generating various types of defeaters. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_17991 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Evaluating the Effectiveness of GPT-4 Turbo in Creating Defeaters for Assurance Cases Shahandashti, Kimya Khakzad Sivakumar, Mithila Mohajer, Mohammad Mahdi Belle, Alvine B. Wang, Song Lethbridge, Timothy C. Software Engineering Assurance cases (ACs) are structured arguments that support the verification of the correct implementation of systems' non-functional requirements, such as safety and security, thereby preventing system failures which could lead to catastrophic outcomes, including loss of lives. ACs facilitate the certification of systems in accordance with industrial standards, for example, DO-178C and ISO 26262. Identifying defeaters arguments that refute these ACs is essential for improving the robustness and confidence in ACs. To automate this task, we introduce a novel method that leverages the capabilities of GPT-4 Turbo, an advanced Large Language Model (LLM) developed by OpenAI, to identify defeaters within ACs formalized using the Eliminative Argumentation (EA) notation. Our initial evaluation gauges the model's proficiency in understanding and generating arguments within this framework. The findings indicate that GPT-4 Turbo excels in EA notation and is capable of generating various types of defeaters. |
| title | Evaluating the Effectiveness of GPT-4 Turbo in Creating Defeaters for Assurance Cases |
| topic | Software Engineering |
| url | https://arxiv.org/abs/2401.17991 |