Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2508.03342 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916882436587520 |
|---|---|
| author | Gurabi, Mehdi Akbari Nitz, Lasse Castravet, Radu-Mihai Matzutt, Roman Mandal, Avikarsha Decker, Stefan |
| author_facet | Gurabi, Mehdi Akbari Nitz, Lasse Castravet, Radu-Mihai Matzutt, Roman Mandal, Avikarsha Decker, Stefan |
| contents | Existing cybersecurity playbooks are often written in heterogeneous, non-machine-readable formats, which limits their automation and interoperability across Security Orchestration, Automation, and Response platforms. This paper explores the suitability of Large Language Models, combined with Prompt Engineering, to automatically translate legacy incident response playbooks into the standardized, machine-readable CACAO format. We systematically examine various Prompt Engineering techniques and carefully design prompts aimed at maximizing syntactic accuracy and semantic fidelity for control flow preservation. Our modular transformation pipeline integrates a syntax checker to ensure syntactic correctness and features an iterative refinement mechanism that progressively reduces syntactic errors. We evaluate the proposed approach on a custom-generated dataset comprising diverse legacy playbooks paired with manually created CACAO references. The results demonstrate that our method significantly improves the accuracy of playbook transformation over baseline models, effectively captures complex workflow structures, and substantially reduces errors. It highlights the potential for practical deployment in automated cybersecurity playbook transformation tasks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_03342 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | From Legacy to Standard: LLM-Assisted Transformation of Cybersecurity Playbooks into CACAO Format Gurabi, Mehdi Akbari Nitz, Lasse Castravet, Radu-Mihai Matzutt, Roman Mandal, Avikarsha Decker, Stefan Cryptography and Security Artificial Intelligence Existing cybersecurity playbooks are often written in heterogeneous, non-machine-readable formats, which limits their automation and interoperability across Security Orchestration, Automation, and Response platforms. This paper explores the suitability of Large Language Models, combined with Prompt Engineering, to automatically translate legacy incident response playbooks into the standardized, machine-readable CACAO format. We systematically examine various Prompt Engineering techniques and carefully design prompts aimed at maximizing syntactic accuracy and semantic fidelity for control flow preservation. Our modular transformation pipeline integrates a syntax checker to ensure syntactic correctness and features an iterative refinement mechanism that progressively reduces syntactic errors. We evaluate the proposed approach on a custom-generated dataset comprising diverse legacy playbooks paired with manually created CACAO references. The results demonstrate that our method significantly improves the accuracy of playbook transformation over baseline models, effectively captures complex workflow structures, and substantially reduces errors. It highlights the potential for practical deployment in automated cybersecurity playbook transformation tasks. |
| title | From Legacy to Standard: LLM-Assisted Transformation of Cybersecurity Playbooks into CACAO Format |
| topic | Cryptography and Security Artificial Intelligence |
| url | https://arxiv.org/abs/2508.03342 |