Asset-centric Threat Modeling for AI-based Systems

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: von der Assen, Jan, Sharif, Jamo, Feng, Chao, Killer, Christian, Bovet, Gérôme, Stiller, Burkhard
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911899789033472
author von der Assen, Jan
Sharif, Jamo
Feng, Chao
Killer, Christian
Bovet, Gérôme
Stiller, Burkhard
author_facet von der Assen, Jan
Sharif, Jamo
Feng, Chao
Killer, Christian
Bovet, Gérôme
Stiller, Burkhard
contents Threat modeling is a popular method to securely develop systems by achieving awareness of potential areas of future damage caused by adversaries. However, threat modeling for systems relying on Artificial Intelligence is still not well explored. While conventional threat modeling methods and tools did not address AI-related threats, research on this amalgamation still lacks solutions capable of guiding and automating the process, as well as providing evidence that the methods hold up in practice. Consequently, this paper presents ThreatFinderAI, an approach and tool providing guidance and automation to model AI-related assets, threats, countermeasures, and quantify residual risks. To evaluate the practicality of the approach, participants were tasked to recreate a threat model developed by cybersecurity experts of an AI-based healthcare platform. Secondly, the approach was used to identify and discuss strategic risks in an LLM-based application through a case study. Overall, the solution's usability was well-perceived and effectively supports threat identification and risk discussion.
format Preprint
id arxiv_https___arxiv_org_abs_2403_06512
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Asset-centric Threat Modeling for AI-based Systems
von der Assen, Jan
Sharif, Jamo
Feng, Chao
Killer, Christian
Bovet, Gérôme
Stiller, Burkhard
Cryptography and Security
Software Engineering
Threat modeling is a popular method to securely develop systems by achieving awareness of potential areas of future damage caused by adversaries. However, threat modeling for systems relying on Artificial Intelligence is still not well explored. While conventional threat modeling methods and tools did not address AI-related threats, research on this amalgamation still lacks solutions capable of guiding and automating the process, as well as providing evidence that the methods hold up in practice. Consequently, this paper presents ThreatFinderAI, an approach and tool providing guidance and automation to model AI-related assets, threats, countermeasures, and quantify residual risks. To evaluate the practicality of the approach, participants were tasked to recreate a threat model developed by cybersecurity experts of an AI-based healthcare platform. Secondly, the approach was used to identify and discuss strategic risks in an LLM-based application through a case study. Overall, the solution's usability was well-perceived and effectively supports threat identification and risk discussion.
title Asset-centric Threat Modeling for AI-based Systems
topic Cryptography and Security
Software Engineering
url https://arxiv.org/abs/2403.06512