Digital Deception: Generative Artificial Intelligence in Social Engineering and Phishing

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Schmitt, Marc, Flechais, Ivan
Formato: Preprint
Publicado: 2023
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916770660483072
author Schmitt, Marc
Flechais, Ivan
author_facet Schmitt, Marc
Flechais, Ivan
contents The advancement of Artificial Intelligence (AI) and Machine Learning (ML) has profound implications for both the utility and security of our digital interactions. This paper investigates the transformative role of Generative AI in Social Engineering (SE) attacks. We conduct a systematic review of social engineering and AI capabilities and use a theory of social engineering to identify three pillars where Generative AI amplifies the impact of SE attacks: Realistic Content Creation, Advanced Targeting and Personalization, and Automated Attack Infrastructure. We integrate these elements into a conceptual model designed to investigate the complex nature of AI-driven SE attacks - the Generative AI Social Engineering Framework. We further explore human implications and potential countermeasures to mitigate these risks. Our study aims to foster a deeper understanding of the risks, human implications, and countermeasures associated with this emerging paradigm, thereby contributing to a more secure and trustworthy human-computer interaction.
format Preprint
id arxiv_https___arxiv_org_abs_2310_13715
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Digital Deception: Generative Artificial Intelligence in Social Engineering and Phishing
Schmitt, Marc
Flechais, Ivan
Cryptography and Security
Computers and Society
Human-Computer Interaction
The advancement of Artificial Intelligence (AI) and Machine Learning (ML) has profound implications for both the utility and security of our digital interactions. This paper investigates the transformative role of Generative AI in Social Engineering (SE) attacks. We conduct a systematic review of social engineering and AI capabilities and use a theory of social engineering to identify three pillars where Generative AI amplifies the impact of SE attacks: Realistic Content Creation, Advanced Targeting and Personalization, and Automated Attack Infrastructure. We integrate these elements into a conceptual model designed to investigate the complex nature of AI-driven SE attacks - the Generative AI Social Engineering Framework. We further explore human implications and potential countermeasures to mitigate these risks. Our study aims to foster a deeper understanding of the risks, human implications, and countermeasures associated with this emerging paradigm, thereby contributing to a more secure and trustworthy human-computer interaction.
title Digital Deception: Generative Artificial Intelligence in Social Engineering and Phishing
topic Cryptography and Security
Computers and Society
Human-Computer Interaction
url https://arxiv.org/abs/2310.13715