The Shadow of Fraud: The Emerging Danger of AI-powered Social Engineering and its Possible Cure

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Yu, Jingru, Yu, Yi, Wang, Xuhong, Lin, Yilun, Yang, Manzhi, Qiao, Yu, Wang, Fei-Yue
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910538873700352
author Yu, Jingru
Yu, Yi
Wang, Xuhong
Lin, Yilun
Yang, Manzhi
Qiao, Yu
Wang, Fei-Yue
author_facet Yu, Jingru
Yu, Yi
Wang, Xuhong
Lin, Yilun
Yang, Manzhi
Qiao, Yu
Wang, Fei-Yue
contents Social engineering (SE) attacks remain a significant threat to both individuals and organizations. The advancement of Artificial Intelligence (AI), including diffusion models and large language models (LLMs), has potentially intensified these threats by enabling more personalized and convincing attacks. This survey paper categorizes SE attack mechanisms, analyzes their evolution, and explores methods for measuring these threats. It highlights the challenges in raising awareness about the risks of AI-enhanced SE attacks and offers insights into developing proactive and adaptable defense strategies. Additionally, we introduce a categorization of the evolving nature of AI-powered social engineering attacks into "3E phases": Enlarging, wherein the magnitude of attacks expands through the leverage of digital media; Enriching, introducing novel attack vectors and techniques; and Emerging, signifying the advent of novel threats and methods. Moreover, we emphasize the necessity for a robust framework to assess the risk of AI-powered SE attacks. By identifying and addressing gaps in existing research, we aim to guide future studies and encourage the development of more effective defenses against the growing threat of AI-powered social engineering.
format Preprint
id arxiv_https___arxiv_org_abs_2407_15912
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle The Shadow of Fraud: The Emerging Danger of AI-powered Social Engineering and its Possible Cure
Yu, Jingru
Yu, Yi
Wang, Xuhong
Lin, Yilun
Yang, Manzhi
Qiao, Yu
Wang, Fei-Yue
Cryptography and Security
Social engineering (SE) attacks remain a significant threat to both individuals and organizations. The advancement of Artificial Intelligence (AI), including diffusion models and large language models (LLMs), has potentially intensified these threats by enabling more personalized and convincing attacks. This survey paper categorizes SE attack mechanisms, analyzes their evolution, and explores methods for measuring these threats. It highlights the challenges in raising awareness about the risks of AI-enhanced SE attacks and offers insights into developing proactive and adaptable defense strategies. Additionally, we introduce a categorization of the evolving nature of AI-powered social engineering attacks into "3E phases": Enlarging, wherein the magnitude of attacks expands through the leverage of digital media; Enriching, introducing novel attack vectors and techniques; and Emerging, signifying the advent of novel threats and methods. Moreover, we emphasize the necessity for a robust framework to assess the risk of AI-powered SE attacks. By identifying and addressing gaps in existing research, we aim to guide future studies and encourage the development of more effective defenses against the growing threat of AI-powered social engineering.
title The Shadow of Fraud: The Emerging Danger of AI-powered Social Engineering and its Possible Cure
topic Cryptography and Security
url https://arxiv.org/abs/2407.15912