ChatSpamDetector: Leveraging Large Language Models for Effective Phishing Email Detection

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Koide, Takashi, Fukushi, Naoki, Nakano, Hiroki, Chiba, Daiki
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909293882638336
author Koide, Takashi
Fukushi, Naoki
Nakano, Hiroki
Chiba, Daiki
author_facet Koide, Takashi
Fukushi, Naoki
Nakano, Hiroki
Chiba, Daiki
contents The proliferation of phishing sites and emails poses significant challenges to existing cybersecurity efforts. Despite advances in malicious email filters and email security protocols, problems with oversight and false positives persist. Users often struggle to understand why emails are flagged as potentially fraudulent, risking the possibility of missing important communications or mistakenly trusting deceptive phishing emails. This study introduces ChatSpamDetector, a system that uses large language models (LLMs) to detect phishing emails. By converting email data into a prompt suitable for LLM analysis, the system provides a highly accurate determination of whether an email is phishing or not. Importantly, it offers detailed reasoning for its phishing determinations, assisting users in making informed decisions about how to handle suspicious emails. We conducted an evaluation using a comprehensive phishing email dataset and compared our system to several LLMs and baseline systems. We confirmed that our system using GPT-4 has superior detection capabilities with an accuracy of 99.70%. Advanced contextual interpretation by LLMs enables the identification of various phishing tactics and impersonations, making them a potentially powerful tool in the fight against email-based phishing threats.
format Preprint
id arxiv_https___arxiv_org_abs_2402_18093
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle ChatSpamDetector: Leveraging Large Language Models for Effective Phishing Email Detection
Koide, Takashi
Fukushi, Naoki
Nakano, Hiroki
Chiba, Daiki
Cryptography and Security
The proliferation of phishing sites and emails poses significant challenges to existing cybersecurity efforts. Despite advances in malicious email filters and email security protocols, problems with oversight and false positives persist. Users often struggle to understand why emails are flagged as potentially fraudulent, risking the possibility of missing important communications or mistakenly trusting deceptive phishing emails. This study introduces ChatSpamDetector, a system that uses large language models (LLMs) to detect phishing emails. By converting email data into a prompt suitable for LLM analysis, the system provides a highly accurate determination of whether an email is phishing or not. Importantly, it offers detailed reasoning for its phishing determinations, assisting users in making informed decisions about how to handle suspicious emails. We conducted an evaluation using a comprehensive phishing email dataset and compared our system to several LLMs and baseline systems. We confirmed that our system using GPT-4 has superior detection capabilities with an accuracy of 99.70%. Advanced contextual interpretation by LLMs enables the identification of various phishing tactics and impersonations, making them a potentially powerful tool in the fight against email-based phishing threats.
title ChatSpamDetector: Leveraging Large Language Models for Effective Phishing Email Detection
topic Cryptography and Security
url https://arxiv.org/abs/2402.18093