PhishAgent: A Robust Multimodal Agent for Phishing Webpage Detection

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Cao, Tri, Huang, Chengyu, Li, Yuexin, Wang, Huilin, He, Amy, Oo, Nay, Hooi, Bryan
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910795879677952
author Cao, Tri
Huang, Chengyu
Li, Yuexin
Wang, Huilin
He, Amy
Oo, Nay
Hooi, Bryan
author_facet Cao, Tri
Huang, Chengyu
Li, Yuexin
Wang, Huilin
He, Amy
Oo, Nay
Hooi, Bryan
contents Phishing attacks are a major threat to online security, exploiting user vulnerabilities to steal sensitive information. Various methods have been developed to counteract phishing, each with varying levels of accuracy, but they also face notable limitations. In this study, we introduce PhishAgent, a multimodal agent that combines a wide range of tools, integrating both online and offline knowledge bases with Multimodal Large Language Models (MLLMs). This combination leads to broader brand coverage, which enhances brand recognition and recall. Furthermore, we propose a multimodal information retrieval framework designed to extract the relevant top k items from offline knowledge bases, using available information from a webpage, including logos and HTML. Our empirical results, based on three real-world datasets, demonstrate that the proposed framework significantly enhances detection accuracy and reduces both false positives and false negatives, while maintaining model efficiency. Additionally, PhishAgent shows strong resilience against various types of adversarial attacks.
format Preprint
id arxiv_https___arxiv_org_abs_2408_10738
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle PhishAgent: A Robust Multimodal Agent for Phishing Webpage Detection
Cao, Tri
Huang, Chengyu
Li, Yuexin
Wang, Huilin
He, Amy
Oo, Nay
Hooi, Bryan
Cryptography and Security
Phishing attacks are a major threat to online security, exploiting user vulnerabilities to steal sensitive information. Various methods have been developed to counteract phishing, each with varying levels of accuracy, but they also face notable limitations. In this study, we introduce PhishAgent, a multimodal agent that combines a wide range of tools, integrating both online and offline knowledge bases with Multimodal Large Language Models (MLLMs). This combination leads to broader brand coverage, which enhances brand recognition and recall. Furthermore, we propose a multimodal information retrieval framework designed to extract the relevant top k items from offline knowledge bases, using available information from a webpage, including logos and HTML. Our empirical results, based on three real-world datasets, demonstrate that the proposed framework significantly enhances detection accuracy and reduces both false positives and false negatives, while maintaining model efficiency. Additionally, PhishAgent shows strong resilience against various types of adversarial attacks.
title PhishAgent: A Robust Multimodal Agent for Phishing Webpage Detection
topic Cryptography and Security
url https://arxiv.org/abs/2408.10738