Small Language Models for Phishing Website Detection: Cost, Performance, and Privacy Trade-Offs

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Goldenits, Georg, Koenig, Philip, Raubitzek, Sebastian, Ekelhart, Andreas
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908665587433472
author Goldenits, Georg
Koenig, Philip
Raubitzek, Sebastian
Ekelhart, Andreas
author_facet Goldenits, Georg
Koenig, Philip
Raubitzek, Sebastian
Ekelhart, Andreas
contents Phishing websites pose a major cybersecurity threat, exploiting unsuspecting users and causing significant financial and organisational harm. Traditional machine learning approaches for phishing detection often require extensive feature engineering, continuous retraining, and costly infrastructure maintenance. At the same time, proprietary large language models (LLMs) have demonstrated strong performance in phishing-related classification tasks, but their operational costs and reliance on external providers limit their practical adoption in many business environments. This paper investigates the feasibility of small language models (SLMs) for detecting phishing websites using only their raw HTML code. A key advantage of these models is that they can be deployed on local infrastructure, providing organisations with greater control over data and operations. We systematically evaluate 15 commonly used Small Language Models (SLMs), ranging from 1 billion to 70 billion parameters, benchmarking their classification accuracy, computational requirements, and cost-efficiency. Our results highlight the trade-offs between detection performance and resource consumption, demonstrating that while SLMs underperform compared to state-of-the-art proprietary LLMs, they can still provide a viable and scalable alternative to external LLM services. By presenting a comparative analysis of costs and benefits, this work lays the foundation for future research on the adaptation, fine-tuning, and deployment of SLMs in phishing detection systems, aiming to balance security effectiveness and economic practicality.
format Preprint
id arxiv_https___arxiv_org_abs_2511_15434
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Small Language Models for Phishing Website Detection: Cost, Performance, and Privacy Trade-Offs
Goldenits, Georg
Koenig, Philip
Raubitzek, Sebastian
Ekelhart, Andreas
Cryptography and Security
Artificial Intelligence
Phishing websites pose a major cybersecurity threat, exploiting unsuspecting users and causing significant financial and organisational harm. Traditional machine learning approaches for phishing detection often require extensive feature engineering, continuous retraining, and costly infrastructure maintenance. At the same time, proprietary large language models (LLMs) have demonstrated strong performance in phishing-related classification tasks, but their operational costs and reliance on external providers limit their practical adoption in many business environments. This paper investigates the feasibility of small language models (SLMs) for detecting phishing websites using only their raw HTML code. A key advantage of these models is that they can be deployed on local infrastructure, providing organisations with greater control over data and operations. We systematically evaluate 15 commonly used Small Language Models (SLMs), ranging from 1 billion to 70 billion parameters, benchmarking their classification accuracy, computational requirements, and cost-efficiency. Our results highlight the trade-offs between detection performance and resource consumption, demonstrating that while SLMs underperform compared to state-of-the-art proprietary LLMs, they can still provide a viable and scalable alternative to external LLM services. By presenting a comparative analysis of costs and benefits, this work lays the foundation for future research on the adaptation, fine-tuning, and deployment of SLMs in phishing detection systems, aiming to balance security effectiveness and economic practicality.
title Small Language Models for Phishing Website Detection: Cost, Performance, and Privacy Trade-Offs
topic Cryptography and Security
Artificial Intelligence
url https://arxiv.org/abs/2511.15434