Saved in:
Bibliographic Details
Main Authors: Bobe III, Frank, Vetaw, Gregory D., Pavlick, Chase, Bryner, Darshan, Cook, Matthew, Salas-Vernis, Jose
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2601.10524
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908768903626752
author Bobe III, Frank
Vetaw, Gregory D.
Pavlick, Chase
Bryner, Darshan
Cook, Matthew
Salas-Vernis, Jose
author_facet Bobe III, Frank
Vetaw, Gregory D.
Pavlick, Chase
Bryner, Darshan
Cook, Matthew
Salas-Vernis, Jose
contents The practice of fine-tuning Large Language Models (LLMs) has achieved state-of-the-art performance on specialized tasks, yet diagnosing why these models become brittle and fail to generalize remains a critical open problem. To address this, we introduce and apply a multi-layered diagnostic framework to a cross-architectural study. We fine-tune Llama 3.1 8B, Gemma 2 9B, and Mistral models on a high-stakes phishing detection task and use SHAP analysis and mechanistic interpretability to uncover the root causes of their generalization failures. Our investigation reveals three critical findings: (1) Generalization is driven by a powerful synergy between architecture and data diversity. The Gemma 2 9B model achieves state-of-the-art performance (>91\% F1), but only when trained on a stylistically diverse ``generalist'' dataset. (2) Generalization is highly architecture-dependent. We diagnose a specific failure mode in Llama 3.1 8B, which performs well on a narrow domain but cannot integrate diverse data, leading to a significant performance drop. (3) Some architectures are inherently more generalizable. The Mistral model proves to be a consistent and resilient performer across multiple training paradigms. By pinpointing the flawed heuristics responsible for these failures, our work provides a concrete methodology for diagnosing and understanding generalization failures, underscoring that reliable AI requires deep validation of the interplay between architecture, data, and training strategy.
format Preprint
id arxiv_https___arxiv_org_abs_2601_10524
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Diagnosing Generalization Failures in Fine-Tuned LLMs: A Cross-Architectural Study on Phishing Detection
Bobe III, Frank
Vetaw, Gregory D.
Pavlick, Chase
Bryner, Darshan
Cook, Matthew
Salas-Vernis, Jose
Artificial Intelligence
The practice of fine-tuning Large Language Models (LLMs) has achieved state-of-the-art performance on specialized tasks, yet diagnosing why these models become brittle and fail to generalize remains a critical open problem. To address this, we introduce and apply a multi-layered diagnostic framework to a cross-architectural study. We fine-tune Llama 3.1 8B, Gemma 2 9B, and Mistral models on a high-stakes phishing detection task and use SHAP analysis and mechanistic interpretability to uncover the root causes of their generalization failures. Our investigation reveals three critical findings: (1) Generalization is driven by a powerful synergy between architecture and data diversity. The Gemma 2 9B model achieves state-of-the-art performance (>91\% F1), but only when trained on a stylistically diverse ``generalist'' dataset. (2) Generalization is highly architecture-dependent. We diagnose a specific failure mode in Llama 3.1 8B, which performs well on a narrow domain but cannot integrate diverse data, leading to a significant performance drop. (3) Some architectures are inherently more generalizable. The Mistral model proves to be a consistent and resilient performer across multiple training paradigms. By pinpointing the flawed heuristics responsible for these failures, our work provides a concrete methodology for diagnosing and understanding generalization failures, underscoring that reliable AI requires deep validation of the interplay between architecture, data, and training strategy.
title Diagnosing Generalization Failures in Fine-Tuned LLMs: A Cross-Architectural Study on Phishing Detection
topic Artificial Intelligence
url https://arxiv.org/abs/2601.10524