Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2511.01746 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917070275346432 |
|---|---|
| author | Chang, Chen-Wei Sarkar, Shailik Salemi, Hossein Kim, Hyungmin Mitra, Shutonu Purohit, Hemant Zhang, Fengxiu Hong, Michin Cho, Jin-Hee Lu, Chang-Tien |
| author_facet | Chang, Chen-Wei Sarkar, Shailik Salemi, Hossein Kim, Hyungmin Mitra, Shutonu Purohit, Hemant Zhang, Fengxiu Hong, Michin Cho, Jin-Hee Lu, Chang-Tien |
| contents | Scam detection remains a critical challenge in cybersecurity as adversaries craft messages that evade automated filters. We propose a Hierarchical Scam Detection System (HSDS) that combines a lightweight multi-model voting front end with a fine-tuned LLaMA 3.1 8B Instruct back end to improve accuracy and robustness against adversarial attacks. An ensemble of four classifiers provides preliminary predictions through majority vote, and ambiguous cases are escalated to the fine-tuned model, which is optimized with adversarial training to reduce misclassification. Experiments show that this hierarchical design both improves adversarial scam detection and shortens inference time by routing most cases away from the LLM, outperforming traditional machine-learning baselines and proprietary LLM baselines. The findings highlight the effectiveness of a hybrid voting mechanism and adversarial fine-tuning in fortifying LLMs against evolving scam tactics, enhancing the resilience of automated scam detection systems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_01746 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Scam Shield: Multi-Model Voting and Fine-Tuned LLMs Against Adversarial Attacks Chang, Chen-Wei Sarkar, Shailik Salemi, Hossein Kim, Hyungmin Mitra, Shutonu Purohit, Hemant Zhang, Fengxiu Hong, Michin Cho, Jin-Hee Lu, Chang-Tien Cryptography and Security Artificial Intelligence Scam detection remains a critical challenge in cybersecurity as adversaries craft messages that evade automated filters. We propose a Hierarchical Scam Detection System (HSDS) that combines a lightweight multi-model voting front end with a fine-tuned LLaMA 3.1 8B Instruct back end to improve accuracy and robustness against adversarial attacks. An ensemble of four classifiers provides preliminary predictions through majority vote, and ambiguous cases are escalated to the fine-tuned model, which is optimized with adversarial training to reduce misclassification. Experiments show that this hierarchical design both improves adversarial scam detection and shortens inference time by routing most cases away from the LLM, outperforming traditional machine-learning baselines and proprietary LLM baselines. The findings highlight the effectiveness of a hybrid voting mechanism and adversarial fine-tuning in fortifying LLMs against evolving scam tactics, enhancing the resilience of automated scam detection systems. |
| title | Scam Shield: Multi-Model Voting and Fine-Tuned LLMs Against Adversarial Attacks |
| topic | Cryptography and Security Artificial Intelligence |
| url | https://arxiv.org/abs/2511.01746 |