The Imitation Game: Using Large Language Models as Chatbots to Combat Chat-Based Cybercrimes

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yao, Yifan, Wang, Baojuan, Duan, Jinhao, Xu, Kaidi, Guo, ChuanKai, Sun, Zhibo Eric, Zhang, Yue
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917169360535552
author Yao, Yifan
Wang, Baojuan
Duan, Jinhao
Xu, Kaidi
Guo, ChuanKai
Sun, Zhibo Eric
Zhang, Yue
author_facet Yao, Yifan
Wang, Baojuan
Duan, Jinhao
Xu, Kaidi
Guo, ChuanKai
Sun, Zhibo Eric
Zhang, Yue
contents Chat-based cybercrime has emerged as a pervasive threat, with attackers leveraging real-time messaging platforms to conduct scams that rely on trust-building, deception, and psychological manipulation. Traditional defense mechanisms, which operate on static rules or shallow content filters, struggle to identify these conversational threats, especially when attackers use multimedia obfuscation and context-aware dialogue. In this work, we ask a provocative question inspired by the classic Imitation Game: Can machines convincingly pose as human victims to turn deception against cybercriminals? We present LURE (LLM-based User Response Engagement), the first system to deploy Large Language Models (LLMs) as active agents, not as passive classifiers, embedded within adversarial chat environments. LURE combines automated discovery, adversarial interaction, and OCR-based analysis of image-embedded payment data. Applied to the setting of illicit video chat scams on Telegram, our system engaged 53 actors across 98 groups. In over 56 percent of interactions, the LLM maintained multi-round conversations without being noticed as a bot, effectively "winning" the imitation game. Our findings reveal key behavioral patterns in scam operations, such as payment flows, upselling strategies, and platform migration tactics.
format Preprint
id arxiv_https___arxiv_org_abs_2512_21371
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle The Imitation Game: Using Large Language Models as Chatbots to Combat Chat-Based Cybercrimes
Yao, Yifan
Wang, Baojuan
Duan, Jinhao
Xu, Kaidi
Guo, ChuanKai
Sun, Zhibo Eric
Zhang, Yue
Cryptography and Security
Chat-based cybercrime has emerged as a pervasive threat, with attackers leveraging real-time messaging platforms to conduct scams that rely on trust-building, deception, and psychological manipulation. Traditional defense mechanisms, which operate on static rules or shallow content filters, struggle to identify these conversational threats, especially when attackers use multimedia obfuscation and context-aware dialogue. In this work, we ask a provocative question inspired by the classic Imitation Game: Can machines convincingly pose as human victims to turn deception against cybercriminals? We present LURE (LLM-based User Response Engagement), the first system to deploy Large Language Models (LLMs) as active agents, not as passive classifiers, embedded within adversarial chat environments. LURE combines automated discovery, adversarial interaction, and OCR-based analysis of image-embedded payment data. Applied to the setting of illicit video chat scams on Telegram, our system engaged 53 actors across 98 groups. In over 56 percent of interactions, the LLM maintained multi-round conversations without being noticed as a bot, effectively "winning" the imitation game. Our findings reveal key behavioral patterns in scam operations, such as payment flows, upselling strategies, and platform migration tactics.
title The Imitation Game: Using Large Language Models as Chatbots to Combat Chat-Based Cybercrimes
topic Cryptography and Security
url https://arxiv.org/abs/2512.21371