Advanced Real-Time Fraud Detection Using RAG-Based LLMs

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Singh, Gurjot, Singh, Prabhjot, Singh, Maninder
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912205242368000
author Singh, Gurjot
Singh, Prabhjot
Singh, Maninder
author_facet Singh, Gurjot
Singh, Prabhjot
Singh, Maninder
contents Artificial Intelligence has become a double edged sword in modern society being both a boon and a bane. While it empowers individuals it also enables malicious actors to perpetrate scams such as fraudulent phone calls and user impersonations. This growing threat necessitates a robust system to protect individuals In this paper we introduce a novel real time fraud detection mechanism using Retrieval Augmented Generation technology to address this challenge on two fronts. First our system incorporates a continuously updating policy checking feature that transcribes phone calls in real time and uses RAG based models to verify that the caller is not soliciting private information thus ensuring transparency and the authenticity of the conversation. Second we implement a real time user impersonation check with a two step verification process to confirm the callers identity ensuring accountability. A key innovation of our system is the ability to update policies without retraining the entire model enhancing its adaptability. We validated our RAG based approach using synthetic call recordings achieving an accuracy of 97.98 percent and an F1score of 97.44 percent with 100 calls outperforming state of the art methods. This robust and flexible fraud detection system is well suited for real world deployment.
format Preprint
id arxiv_https___arxiv_org_abs_2501_15290
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Advanced Real-Time Fraud Detection Using RAG-Based LLMs
Singh, Gurjot
Singh, Prabhjot
Singh, Maninder
Cryptography and Security
Artificial Intelligence
Artificial Intelligence has become a double edged sword in modern society being both a boon and a bane. While it empowers individuals it also enables malicious actors to perpetrate scams such as fraudulent phone calls and user impersonations. This growing threat necessitates a robust system to protect individuals In this paper we introduce a novel real time fraud detection mechanism using Retrieval Augmented Generation technology to address this challenge on two fronts. First our system incorporates a continuously updating policy checking feature that transcribes phone calls in real time and uses RAG based models to verify that the caller is not soliciting private information thus ensuring transparency and the authenticity of the conversation. Second we implement a real time user impersonation check with a two step verification process to confirm the callers identity ensuring accountability. A key innovation of our system is the ability to update policies without retraining the entire model enhancing its adaptability. We validated our RAG based approach using synthetic call recordings achieving an accuracy of 97.98 percent and an F1score of 97.44 percent with 100 calls outperforming state of the art methods. This robust and flexible fraud detection system is well suited for real world deployment.
title Advanced Real-Time Fraud Detection Using RAG-Based LLMs
topic Cryptography and Security
Artificial Intelligence
url https://arxiv.org/abs/2501.15290