Financial Statement Fraud Detection via Large Language Models

Fuente: Wiley Open Access
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Zehra Erva Ergun, Emre Sefer
Format: Artículo Open Access
Publié: Wiley 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1867009316768186368
author Zehra Erva Ergun
Emre Sefer
author_facet Zehra Erva Ergun
Emre Sefer
Zehra Erva Ergun
Emre Sefer
collection Wiley Open Access
contents Financial Statement Fraud Detection via Large Language Models Zehra Erva Ergun Emre Sefer Intelligent Systems in Accounting, Finance and Management ABSTRACT With the widespread adoption of Internet‐based AI technologies, addressing financial fraud has become increasingly critical, particularly within the realm of machine learning. In this case, deep learning and natural language processing (NLP) techniques offer powerful means of detecting fraudulent activity by analyzing financial documents, thereby enhancing both the efficiency and precision of such assessments and supporting financial security. In this study, we introduce deep representation learning‐based approaches relying mainly on large language models (LLMs) for identifying fraud in financial statements by examining temporal changes in the Management Discussion and Analysis (MD&A) sections of corporate disclosures. Departing from conventional techniques that rely only on word frequency analysis, we propose D eep F raud that combines time‐evolving financial LLM embeddings, such as FinBERT, FinLlama, and FinGPT embeddings, of paragraphs and uses long short‐term memory (LSTM) to predict frauds via historical textual embeddings. In addition to LLM embeddings, we also integrate (1) time‐evolving word frequencies of words relevant to fraud detection, such as those expressing sentiment or uncertainty, and (2) time‐evolving financial ratios. Trajectories of paragraph‐level embeddings, frequencies, and ratios are used to construct a fraud detection model, which we evaluate against machine learning methods and deep time‐series models. Using 30 years of financial report data (from 1995 to 2024), our experiments demonstrate that D eep F raud on average enhances fraud detection performance across a number of scenarios and on average outperforms the competing approaches as well as conventional word frequency approaches. Our framework introduces a novel direction for deep feature engineering in the field of financial statement fraud detection. 10.1002/isaf.70021 http://onlinelibrary.wiley.com/termsAndConditions#vor
doi_str_mv 10.1002/isaf.70021
format Artículo Open Access
id wiley_oa_10_1002_isaf_70021
institution Wiley Open Access
license_str_mv http://onlinelibrary.wiley.com/termsAndConditions#vor
publishDate 2025
publisher Wiley
record_format wiley_oa
spellingShingle Financial Statement Fraud Detection via Large Language Models
Zehra Erva Ergun
Emre Sefer
Intelligent Systems in Accounting, Finance and Management
Financial Statement Fraud Detection via Large Language Models Zehra Erva Ergun Emre Sefer Intelligent Systems in Accounting, Finance and Management ABSTRACT With the widespread adoption of Internet‐based AI technologies, addressing financial fraud has become increasingly critical, particularly within the realm of machine learning. In this case, deep learning and natural language processing (NLP) techniques offer powerful means of detecting fraudulent activity by analyzing financial documents, thereby enhancing both the efficiency and precision of such assessments and supporting financial security. In this study, we introduce deep representation learning‐based approaches relying mainly on large language models (LLMs) for identifying fraud in financial statements by examining temporal changes in the Management Discussion and Analysis (MD&A) sections of corporate disclosures. Departing from conventional techniques that rely only on word frequency analysis, we propose D eep F raud that combines time‐evolving financial LLM embeddings, such as FinBERT, FinLlama, and FinGPT embeddings, of paragraphs and uses long short‐term memory (LSTM) to predict frauds via historical textual embeddings. In addition to LLM embeddings, we also integrate (1) time‐evolving word frequencies of words relevant to fraud detection, such as those expressing sentiment or uncertainty, and (2) time‐evolving financial ratios. Trajectories of paragraph‐level embeddings, frequencies, and ratios are used to construct a fraud detection model, which we evaluate against machine learning methods and deep time‐series models. Using 30 years of financial report data (from 1995 to 2024), our experiments demonstrate that D eep F raud on average enhances fraud detection performance across a number of scenarios and on average outperforms the competing approaches as well as conventional word frequency approaches. Our framework introduces a novel direction for deep feature engineering in the field of financial statement fraud detection. 10.1002/isaf.70021 http://onlinelibrary.wiley.com/termsAndConditions#vor
title Financial Statement Fraud Detection via Large Language Models
topic Intelligent Systems in Accounting, Finance and Management
url https://onlinelibrary.wiley.com/doi/10.1002/isaf.70021