Empowering Many, Biasing a Few: Generalist Credit Scoring through Large Language Models

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Feng, Duanyu, Dai, Yongfu, Huang, Jimin, Zhang, Yifang, Xie, Qianqian, Han, Weiguang, Chen, Zhengyu, Lopez-Lira, Alejandro, Wang, Hao
Natura: Preprint
Pubblicazione: 2023
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909110171074560
author Feng, Duanyu
Dai, Yongfu
Huang, Jimin
Zhang, Yifang
Xie, Qianqian
Han, Weiguang
Chen, Zhengyu
Lopez-Lira, Alejandro
Wang, Hao
author_facet Feng, Duanyu
Dai, Yongfu
Huang, Jimin
Zhang, Yifang
Xie, Qianqian
Han, Weiguang
Chen, Zhengyu
Lopez-Lira, Alejandro
Wang, Hao
contents In the financial industry, credit scoring is a fundamental element, shaping access to credit and determining the terms of loans for individuals and businesses alike. Traditional credit scoring methods, however, often grapple with challenges such as narrow knowledge scope and isolated evaluation of credit tasks. Our work posits that Large Language Models (LLMs) have great potential for credit scoring tasks, with strong generalization ability across multiple tasks. To systematically explore LLMs for credit scoring, we propose the first open-source comprehensive framework. We curate a novel benchmark covering 9 datasets with 14K samples, tailored for credit assessment and a critical examination of potential biases within LLMs, and the novel instruction tuning data with over 45k samples. We then propose the first Credit and Risk Assessment Large Language Model (CALM) by instruction tuning, tailored to the nuanced demands of various financial risk assessment tasks. We evaluate CALM, existing state-of-art (SOTA) methods, open source and closed source LLMs on the build benchmark. Our empirical results illuminate the capability of LLMs to not only match but surpass conventional models, pointing towards a future where credit scoring can be more inclusive, comprehensive, and unbiased. We contribute to the industry's transformation by sharing our pioneering instruction-tuning datasets, credit and risk assessment LLM, and benchmarks with the research community and the financial industry.
format Preprint
id arxiv_https___arxiv_org_abs_2310_00566
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Empowering Many, Biasing a Few: Generalist Credit Scoring through Large Language Models
Feng, Duanyu
Dai, Yongfu
Huang, Jimin
Zhang, Yifang
Xie, Qianqian
Han, Weiguang
Chen, Zhengyu
Lopez-Lira, Alejandro
Wang, Hao
Machine Learning
Artificial Intelligence
Computation and Language
Computers and Society
In the financial industry, credit scoring is a fundamental element, shaping access to credit and determining the terms of loans for individuals and businesses alike. Traditional credit scoring methods, however, often grapple with challenges such as narrow knowledge scope and isolated evaluation of credit tasks. Our work posits that Large Language Models (LLMs) have great potential for credit scoring tasks, with strong generalization ability across multiple tasks. To systematically explore LLMs for credit scoring, we propose the first open-source comprehensive framework. We curate a novel benchmark covering 9 datasets with 14K samples, tailored for credit assessment and a critical examination of potential biases within LLMs, and the novel instruction tuning data with over 45k samples. We then propose the first Credit and Risk Assessment Large Language Model (CALM) by instruction tuning, tailored to the nuanced demands of various financial risk assessment tasks. We evaluate CALM, existing state-of-art (SOTA) methods, open source and closed source LLMs on the build benchmark. Our empirical results illuminate the capability of LLMs to not only match but surpass conventional models, pointing towards a future where credit scoring can be more inclusive, comprehensive, and unbiased. We contribute to the industry's transformation by sharing our pioneering instruction-tuning datasets, credit and risk assessment LLM, and benchmarks with the research community and the financial industry.
title Empowering Many, Biasing a Few: Generalist Credit Scoring through Large Language Models
topic Machine Learning
Artificial Intelligence
Computation and Language
Computers and Society
url https://arxiv.org/abs/2310.00566