THaLLE: Text Hyperlocally Augmented Large Language Extension -- Technical Report
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909221740609536 |
|---|---|
| author | Labs, KBTG Khamnuansin, Danupat Petchsod, Atthakorn Lertpiya, Anuruth Balee, Pornchanan Lodkaew, Thanawat Chalothorn, Tawunrat Pongthawornkamol, Thadpong Lertsutthiwong, Monchai |
| author_facet | Labs, KBTG Khamnuansin, Danupat Petchsod, Atthakorn Lertpiya, Anuruth Balee, Pornchanan Lodkaew, Thanawat Chalothorn, Tawunrat Pongthawornkamol, Thadpong Lertsutthiwong, Monchai |
| contents | Recent advancements in Large Language Models (LLMs) have revealed new capabilities and opportunities across the technological landscape. However, the practicality of very large LLMs is challenged by their high compute cost, which does not justify the benefits given their limited capability compared to humans. While smaller, more practical LLMs have shown potential in financial analysis, though they are not yet fully proficient, as evidenced by their near-passing performance on the Chartered Financial Analyst (CFA) exam. In this work, we present Financial Analyst Extension to our Text Hyperlocally Augmented Large Language Extension (THaLLE), a series of 8B LLMs consistently achieving highest performance on mock CFA exams against models of comparable size. We thoroughly document the fine-tuning techniques used to facilitate future research. Additionally, we introduce the use of Flare CFA, a publicly available dataset for evaluating LLMs as a financial advisor. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_07505 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | THaLLE: Text Hyperlocally Augmented Large Language Extension -- Technical Report Labs, KBTG Khamnuansin, Danupat Petchsod, Atthakorn Lertpiya, Anuruth Balee, Pornchanan Lodkaew, Thanawat Chalothorn, Tawunrat Pongthawornkamol, Thadpong Lertsutthiwong, Monchai Computation and Language Recent advancements in Large Language Models (LLMs) have revealed new capabilities and opportunities across the technological landscape. However, the practicality of very large LLMs is challenged by their high compute cost, which does not justify the benefits given their limited capability compared to humans. While smaller, more practical LLMs have shown potential in financial analysis, though they are not yet fully proficient, as evidenced by their near-passing performance on the Chartered Financial Analyst (CFA) exam. In this work, we present Financial Analyst Extension to our Text Hyperlocally Augmented Large Language Extension (THaLLE), a series of 8B LLMs consistently achieving highest performance on mock CFA exams against models of comparable size. We thoroughly document the fine-tuning techniques used to facilitate future research. Additionally, we introduce the use of Flare CFA, a publicly available dataset for evaluating LLMs as a financial advisor. |
| title | THaLLE: Text Hyperlocally Augmented Large Language Extension -- Technical Report |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2406.07505 |