Structuring the Unstructured: A Multi-Agent System for Extracting and Querying Financial KPIs and Guidance
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866909660129263616 |
|---|---|
| author | Choi, Chanyeol Lopez-Lira, Alejandro Lee, Yongjae Kwon, Jihoon Kim, Minjae Hwang, Juneha Ha, Minsoo Kim, Chaewoon Ha, Jaeseon Yun, Suyeol Kim, Jin |
| author_facet | Choi, Chanyeol Lopez-Lira, Alejandro Lee, Yongjae Kwon, Jihoon Kim, Minjae Hwang, Juneha Ha, Minsoo Kim, Chaewoon Ha, Jaeseon Yun, Suyeol Kim, Jin |
| contents | Extracting structured and quantitative insights from unstructured financial filings is essential in investment research, yet remains time-consuming and resource-intensive. Conventional approaches in practice rely heavily on labor-intensive manual processes, limiting scalability and delaying the research workflow. In this paper, we propose an efficient and scalable method for accurately extracting quantitative insights from unstructured financial documents, leveraging a multi-agent system composed of large language models. Our proposed multi-agent system consists of two specialized agents: the \emph{Extraction Agent} and the \emph{Text-to-SQL Agent}. The \textit{Extraction Agent} automatically identifies key performance indicators from unstructured financial text, standardizes their formats, and verifies their accuracy. On the other hand, the \textit{Text-to-SQL Agent} generates executable SQL statements from natural language queries, allowing users to access structured data accurately without requiring familiarity with the database schema. Through experiments, we demonstrate that our proposed system effectively transforms unstructured text into structured data accurately and enables precise retrieval of key information. First, we demonstrate that our system achieves approximately 95\% accuracy in transforming financial filings into structured data, matching the performance level typically attained by human annotators. Second, in a human evaluation of the retrieval task -- where natural language queries are used to search information from structured data -- 91\% of the responses were rated as correct by human evaluators. In both evaluations, our system generalizes well across financial document types, consistently delivering reliable performance. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_19197 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Structuring the Unstructured: A Multi-Agent System for Extracting and Querying Financial KPIs and Guidance Choi, Chanyeol Lopez-Lira, Alejandro Lee, Yongjae Kwon, Jihoon Kim, Minjae Hwang, Juneha Ha, Minsoo Kim, Chaewoon Ha, Jaeseon Yun, Suyeol Kim, Jin Artificial Intelligence Extracting structured and quantitative insights from unstructured financial filings is essential in investment research, yet remains time-consuming and resource-intensive. Conventional approaches in practice rely heavily on labor-intensive manual processes, limiting scalability and delaying the research workflow. In this paper, we propose an efficient and scalable method for accurately extracting quantitative insights from unstructured financial documents, leveraging a multi-agent system composed of large language models. Our proposed multi-agent system consists of two specialized agents: the \emph{Extraction Agent} and the \emph{Text-to-SQL Agent}. The \textit{Extraction Agent} automatically identifies key performance indicators from unstructured financial text, standardizes their formats, and verifies their accuracy. On the other hand, the \textit{Text-to-SQL Agent} generates executable SQL statements from natural language queries, allowing users to access structured data accurately without requiring familiarity with the database schema. Through experiments, we demonstrate that our proposed system effectively transforms unstructured text into structured data accurately and enables precise retrieval of key information. First, we demonstrate that our system achieves approximately 95\% accuracy in transforming financial filings into structured data, matching the performance level typically attained by human annotators. Second, in a human evaluation of the retrieval task -- where natural language queries are used to search information from structured data -- 91\% of the responses were rated as correct by human evaluators. In both evaluations, our system generalizes well across financial document types, consistently delivering reliable performance. |
| title | Structuring the Unstructured: A Multi-Agent System for Extracting and Querying Financial KPIs and Guidance |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2505.19197 |