FinGround: Detecting and Grounding Financial Hallucinations via Atomic Claim Verification

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Guo, Dongxin, Wu, Jikun, Yiu, Siu Ming
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913062886309888
author Guo, Dongxin
Wu, Jikun
Yiu, Siu Ming
author_facet Guo, Dongxin
Wu, Jikun
Yiu, Siu Ming
contents Financial AI systems must produce answers grounded in specific regulatory filings, yet current LLMs fabricate metrics, invent citations, and miscalculate derived quantities. These errors carry direct regulatory consequences as the EU AI Act's high-risk enforcement deadline approaches (August 2026). Existing hallucination detectors treat all claims uniformly, missing 43% of computational errors that require arithmetic re-verification against structured tables. We present FinGround, a three-stage verify-then-ground pipeline for financial document QA. Stage 1 performs finance-aware hybrid retrieval over text and tables. Stage 2 decomposes answers into atomic claims classified by a six-type financial taxonomy and verified with type-routed strategies including formula reconstruction. Stage 3 rewrites unsupported claims with paragraph- and table-cell-level citations. To cleanly isolate verification value from retrieval quality, we propose retrieval-equalized evaluation as standard methodology for RAG verification research: when all systems receive identical retrieval, FinGround still reduces hallucination rates by 68% over the strongest baseline ($p < 0.01$). The full pipeline achieves a 78% reduction relative to GPT-4o. An 8B distilled detector retains 91.4% F1 at 18x lower per-claim latency, enabling $0.003/query deployment, supported by qualitative signals from a four-week analyst pilot.
format Preprint
id arxiv_https___arxiv_org_abs_2604_23588
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle FinGround: Detecting and Grounding Financial Hallucinations via Atomic Claim Verification
Guo, Dongxin
Wu, Jikun
Yiu, Siu Ming
Artificial Intelligence
Computation and Language
Information Retrieval
I.2.7; H.3.3; I.2.6; J.4
Financial AI systems must produce answers grounded in specific regulatory filings, yet current LLMs fabricate metrics, invent citations, and miscalculate derived quantities. These errors carry direct regulatory consequences as the EU AI Act's high-risk enforcement deadline approaches (August 2026). Existing hallucination detectors treat all claims uniformly, missing 43% of computational errors that require arithmetic re-verification against structured tables. We present FinGround, a three-stage verify-then-ground pipeline for financial document QA. Stage 1 performs finance-aware hybrid retrieval over text and tables. Stage 2 decomposes answers into atomic claims classified by a six-type financial taxonomy and verified with type-routed strategies including formula reconstruction. Stage 3 rewrites unsupported claims with paragraph- and table-cell-level citations. To cleanly isolate verification value from retrieval quality, we propose retrieval-equalized evaluation as standard methodology for RAG verification research: when all systems receive identical retrieval, FinGround still reduces hallucination rates by 68% over the strongest baseline ($p < 0.01$). The full pipeline achieves a 78% reduction relative to GPT-4o. An 8B distilled detector retains 91.4% F1 at 18x lower per-claim latency, enabling $0.003/query deployment, supported by qualitative signals from a four-week analyst pilot.
title FinGround: Detecting and Grounding Financial Hallucinations via Atomic Claim Verification
topic Artificial Intelligence
Computation and Language
Information Retrieval
I.2.7; H.3.3; I.2.6; J.4
url https://arxiv.org/abs/2604.23588