Fine-Refine: Iterative Fine-grained Refinement for Mitigating Dialogue Hallucination

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Chen, Xiangyan, Gan, Yujian, Purver, Matthew
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912909701939200
author Chen, Xiangyan
Gan, Yujian
Purver, Matthew
author_facet Chen, Xiangyan
Gan, Yujian
Purver, Matthew
contents The tendency for hallucination in current large language models (LLMs) negatively impacts dialogue systems. Such hallucinations produce factually incorrect responses that may mislead users and undermine system trust. Existing refinement methods for dialogue systems typically operate at the response level, overlooking the fact that a single response may contain multiple verifiable or unverifiable facts. To address this gap, we propose Fine-Refine, a fine-grained refinement framework that decomposes responses into atomic units, verifies each unit using external knowledge, assesses fluency via perplexity, and iteratively corrects granular errors. We evaluate factuality across the HybriDialogue and OpendialKG datasets in terms of factual accuracy (fact score) and coverage (Not Enough Information Proportion), and experiments show that Fine-Refine substantially improves factuality, achieving up to a 7.63-point gain in dialogue fact score, with a small trade-off in dialogue quality.
format Preprint
id arxiv_https___arxiv_org_abs_2602_15509
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Fine-Refine: Iterative Fine-grained Refinement for Mitigating Dialogue Hallucination
Chen, Xiangyan
Gan, Yujian
Purver, Matthew
Computation and Language
The tendency for hallucination in current large language models (LLMs) negatively impacts dialogue systems. Such hallucinations produce factually incorrect responses that may mislead users and undermine system trust. Existing refinement methods for dialogue systems typically operate at the response level, overlooking the fact that a single response may contain multiple verifiable or unverifiable facts. To address this gap, we propose Fine-Refine, a fine-grained refinement framework that decomposes responses into atomic units, verifies each unit using external knowledge, assesses fluency via perplexity, and iteratively corrects granular errors. We evaluate factuality across the HybriDialogue and OpendialKG datasets in terms of factual accuracy (fact score) and coverage (Not Enough Information Proportion), and experiments show that Fine-Refine substantially improves factuality, achieving up to a 7.63-point gain in dialogue fact score, with a small trade-off in dialogue quality.
title Fine-Refine: Iterative Fine-grained Refinement for Mitigating Dialogue Hallucination
topic Computation and Language
url https://arxiv.org/abs/2602.15509