Self-Consistency as a Free Lunch: Reducing Hallucinations in Vision-Language Models via Self-Reflection

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Han, Mingfei, Hao, Haihong, Zhou, Jinxing, Li, Zhihui, Zheng, Yuhui, Deng, Xueqing, Yang, Linjie, Chang, Xiaojun
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916974166016000
author Han, Mingfei
Hao, Haihong
Zhou, Jinxing
Li, Zhihui
Zheng, Yuhui
Deng, Xueqing
Yang, Linjie
Chang, Xiaojun
author_facet Han, Mingfei
Hao, Haihong
Zhou, Jinxing
Li, Zhihui
Zheng, Yuhui
Deng, Xueqing
Yang, Linjie
Chang, Xiaojun
contents Vision-language models often hallucinate details, generating non-existent objects or inaccurate attributes that compromise output reliability. Existing methods typically address these issues via extensive human annotations or external supervision from more powerful models. In this work, we present a novel framework that leverages the model's self-consistency between long responses and short answers to generate preference pairs for training. We observe that short binary questions tend to yield highly reliable responses, which can be used to query the target model to evaluate and rank its generated responses. Specifically, we design a self-reflection pipeline where detailed model responses are compared against concise binary answers, and inconsistency signals are utilized to automatically curate high-quality training data without human annotations or external model-based supervision. By relying solely on self-consistency rather than external supervision, our method offers a scalable and efficient solution that effectively reduces hallucinations using unlabeled data. Extensive experiments on multiple benchmarks, i.e., AMBER, MultiObject-Hal (ROPE), Object HalBench, and MMHal-Bench, demonstrate significant improvements in factual grounding and reliability. Moreover, our approach maintains robust instruction-following ability, as evidenced by enhanced performance on LLaVA-Bench and MMBench.
format Preprint
id arxiv_https___arxiv_org_abs_2509_23236
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Self-Consistency as a Free Lunch: Reducing Hallucinations in Vision-Language Models via Self-Reflection
Han, Mingfei
Hao, Haihong
Zhou, Jinxing
Li, Zhihui
Zheng, Yuhui
Deng, Xueqing
Yang, Linjie
Chang, Xiaojun
Computer Vision and Pattern Recognition
Artificial Intelligence
Vision-language models often hallucinate details, generating non-existent objects or inaccurate attributes that compromise output reliability. Existing methods typically address these issues via extensive human annotations or external supervision from more powerful models. In this work, we present a novel framework that leverages the model's self-consistency between long responses and short answers to generate preference pairs for training. We observe that short binary questions tend to yield highly reliable responses, which can be used to query the target model to evaluate and rank its generated responses. Specifically, we design a self-reflection pipeline where detailed model responses are compared against concise binary answers, and inconsistency signals are utilized to automatically curate high-quality training data without human annotations or external model-based supervision. By relying solely on self-consistency rather than external supervision, our method offers a scalable and efficient solution that effectively reduces hallucinations using unlabeled data. Extensive experiments on multiple benchmarks, i.e., AMBER, MultiObject-Hal (ROPE), Object HalBench, and MMHal-Bench, demonstrate significant improvements in factual grounding and reliability. Moreover, our approach maintains robust instruction-following ability, as evidenced by enhanced performance on LLaVA-Bench and MMBench.
title Self-Consistency as a Free Lunch: Reducing Hallucinations in Vision-Language Models via Self-Reflection
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2509.23236