Guardado en:
Detalles Bibliográficos
Autores principales: Chen, Minghui, Yang, Chenxu, Zhu, Hengjie, Wu, Dayan, Lin, Zheng, Si, Qingyi
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:https://arxiv.org/abs/2605.00323
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911638243770368
author Chen, Minghui
Yang, Chenxu
Zhu, Hengjie
Wu, Dayan
Lin, Zheng
Si, Qingyi
author_facet Chen, Minghui
Yang, Chenxu
Zhu, Hengjie
Wu, Dayan
Lin, Zheng
Si, Qingyi
contents Large Vision-Language Models (LVLMs) often suffer from hallucinations, generating descriptions that include visual details absent from the input image. Recent preference alignment methods typically rely on supervision distilled from stronger models such as GPT. However, this offline paradigm introduces a Supervision-Perception Mismatch: the student model is forced to align with fine-grained details beyond its perceptual capacity, learning to guess rather than to see. To obtain reliable self-supervision for online learning, we identify a Generative-Discriminative Gap within LVLMs, where models exhibit higher accuracy on discriminative verification than open-ended generation. Leveraging this capability, we propose \textbf{O}nline \textbf{S}elf-\textbf{CA}lib\textbf{R}ation (OSCAR), a framework that integrates Monte Carlo Tree Search with a Dual-Granularity Reward Mechanism to construct preference data and iteratively refines the model via Direct Preference Optimization. Extensive experiments demonstrate that OSCAR achieves state-of-the-art performance on hallucination benchmarks while improving general multimodal capabilities.
format Preprint
id arxiv_https___arxiv_org_abs_2605_00323
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Online Self-Calibration Against Hallucination in Vision-Language Models
Chen, Minghui
Yang, Chenxu
Zhu, Hengjie
Wu, Dayan
Lin, Zheng
Si, Qingyi
Computer Vision and Pattern Recognition
Machine Learning
Large Vision-Language Models (LVLMs) often suffer from hallucinations, generating descriptions that include visual details absent from the input image. Recent preference alignment methods typically rely on supervision distilled from stronger models such as GPT. However, this offline paradigm introduces a Supervision-Perception Mismatch: the student model is forced to align with fine-grained details beyond its perceptual capacity, learning to guess rather than to see. To obtain reliable self-supervision for online learning, we identify a Generative-Discriminative Gap within LVLMs, where models exhibit higher accuracy on discriminative verification than open-ended generation. Leveraging this capability, we propose \textbf{O}nline \textbf{S}elf-\textbf{CA}lib\textbf{R}ation (OSCAR), a framework that integrates Monte Carlo Tree Search with a Dual-Granularity Reward Mechanism to construct preference data and iteratively refines the model via Direct Preference Optimization. Extensive experiments demonstrate that OSCAR achieves state-of-the-art performance on hallucination benchmarks while improving general multimodal capabilities.
title Online Self-Calibration Against Hallucination in Vision-Language Models
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2605.00323