Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2508.20655 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914032448962560 |
|---|---|
| author | Yang, Sihan Cui, Chenhang Zhao, Zihao Zhou, Yiyang Yan, Weilong Wei, Ying Yao, Huaxiu |
| author_facet | Yang, Sihan Cui, Chenhang Zhao, Zihao Zhou, Yiyang Yan, Weilong Wei, Ying Yao, Huaxiu |
| contents | The rapid advancements in Large Language Models (LLMs) and Large Visual-Language Models (LVLMs) have opened up new opportunities for integrating visual and linguistic modalities. However, effectively aligning these modalities remains challenging, often leading to hallucinations--where generated outputs are not grounded in the visual input--and raising safety concerns across various domains. Existing alignment methods, such as instruction tuning and preference tuning, often rely on external datasets, human annotations, or complex post-processing, which limit scalability and increase costs. To address these challenges, we propose a novel approach that generates the debiased self-judgment score, a self-evaluation metric created internally by the model without relying on external resources. This enables the model to autonomously improve alignment. Our method enhances both decoding strategies and preference tuning processes, resulting in reduced hallucinations, enhanced safety, and improved overall capability. Empirical results show that our approach significantly outperforms traditional methods, offering a more effective solution for aligning LVLMs. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_20655 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Improving Alignment in LVLMs with Debiased Self-Judgment Yang, Sihan Cui, Chenhang Zhao, Zihao Zhou, Yiyang Yan, Weilong Wei, Ying Yao, Huaxiu Computer Vision and Pattern Recognition Computation and Language The rapid advancements in Large Language Models (LLMs) and Large Visual-Language Models (LVLMs) have opened up new opportunities for integrating visual and linguistic modalities. However, effectively aligning these modalities remains challenging, often leading to hallucinations--where generated outputs are not grounded in the visual input--and raising safety concerns across various domains. Existing alignment methods, such as instruction tuning and preference tuning, often rely on external datasets, human annotations, or complex post-processing, which limit scalability and increase costs. To address these challenges, we propose a novel approach that generates the debiased self-judgment score, a self-evaluation metric created internally by the model without relying on external resources. This enables the model to autonomously improve alignment. Our method enhances both decoding strategies and preference tuning processes, resulting in reduced hallucinations, enhanced safety, and improved overall capability. Empirical results show that our approach significantly outperforms traditional methods, offering a more effective solution for aligning LVLMs. |
| title | Improving Alignment in LVLMs with Debiased Self-Judgment |
| topic | Computer Vision and Pattern Recognition Computation and Language |
| url | https://arxiv.org/abs/2508.20655 |