Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | https://arxiv.org/abs/2509.09190 |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866915489369817088 |
|---|---|
| author | Zhu, Hanwei Wu, Haoning Zhang, Zicheng Zhu, Lingyu Li, Yixuan Chen, Peilin Wang, Shiqi Zhou, Chris Wei Cao, Linhan Sun, Wei Zhu, Xiangyang Zhang, Weixia Zhu, Yucheng Liu, Jing Zhu, Dandan Zhai, Guangtao Min, Xiongkuo Zhang, Zhichao Li, Xinyue Xu, Shubo Dao, Anh Li, Yifan Yu, Hongyuan Yi, Jiaojiao Tian, Yiding Wu, Yupeng Sun, Feiran Liao, Lijuan Jiang, Song |
| author_facet | Zhu, Hanwei Wu, Haoning Zhang, Zicheng Zhu, Lingyu Li, Yixuan Chen, Peilin Wang, Shiqi Zhou, Chris Wei Cao, Linhan Sun, Wei Zhu, Xiangyang Zhang, Weixia Zhu, Yucheng Liu, Jing Zhu, Dandan Zhai, Guangtao Min, Xiongkuo Zhang, Zhichao Li, Xinyue Xu, Shubo Dao, Anh Li, Yifan Yu, Hongyuan Yi, Jiaojiao Tian, Yiding Wu, Yupeng Sun, Feiran Liao, Lijuan Jiang, Song |
| contents | This paper presents a summary of the VQualA 2025 Challenge on Visual Quality Comparison for Large Multimodal Models (LMMs), hosted as part of the ICCV 2025 Workshop on Visual Quality Assessment. The challenge aims to evaluate and enhance the ability of state-of-the-art LMMs to perform open-ended and detailed reasoning about visual quality differences across multiple images. To this end, the competition introduces a novel benchmark comprising thousands of coarse-to-fine grained visual quality comparison tasks, spanning single images, pairs, and multi-image groups. Each task requires models to provide accurate quality judgments. The competition emphasizes holistic evaluation protocols, including 2AFC-based binary preference and multi-choice questions (MCQs). Around 100 participants submitted entries, with five models demonstrating the emerging capabilities of instruction-tuned LMMs on quality assessment. This challenge marks a significant step toward open-domain visual quality reasoning and comparison and serves as a catalyst for future research on interpretable and human-aligned quality evaluation systems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_09190 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | VQualA 2025 Challenge on Visual Quality Comparison for Large Multimodal Models: Methods and Results Zhu, Hanwei Wu, Haoning Zhang, Zicheng Zhu, Lingyu Li, Yixuan Chen, Peilin Wang, Shiqi Zhou, Chris Wei Cao, Linhan Sun, Wei Zhu, Xiangyang Zhang, Weixia Zhu, Yucheng Liu, Jing Zhu, Dandan Zhai, Guangtao Min, Xiongkuo Zhang, Zhichao Li, Xinyue Xu, Shubo Dao, Anh Li, Yifan Yu, Hongyuan Yi, Jiaojiao Tian, Yiding Wu, Yupeng Sun, Feiran Liao, Lijuan Jiang, Song Computer Vision and Pattern Recognition This paper presents a summary of the VQualA 2025 Challenge on Visual Quality Comparison for Large Multimodal Models (LMMs), hosted as part of the ICCV 2025 Workshop on Visual Quality Assessment. The challenge aims to evaluate and enhance the ability of state-of-the-art LMMs to perform open-ended and detailed reasoning about visual quality differences across multiple images. To this end, the competition introduces a novel benchmark comprising thousands of coarse-to-fine grained visual quality comparison tasks, spanning single images, pairs, and multi-image groups. Each task requires models to provide accurate quality judgments. The competition emphasizes holistic evaluation protocols, including 2AFC-based binary preference and multi-choice questions (MCQs). Around 100 participants submitted entries, with five models demonstrating the emerging capabilities of instruction-tuned LMMs on quality assessment. This challenge marks a significant step toward open-domain visual quality reasoning and comparison and serves as a catalyst for future research on interpretable and human-aligned quality evaluation systems. |
| title | VQualA 2025 Challenge on Visual Quality Comparison for Large Multimodal Models: Methods and Results |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2509.09190 |