Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | https://arxiv.org/abs/2505.22543 |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866918037322465280 |
|---|---|
| author | Jia, Ziheng Zhang, Zicheng Zhang, Zeyu Liang, Yingji Zhu, Xiaorong Li, Chunyi Han, Jinliang Wu, Haoning Wang, Bin Zhang, Haoran Zhu, Guanyu Zhao, Qiyong Liu, Xiaohong Zhai, Guangtao Min, Xiongkuo |
| author_facet | Jia, Ziheng Zhang, Zicheng Zhang, Zeyu Liang, Yingji Zhu, Xiaorong Li, Chunyi Han, Jinliang Wu, Haoning Wang, Bin Zhang, Haoran Zhu, Guanyu Zhao, Qiyong Liu, Xiaohong Zhai, Guangtao Min, Xiongkuo |
| contents | The data scaling law has been shown to significantly enhance the performance of large multi-modal models (LMMs) across various downstream tasks. However, in the domain of perceptual video quality assessment (VQA), the potential of scaling law remains unprecedented due to the scarcity of labeled resources and the insufficient scale of datasets. To address this, we propose \textbf{OmniVQA}, an efficient framework designed to efficiently build high-quality, human-in-the-loop VQA multi-modal instruction databases (MIDBs). We then scale up to create \textbf{OmniVQA-Chat-400K}, the largest MIDB in the VQA field concurrently. Our focus is on the technical and aesthetic quality dimensions, with abundant in-context instruction data to provide fine-grained VQA knowledge. Additionally, we have built the \textbf{OmniVQA-MOS-20K} dataset to enhance the model's quantitative quality rating capabilities. We then introduce a \textbf{complementary} training strategy that effectively leverages the knowledge from datasets for quality understanding and quality rating tasks. Furthermore, we propose the \textbf{OmniVQA-FG (fine-grain)-Benchmark} to evaluate the fine-grained performance of the models. Our results demonstrate that our models achieve state-of-the-art performance in both quality understanding and rating tasks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_22543 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Scaling-up Perceptual Video Quality Assessment Jia, Ziheng Zhang, Zicheng Zhang, Zeyu Liang, Yingji Zhu, Xiaorong Li, Chunyi Han, Jinliang Wu, Haoning Wang, Bin Zhang, Haoran Zhu, Guanyu Zhao, Qiyong Liu, Xiaohong Zhai, Guangtao Min, Xiongkuo Computer Vision and Pattern Recognition Artificial Intelligence The data scaling law has been shown to significantly enhance the performance of large multi-modal models (LMMs) across various downstream tasks. However, in the domain of perceptual video quality assessment (VQA), the potential of scaling law remains unprecedented due to the scarcity of labeled resources and the insufficient scale of datasets. To address this, we propose \textbf{OmniVQA}, an efficient framework designed to efficiently build high-quality, human-in-the-loop VQA multi-modal instruction databases (MIDBs). We then scale up to create \textbf{OmniVQA-Chat-400K}, the largest MIDB in the VQA field concurrently. Our focus is on the technical and aesthetic quality dimensions, with abundant in-context instruction data to provide fine-grained VQA knowledge. Additionally, we have built the \textbf{OmniVQA-MOS-20K} dataset to enhance the model's quantitative quality rating capabilities. We then introduce a \textbf{complementary} training strategy that effectively leverages the knowledge from datasets for quality understanding and quality rating tasks. Furthermore, we propose the \textbf{OmniVQA-FG (fine-grain)-Benchmark} to evaluate the fine-grained performance of the models. Our results demonstrate that our models achieve state-of-the-art performance in both quality understanding and rating tasks. |
| title | Scaling-up Perceptual Video Quality Assessment |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence |
| url | https://arxiv.org/abs/2505.22543 |