Saved in:
Bibliographic Details
Main Authors: Zou, Jian, Xu, Xiaoyu, Wang, Zhihua, Wang, Yilin, Adsumilli, Balu, Ma, Kede
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2603.11525
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918384146317312
author Zou, Jian
Xu, Xiaoyu
Wang, Zhihua
Wang, Yilin
Adsumilli, Balu
Ma, Kede
author_facet Zou, Jian
Xu, Xiaoyu
Wang, Zhihua
Wang, Yilin
Adsumilli, Balu
Ma, Kede
contents Learning-based video quality assessment (VQA) has advanced rapidly, yet progress is increasingly constrained by a disconnect between model design and dataset curation. Model-centric approaches often iterate on fixed benchmarks, while data-centric efforts collect new human labels without systematically targeting the weaknesses of existing VQA models. Here, we describe MDS-VQA, a model-informed data selection mechanism for curating unlabeled videos that are both difficult for the base VQA model and diverse in content. Difficulty is estimated by a failure predictor trained with a ranking objective, and diversity is measured using deep semantic video features, with a greedy procedure balancing the two under a constrained labeling budget. Experiments across multiple VQA datasets and models demonstrate that MDS-VQA identifies diverse, challenging samples that are particularly informative for active fine-tuning. With only a 5% selected subset per target domain, the fine-tuned model improves mean SRCC from 0.651 to 0.722 and achieves the top gMAD rank, indicating strong adaptation and generalization.
format Preprint
id arxiv_https___arxiv_org_abs_2603_11525
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle MDS-VQA: Model-Informed Data Selection for Video Quality Assessment
Zou, Jian
Xu, Xiaoyu
Wang, Zhihua
Wang, Yilin
Adsumilli, Balu
Ma, Kede
Computer Vision and Pattern Recognition
Learning-based video quality assessment (VQA) has advanced rapidly, yet progress is increasingly constrained by a disconnect between model design and dataset curation. Model-centric approaches often iterate on fixed benchmarks, while data-centric efforts collect new human labels without systematically targeting the weaknesses of existing VQA models. Here, we describe MDS-VQA, a model-informed data selection mechanism for curating unlabeled videos that are both difficult for the base VQA model and diverse in content. Difficulty is estimated by a failure predictor trained with a ranking objective, and diversity is measured using deep semantic video features, with a greedy procedure balancing the two under a constrained labeling budget. Experiments across multiple VQA datasets and models demonstrate that MDS-VQA identifies diverse, challenging samples that are particularly informative for active fine-tuning. With only a 5% selected subset per target domain, the fine-tuned model improves mean SRCC from 0.651 to 0.722 and achieves the top gMAD rank, indicating strong adaptation and generalization.
title MDS-VQA: Model-Informed Data Selection for Video Quality Assessment
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2603.11525