Perceptual Quality Assessment of Virtual Reality Videos in the Wild

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Wen, Wen, Li, Mu, Yao, Yiru, Sui, Xiangjie, Zhang, Yabin, Lan, Long, Fang, Yuming, Ma, Kede
Format: Preprint
Publié: 2022
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910367369658368
author Wen, Wen
Li, Mu
Yao, Yiru
Sui, Xiangjie
Zhang, Yabin
Lan, Long
Fang, Yuming
Ma, Kede
author_facet Wen, Wen
Li, Mu
Yao, Yiru
Sui, Xiangjie
Zhang, Yabin
Lan, Long
Fang, Yuming
Ma, Kede
contents Investigating how people perceive virtual reality (VR) videos in the wild (i.e., those captured by everyday users) is a crucial and challenging task in VR-related applications due to complex authentic distortions localized in space and time. Existing panoramic video databases only consider synthetic distortions, assume fixed viewing conditions, and are limited in size. To overcome these shortcomings, we construct the VR Video Quality in the Wild (VRVQW) database, containing $502$ user-generated videos with diverse content and distortion characteristics. Based on VRVQW, we conduct a formal psychophysical experiment to record the scanpaths and perceived quality scores from $139$ participants under two different viewing conditions. We provide a thorough statistical analysis of the recorded data, observing significant impact of viewing conditions on both human scanpaths and perceived quality. Moreover, we develop an objective quality assessment model for VR videos based on pseudocylindrical representation and convolution. Results on the proposed VRVQW show that our method is superior to existing video quality assessment models. We have made the database and code available at https://github.com/limuhit/VR-Video-Quality-in-the-Wild.
format Preprint
id arxiv_https___arxiv_org_abs_2206_08751
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Perceptual Quality Assessment of Virtual Reality Videos in the Wild
Wen, Wen
Li, Mu
Yao, Yiru
Sui, Xiangjie
Zhang, Yabin
Lan, Long
Fang, Yuming
Ma, Kede
Computer Vision and Pattern Recognition
Image and Video Processing
Investigating how people perceive virtual reality (VR) videos in the wild (i.e., those captured by everyday users) is a crucial and challenging task in VR-related applications due to complex authentic distortions localized in space and time. Existing panoramic video databases only consider synthetic distortions, assume fixed viewing conditions, and are limited in size. To overcome these shortcomings, we construct the VR Video Quality in the Wild (VRVQW) database, containing $502$ user-generated videos with diverse content and distortion characteristics. Based on VRVQW, we conduct a formal psychophysical experiment to record the scanpaths and perceived quality scores from $139$ participants under two different viewing conditions. We provide a thorough statistical analysis of the recorded data, observing significant impact of viewing conditions on both human scanpaths and perceived quality. Moreover, we develop an objective quality assessment model for VR videos based on pseudocylindrical representation and convolution. Results on the proposed VRVQW show that our method is superior to existing video quality assessment models. We have made the database and code available at https://github.com/limuhit/VR-Video-Quality-in-the-Wild.
title Perceptual Quality Assessment of Virtual Reality Videos in the Wild
topic Computer Vision and Pattern Recognition
Image and Video Processing
url https://arxiv.org/abs/2206.08751