In-place Double Stimulus Methodology for Subjective Assessment of High Quality Images
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866909767878836224 |
|---|---|
| author | Mohammadi, Shima Jenadeleh, Mohsen Testolina, Michela Sneyers, Jon Ebrahimi, Touradj Saupe, Dietmar Ascenso, João |
| author_facet | Mohammadi, Shima Jenadeleh, Mohsen Testolina, Michela Sneyers, Jon Ebrahimi, Touradj Saupe, Dietmar Ascenso, João |
| contents | This paper introduces a novel double stimulus subjective assessment methodology for the evaluation of high quality images to address the limitations of existing protocols in detecting subtle perceptual differences. The In-place Double Stimulus Quality Scale (IDSQS) allows subjects to alternately view a reference and a distorted image at the same spatial location, facilitating a more intuitive detection of differences in quality, especially at high to visually lossless quality levels. A large-scale crowdsourcing study employing this methodology was conducted, generating a comprehensive public dataset to evaluate perceived image quality across several compression algorithms and distortion levels. An additional contribution is the modeling of quality scores using a Beta distribution, allowing for the assessment of variability and subject consistency. Our findings demonstrate the effectiveness of the IDSQS methodology in achieving high correlation with more precise subjective evaluation benchmarks. The dataset, subjective data, and graphical user interface developed for this study are publicly available at https://github.com/shimamohammadi/IDSQS |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_09777 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | In-place Double Stimulus Methodology for Subjective Assessment of High Quality Images Mohammadi, Shima Jenadeleh, Mohsen Testolina, Michela Sneyers, Jon Ebrahimi, Touradj Saupe, Dietmar Ascenso, João Multimedia This paper introduces a novel double stimulus subjective assessment methodology for the evaluation of high quality images to address the limitations of existing protocols in detecting subtle perceptual differences. The In-place Double Stimulus Quality Scale (IDSQS) allows subjects to alternately view a reference and a distorted image at the same spatial location, facilitating a more intuitive detection of differences in quality, especially at high to visually lossless quality levels. A large-scale crowdsourcing study employing this methodology was conducted, generating a comprehensive public dataset to evaluate perceived image quality across several compression algorithms and distortion levels. An additional contribution is the modeling of quality scores using a Beta distribution, allowing for the assessment of variability and subject consistency. Our findings demonstrate the effectiveness of the IDSQS methodology in achieving high correlation with more precise subjective evaluation benchmarks. The dataset, subjective data, and graphical user interface developed for this study are publicly available at https://github.com/shimamohammadi/IDSQS |
| title | In-place Double Stimulus Methodology for Subjective Assessment of High Quality Images |
| topic | Multimedia |
| url | https://arxiv.org/abs/2508.09777 |