Towards a Perceptual Evaluation Framework for Lighting Estimation
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910376914845696 |
|---|---|
| author | Giroux, Justine Dastjerdi, Mohammad Reza Karimi Hold-Geoffroy, Yannick Vazquez-Corral, Javier Lalonde, Jean-François |
| author_facet | Giroux, Justine Dastjerdi, Mohammad Reza Karimi Hold-Geoffroy, Yannick Vazquez-Corral, Javier Lalonde, Jean-François |
| contents | Progress in lighting estimation is tracked by computing existing image quality assessment (IQA) metrics on images from standard datasets. While this may appear to be a reasonable approach, we demonstrate that doing so does not correlate to human preference when the estimated lighting is used to relight a virtual scene into a real photograph. To study this, we design a controlled psychophysical experiment where human observers must choose their preference amongst rendered scenes lit using a set of lighting estimation algorithms selected from the recent literature, and use it to analyse how these algorithms perform according to human perception. Then, we demonstrate that none of the most popular IQA metrics from the literature, taken individually, correctly represent human perception. Finally, we show that by learning a combination of existing IQA metrics, we can more accurately represent human preference. This provides a new perceptual framework to help evaluate future lighting estimation algorithms. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2312_04334 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Towards a Perceptual Evaluation Framework for Lighting Estimation Giroux, Justine Dastjerdi, Mohammad Reza Karimi Hold-Geoffroy, Yannick Vazquez-Corral, Javier Lalonde, Jean-François Computer Vision and Pattern Recognition Progress in lighting estimation is tracked by computing existing image quality assessment (IQA) metrics on images from standard datasets. While this may appear to be a reasonable approach, we demonstrate that doing so does not correlate to human preference when the estimated lighting is used to relight a virtual scene into a real photograph. To study this, we design a controlled psychophysical experiment where human observers must choose their preference amongst rendered scenes lit using a set of lighting estimation algorithms selected from the recent literature, and use it to analyse how these algorithms perform according to human perception. Then, we demonstrate that none of the most popular IQA metrics from the literature, taken individually, correctly represent human perception. Finally, we show that by learning a combination of existing IQA metrics, we can more accurately represent human preference. This provides a new perceptual framework to help evaluate future lighting estimation algorithms. |
| title | Towards a Perceptual Evaluation Framework for Lighting Estimation |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2312.04334 |