Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2022
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2211.07077 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911275473174528 |
|---|---|
| author | Jo, Byungho Cho, Donghyeon Park, In Kyu Hong, Sungeun |
| author_facet | Jo, Byungho Cho, Donghyeon Park, In Kyu Hong, Sungeun |
| contents | Existing face restoration models have relied on general assessment metrics that do not consider the characteristics of facial regions. Recent works have therefore assessed their methods using human studies, which is not scalable and involves significant effort. This paper proposes a novel face-centric metric based on an adversarial framework where a generator simulates face restoration and a discriminator assesses image quality. Specifically, our per-pixel discriminator enables interpretable evaluation that cannot be provided by traditional metrics. Moreover, our metric emphasizes facial primary regions considering that even minor changes to the eyes, nose, and mouth significantly affect human cognition. Our face-oriented metric consistently surpasses existing general or facial image quality assessment metrics by impressive margins. We demonstrate the generalizability of the proposed strategy in various architectural designs and challenging scenarios. Interestingly, we find that our IFQA can lead to performance improvement as an objective function. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2211_07077 |
| institution | arXiv |
| publishDate | 2022 |
| record_format | arxiv |
| spellingShingle | IFQA: Interpretable Face Quality Assessment Jo, Byungho Cho, Donghyeon Park, In Kyu Hong, Sungeun Computer Vision and Pattern Recognition Existing face restoration models have relied on general assessment metrics that do not consider the characteristics of facial regions. Recent works have therefore assessed their methods using human studies, which is not scalable and involves significant effort. This paper proposes a novel face-centric metric based on an adversarial framework where a generator simulates face restoration and a discriminator assesses image quality. Specifically, our per-pixel discriminator enables interpretable evaluation that cannot be provided by traditional metrics. Moreover, our metric emphasizes facial primary regions considering that even minor changes to the eyes, nose, and mouth significantly affect human cognition. Our face-oriented metric consistently surpasses existing general or facial image quality assessment metrics by impressive margins. We demonstrate the generalizability of the proposed strategy in various architectural designs and challenging scenarios. Interestingly, we find that our IFQA can lead to performance improvement as an objective function. |
| title | IFQA: Interpretable Face Quality Assessment |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2211.07077 |