Prior Knowledge Distillation Network for Face Super-Resolution

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Yang, Qiu, Sun, Xiao, Li, Xin-yu, Cui, Feng-Qi, Guo, Yu-Tong, Hu, Shuang-Zhen, Luo, Ping, Li, Si-Ying
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914954620174336
author Yang, Qiu
Sun, Xiao
Li, Xin-yu
Cui, Feng-Qi
Guo, Yu-Tong
Hu, Shuang-Zhen
Luo, Ping
Li, Si-Ying
author_facet Yang, Qiu
Sun, Xiao
Li, Xin-yu
Cui, Feng-Qi
Guo, Yu-Tong
Hu, Shuang-Zhen
Luo, Ping
Li, Si-Ying
contents The purpose of face super-resolution (FSR) is to reconstruct high-resolution (HR) face images from low-resolution (LR) inputs. With the continuous advancement of deep learning technologies, contemporary prior-guided FSR methods initially estimate facial priors and then use this information to assist in the super-resolution reconstruction process. However, ensuring the accuracy of prior estimation remains challenging, and straightforward cascading and convolutional operations often fail to fully leverage prior knowledge. Inaccurate or insufficiently utilized prior information inevitably degrades FSR performance. To address this issue, we propose a prior knowledge distillation network (PKDN) for FSR, which involves transferring prior information from the teacher network to the student network. This approach enables the network to learn priors during the training stage while relying solely on low-resolution facial images during the testing stage, thus mitigating the adverse effects of prior estimation inaccuracies. Additionally, we incorporate robust attention mechanisms to design a parsing map fusion block that effectively utilizes prior information. To prevent feature loss, we retain multi-scale features during the feature extraction stage and employ them in the subsequent super-resolution reconstruction process. Experimental results on benchmark datasets demonstrate that our PKDN approach surpasses existing FSR methods in generating high-quality face images.
format Preprint
id arxiv_https___arxiv_org_abs_2409_14385
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Prior Knowledge Distillation Network for Face Super-Resolution
Yang, Qiu
Sun, Xiao
Li, Xin-yu
Cui, Feng-Qi
Guo, Yu-Tong
Hu, Shuang-Zhen
Luo, Ping
Li, Si-Ying
Computer Vision and Pattern Recognition
The purpose of face super-resolution (FSR) is to reconstruct high-resolution (HR) face images from low-resolution (LR) inputs. With the continuous advancement of deep learning technologies, contemporary prior-guided FSR methods initially estimate facial priors and then use this information to assist in the super-resolution reconstruction process. However, ensuring the accuracy of prior estimation remains challenging, and straightforward cascading and convolutional operations often fail to fully leverage prior knowledge. Inaccurate or insufficiently utilized prior information inevitably degrades FSR performance. To address this issue, we propose a prior knowledge distillation network (PKDN) for FSR, which involves transferring prior information from the teacher network to the student network. This approach enables the network to learn priors during the training stage while relying solely on low-resolution facial images during the testing stage, thus mitigating the adverse effects of prior estimation inaccuracies. Additionally, we incorporate robust attention mechanisms to design a parsing map fusion block that effectively utilizes prior information. To prevent feature loss, we retain multi-scale features during the feature extraction stage and employ them in the subsequent super-resolution reconstruction process. Experimental results on benchmark datasets demonstrate that our PKDN approach surpasses existing FSR methods in generating high-quality face images.
title Prior Knowledge Distillation Network for Face Super-Resolution
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2409.14385