A Lightweight Complex-Valued Deformable CNN for High-Quality Computer-Generated Holography

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Xie, Shuyang, Zhou, Jie, Xu, Bo, Wang, Jun, Xu, Renjing
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866918192650125312
author Xie, Shuyang
Zhou, Jie
Xu, Bo
Wang, Jun
Xu, Renjing
author_facet Xie, Shuyang
Zhou, Jie
Xu, Bo
Wang, Jun
Xu, Renjing
contents Holographic displays have significant potential in virtual reality and augmented reality owing to their ability to provide all the depth cues. Deep learning-based methods play an important role in computer-generated holography (CGH). During the diffraction process, each pixel exerts an influence on the reconstructed image. However, previous works face challenges in capturing sufficient information to accurately model this process, primarily due to the inadequacy of their effective receptive field (ERF). Here, we designed complex-valued deformable convolution for integration into network, enabling dynamic adjustment of the convolution kernel's shape to increase flexibility of ERF for better feature extraction. This approach allows us to utilize a single model while achieving state-of-the-art performance in both simulated and optical experiment reconstructions, surpassing existing open-source models. Specifically, our method has a peak signal-to-noise ratio that is 2.04 dB, 5.31 dB, and 9.71 dB higher than that of CCNN-CGH, HoloNet, and Holo-encoder, respectively, when the resolution is 1920$\times$1072. The number of parameters of our model is only about one-eighth of that of CCNN-CGH.
format Preprint
id arxiv_https___arxiv_org_abs_2506_14542
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Lightweight Complex-Valued Deformable CNN for High-Quality Computer-Generated Holography
Xie, Shuyang
Zhou, Jie
Xu, Bo
Wang, Jun
Xu, Renjing
Optics
Computer Vision and Pattern Recognition
Holographic displays have significant potential in virtual reality and augmented reality owing to their ability to provide all the depth cues. Deep learning-based methods play an important role in computer-generated holography (CGH). During the diffraction process, each pixel exerts an influence on the reconstructed image. However, previous works face challenges in capturing sufficient information to accurately model this process, primarily due to the inadequacy of their effective receptive field (ERF). Here, we designed complex-valued deformable convolution for integration into network, enabling dynamic adjustment of the convolution kernel's shape to increase flexibility of ERF for better feature extraction. This approach allows us to utilize a single model while achieving state-of-the-art performance in both simulated and optical experiment reconstructions, surpassing existing open-source models. Specifically, our method has a peak signal-to-noise ratio that is 2.04 dB, 5.31 dB, and 9.71 dB higher than that of CCNN-CGH, HoloNet, and Holo-encoder, respectively, when the resolution is 1920$\times$1072. The number of parameters of our model is only about one-eighth of that of CCNN-CGH.
title A Lightweight Complex-Valued Deformable CNN for High-Quality Computer-Generated Holography
topic Optics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.14542