Deep Learning Methods for Calibrated Photometric Stereo and Beyond

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Ju, Yakun, Lam, Kin-Man, Xie, Wuyuan, Zhou, Huiyu, Dong, Junyu, Shi, Boxin
Natura: Preprint
Pubblicazione: 2022
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917579982897152
author Ju, Yakun
Lam, Kin-Man
Xie, Wuyuan
Zhou, Huiyu
Dong, Junyu
Shi, Boxin
author_facet Ju, Yakun
Lam, Kin-Man
Xie, Wuyuan
Zhou, Huiyu
Dong, Junyu
Shi, Boxin
contents Photometric stereo recovers the surface normals of an object from multiple images with varying shading cues, i.e., modeling the relationship between surface orientation and intensity at each pixel. Photometric stereo prevails in superior per-pixel resolution and fine reconstruction details. However, it is a complicated problem because of the non-linear relationship caused by non-Lambertian surface reflectance. Recently, various deep learning methods have shown a powerful ability in the context of photometric stereo against non-Lambertian surfaces. This paper provides a comprehensive review of existing deep learning-based calibrated photometric stereo methods. We first analyze these methods from different perspectives, including input processing, supervision, and network architecture. We summarize the performance of deep learning photometric stereo models on the most widely-used benchmark data set. This demonstrates the advanced performance of deep learning-based photometric stereo methods. Finally, we give suggestions and propose future research trends based on the limitations of existing models.
format Preprint
id arxiv_https___arxiv_org_abs_2212_08414
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Deep Learning Methods for Calibrated Photometric Stereo and Beyond
Ju, Yakun
Lam, Kin-Man
Xie, Wuyuan
Zhou, Huiyu
Dong, Junyu
Shi, Boxin
Computer Vision and Pattern Recognition
Artificial Intelligence
Photometric stereo recovers the surface normals of an object from multiple images with varying shading cues, i.e., modeling the relationship between surface orientation and intensity at each pixel. Photometric stereo prevails in superior per-pixel resolution and fine reconstruction details. However, it is a complicated problem because of the non-linear relationship caused by non-Lambertian surface reflectance. Recently, various deep learning methods have shown a powerful ability in the context of photometric stereo against non-Lambertian surfaces. This paper provides a comprehensive review of existing deep learning-based calibrated photometric stereo methods. We first analyze these methods from different perspectives, including input processing, supervision, and network architecture. We summarize the performance of deep learning photometric stereo models on the most widely-used benchmark data set. This demonstrates the advanced performance of deep learning-based photometric stereo methods. Finally, we give suggestions and propose future research trends based on the limitations of existing models.
title Deep Learning Methods for Calibrated Photometric Stereo and Beyond
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2212.08414