RGB Guided ToF Imaging System: A Survey of Deep Learning-based Methods

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Qiao, Xin, Poggi, Matteo, Deng, Pengchao, Wei, Hao, Ge, Chenyang, Mattoccia, Stefano
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909205769748480
author Qiao, Xin
Poggi, Matteo
Deng, Pengchao
Wei, Hao
Ge, Chenyang
Mattoccia, Stefano
author_facet Qiao, Xin
Poggi, Matteo
Deng, Pengchao
Wei, Hao
Ge, Chenyang
Mattoccia, Stefano
contents Integrating an RGB camera into a ToF imaging system has become a significant technique for perceiving the real world. The RGB guided ToF imaging system is crucial to several applications, including face anti-spoofing, saliency detection, and trajectory prediction. Depending on the distance of the working range, the implementation schemes of the RGB guided ToF imaging systems are different. Specifically, ToF sensors with a uniform field of illumination, which can output dense depth but have low resolution, are typically used for close-range measurements. In contrast, LiDARs, which emit laser pulses and can only capture sparse depth, are usually employed for long-range detection. In the two cases, depth quality improvement for RGB guided ToF imaging corresponds to two sub-tasks: guided depth super-resolution and guided depth completion. In light of the recent significant boost to the field provided by deep learning, this paper comprehensively reviews the works related to RGB guided ToF imaging, including network structures, learning strategies, evaluation metrics, benchmark datasets, and objective functions. Besides, we present quantitative comparisons of state-of-the-art methods on widely used benchmark datasets. Finally, we discuss future trends and the challenges in real applications for further research.
format Preprint
id arxiv_https___arxiv_org_abs_2405_10357
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle RGB Guided ToF Imaging System: A Survey of Deep Learning-based Methods
Qiao, Xin
Poggi, Matteo
Deng, Pengchao
Wei, Hao
Ge, Chenyang
Mattoccia, Stefano
Computer Vision and Pattern Recognition
Integrating an RGB camera into a ToF imaging system has become a significant technique for perceiving the real world. The RGB guided ToF imaging system is crucial to several applications, including face anti-spoofing, saliency detection, and trajectory prediction. Depending on the distance of the working range, the implementation schemes of the RGB guided ToF imaging systems are different. Specifically, ToF sensors with a uniform field of illumination, which can output dense depth but have low resolution, are typically used for close-range measurements. In contrast, LiDARs, which emit laser pulses and can only capture sparse depth, are usually employed for long-range detection. In the two cases, depth quality improvement for RGB guided ToF imaging corresponds to two sub-tasks: guided depth super-resolution and guided depth completion. In light of the recent significant boost to the field provided by deep learning, this paper comprehensively reviews the works related to RGB guided ToF imaging, including network structures, learning strategies, evaluation metrics, benchmark datasets, and objective functions. Besides, we present quantitative comparisons of state-of-the-art methods on widely used benchmark datasets. Finally, we discuss future trends and the challenges in real applications for further research.
title RGB Guided ToF Imaging System: A Survey of Deep Learning-based Methods
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2405.10357