Dense Dispersed Structured Light for Hyperspectral 3D Imaging of Dynamic Scenes

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Shin, Suhyun, Yoon, Seungwoo, Maeda, Ryota, Baek, Seung-Hwan
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913593669189632
author Shin, Suhyun
Yoon, Seungwoo
Maeda, Ryota
Baek, Seung-Hwan
author_facet Shin, Suhyun
Yoon, Seungwoo
Maeda, Ryota
Baek, Seung-Hwan
contents Hyperspectral 3D imaging captures both depth maps and hyperspectral images, enabling comprehensive geometric and material analysis. Recent methods achieve high spectral and depth accuracy; however, they require long acquisition times often over several minutes or rely on large, expensive systems, restricting their use to static scenes. We present Dense Dispersed Structured Light (DDSL), an accurate hyperspectral 3D imaging method for dynamic scenes that utilizes stereo RGB cameras and an RGB projector equipped with an affordable diffraction grating film. We design spectrally multiplexed DDSL patterns that significantly reduce the number of required projector patterns, thereby accelerating acquisition speed. Additionally, we formulate an image formation model and a reconstruction method to estimate a hyperspectral image and depth map from captured stereo images. As the first practical and accurate hyperspectral 3D imaging method for dynamic scenes, we experimentally demonstrate that DDSL achieves a spectral resolution of 15.5 nm full width at half maximum (FWHM), a depth error of 4 mm, and a frame rate of 6.6 fps.
format Preprint
id arxiv_https___arxiv_org_abs_2412_01140
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Dense Dispersed Structured Light for Hyperspectral 3D Imaging of Dynamic Scenes
Shin, Suhyun
Yoon, Seungwoo
Maeda, Ryota
Baek, Seung-Hwan
Computer Vision and Pattern Recognition
Image and Video Processing
Hyperspectral 3D imaging captures both depth maps and hyperspectral images, enabling comprehensive geometric and material analysis. Recent methods achieve high spectral and depth accuracy; however, they require long acquisition times often over several minutes or rely on large, expensive systems, restricting their use to static scenes. We present Dense Dispersed Structured Light (DDSL), an accurate hyperspectral 3D imaging method for dynamic scenes that utilizes stereo RGB cameras and an RGB projector equipped with an affordable diffraction grating film. We design spectrally multiplexed DDSL patterns that significantly reduce the number of required projector patterns, thereby accelerating acquisition speed. Additionally, we formulate an image formation model and a reconstruction method to estimate a hyperspectral image and depth map from captured stereo images. As the first practical and accurate hyperspectral 3D imaging method for dynamic scenes, we experimentally demonstrate that DDSL achieves a spectral resolution of 15.5 nm full width at half maximum (FWHM), a depth error of 4 mm, and a frame rate of 6.6 fps.
title Dense Dispersed Structured Light for Hyperspectral 3D Imaging of Dynamic Scenes
topic Computer Vision and Pattern Recognition
Image and Video Processing
url https://arxiv.org/abs/2412.01140