Spatial Polarization Multiplexing: Single-Shot Invisible Shape and Reflectance Recovery

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Ichikawa, Tomoki, Kawahara, Ryo, Nishino, Ko
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866908748844367872
author Ichikawa, Tomoki
Kawahara, Ryo
Nishino, Ko
author_facet Ichikawa, Tomoki
Kawahara, Ryo
Nishino, Ko
contents We propose spatial polarization multiplexing (SPM) for joint sensing of shape and reflectance of a static or dynamic deformable object, which is also invisible to the naked eye. Past structured-light methods are limited to shape acquisition and cannot recover reflectance as they alter scene appearance. Our key idea is to spatially multiplex a polarization pattern to encode the incident ray and also densely sample the reflected light. We derive a quantized polarized light pattern that can be robustly and uniquely decoded from the reflected Angle of Linear Polarization (AoLP) values. It also enables single-shot disentanglement of polarimetric diffuse and specular reflections for accurate BRDF estimation. We achieve this spatial polarization multiplexing (SPM) with a constrained de Bruijn sequence. We validate this novel invisible single-shot shape and reflectance method with real static and dynamic objects. The results demonstrate the effectiveness of SPM for accurate shape and BRDF measurement which opens new avenues of application for 3D sensing thanks to its invisibility and ability to jointly recover the radiometric properties.
format Preprint
id arxiv_https___arxiv_org_abs_2504_13177
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Spatial Polarization Multiplexing: Single-Shot Invisible Shape and Reflectance Recovery
Ichikawa, Tomoki
Kawahara, Ryo
Nishino, Ko
Computer Vision and Pattern Recognition
We propose spatial polarization multiplexing (SPM) for joint sensing of shape and reflectance of a static or dynamic deformable object, which is also invisible to the naked eye. Past structured-light methods are limited to shape acquisition and cannot recover reflectance as they alter scene appearance. Our key idea is to spatially multiplex a polarization pattern to encode the incident ray and also densely sample the reflected light. We derive a quantized polarized light pattern that can be robustly and uniquely decoded from the reflected Angle of Linear Polarization (AoLP) values. It also enables single-shot disentanglement of polarimetric diffuse and specular reflections for accurate BRDF estimation. We achieve this spatial polarization multiplexing (SPM) with a constrained de Bruijn sequence. We validate this novel invisible single-shot shape and reflectance method with real static and dynamic objects. The results demonstrate the effectiveness of SPM for accurate shape and BRDF measurement which opens new avenues of application for 3D sensing thanks to its invisibility and ability to jointly recover the radiometric properties.
title Spatial Polarization Multiplexing: Single-Shot Invisible Shape and Reflectance Recovery
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2504.13177