Glossy Object Reconstruction with Cost-effective Polarized Acquisition

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Wu, Bojian, Peng, Yifan, Hu, Ruizhen, Zhou, Xiaowei
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912318317658112
author Wu, Bojian
Peng, Yifan
Hu, Ruizhen
Zhou, Xiaowei
author_facet Wu, Bojian
Peng, Yifan
Hu, Ruizhen
Zhou, Xiaowei
contents The challenge of image-based 3D reconstruction for glossy objects lies in separating diffuse and specular components on glossy surfaces from captured images, a task complicated by the ambiguity in discerning lighting conditions and material properties using RGB data alone. While state-of-the-art methods rely on tailored and/or high-end equipment for data acquisition, which can be cumbersome and time-consuming, this work introduces a scalable polarization-aided approach that employs cost-effective acquisition tools. By attaching a linear polarizer to readily available RGB cameras, multi-view polarization images can be captured without the need for advance calibration or precise measurements of the polarizer angle, substantially reducing system construction costs. The proposed approach represents polarimetric BRDF, Stokes vectors, and polarization states of object surfaces as neural implicit fields. These fields, combined with the polarizer angle, are retrieved by optimizing the rendering loss of input polarized images. By leveraging fundamental physical principles for the implicit representation of polarization rendering, our method demonstrates superiority over existing techniques through experiments in public datasets and real captured images on both reconstruction and novel view synthesis.
format Preprint
id arxiv_https___arxiv_org_abs_2504_07025
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Glossy Object Reconstruction with Cost-effective Polarized Acquisition
Wu, Bojian
Peng, Yifan
Hu, Ruizhen
Zhou, Xiaowei
Computer Vision and Pattern Recognition
The challenge of image-based 3D reconstruction for glossy objects lies in separating diffuse and specular components on glossy surfaces from captured images, a task complicated by the ambiguity in discerning lighting conditions and material properties using RGB data alone. While state-of-the-art methods rely on tailored and/or high-end equipment for data acquisition, which can be cumbersome and time-consuming, this work introduces a scalable polarization-aided approach that employs cost-effective acquisition tools. By attaching a linear polarizer to readily available RGB cameras, multi-view polarization images can be captured without the need for advance calibration or precise measurements of the polarizer angle, substantially reducing system construction costs. The proposed approach represents polarimetric BRDF, Stokes vectors, and polarization states of object surfaces as neural implicit fields. These fields, combined with the polarizer angle, are retrieved by optimizing the rendering loss of input polarized images. By leveraging fundamental physical principles for the implicit representation of polarization rendering, our method demonstrates superiority over existing techniques through experiments in public datasets and real captured images on both reconstruction and novel view synthesis.
title Glossy Object Reconstruction with Cost-effective Polarized Acquisition
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2504.07025