Plenodium: UnderWater 3D Scene Reconstruction with Plenoptic Medium Representation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wu, Changguanng, Dong, Jiangxin, Li, Chengjian, Tang, Jinhui
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909625179176960
author Wu, Changguanng
Dong, Jiangxin
Li, Chengjian
Tang, Jinhui
author_facet Wu, Changguanng
Dong, Jiangxin
Li, Chengjian
Tang, Jinhui
contents We present Plenodium (plenoptic medium), an effective and efficient 3D representation framework capable of jointly modeling both objects and participating media. In contrast to existing medium representations that rely solely on view-dependent modeling, our novel plenoptic medium representation incorporates both directional and positional information through spherical harmonics encoding, enabling highly accurate underwater scene reconstruction. To address the initialization challenge in degraded underwater environments, we propose the pseudo-depth Gaussian complementation to augment COLMAP-derived point clouds with robust depth priors. In addition, a depth ranking regularized loss is developed to optimize the geometry of the scene and improve the ordinal consistency of the depth maps. Extensive experiments on real-world underwater datasets demonstrate that our method achieves significant improvements in 3D reconstruction. Furthermore, we conduct a simulated dataset with ground truth and the controllable scattering medium to demonstrate the restoration capability of our method in underwater scenarios. Our code and dataset are available at https://plenodium.github.io/.
format Preprint
id arxiv_https___arxiv_org_abs_2505_21258
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Plenodium: UnderWater 3D Scene Reconstruction with Plenoptic Medium Representation
Wu, Changguanng
Dong, Jiangxin
Li, Chengjian
Tang, Jinhui
Computer Vision and Pattern Recognition
We present Plenodium (plenoptic medium), an effective and efficient 3D representation framework capable of jointly modeling both objects and participating media. In contrast to existing medium representations that rely solely on view-dependent modeling, our novel plenoptic medium representation incorporates both directional and positional information through spherical harmonics encoding, enabling highly accurate underwater scene reconstruction. To address the initialization challenge in degraded underwater environments, we propose the pseudo-depth Gaussian complementation to augment COLMAP-derived point clouds with robust depth priors. In addition, a depth ranking regularized loss is developed to optimize the geometry of the scene and improve the ordinal consistency of the depth maps. Extensive experiments on real-world underwater datasets demonstrate that our method achieves significant improvements in 3D reconstruction. Furthermore, we conduct a simulated dataset with ground truth and the controllable scattering medium to demonstrate the restoration capability of our method in underwater scenarios. Our code and dataset are available at https://plenodium.github.io/.
title Plenodium: UnderWater 3D Scene Reconstruction with Plenoptic Medium Representation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2505.21258