Single-Step Latent Diffusion for Underwater Image Restoration

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Wu, Jiayi, Wang, Tianfu, Siddique, Md Abu Bakr, Islam, Md Jahidul, Fermuller, Cornelia, Aloimonos, Yiannis, Metzler, Christopher A.
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911049905602560
author Wu, Jiayi
Wang, Tianfu
Siddique, Md Abu Bakr
Islam, Md Jahidul
Fermuller, Cornelia
Aloimonos, Yiannis
Metzler, Christopher A.
author_facet Wu, Jiayi
Wang, Tianfu
Siddique, Md Abu Bakr
Islam, Md Jahidul
Fermuller, Cornelia
Aloimonos, Yiannis
Metzler, Christopher A.
contents Underwater image restoration algorithms seek to restore the color, contrast, and appearance of a scene that is imaged underwater. They are a critical tool in applications ranging from marine ecology and aquaculture to underwater construction and archaeology. While existing pixel-domain diffusion-based image restoration approaches are effective at restoring simple scenes with limited depth variation, they are computationally intensive and often generate unrealistic artifacts when applied to scenes with complex geometry and significant depth variation. In this work we overcome these limitations by combining a novel network architecture (SLURPP) with an accurate synthetic data generation pipeline. SLURPP combines pretrained latent diffusion models -- which encode strong priors on the geometry and depth of scenes -- with an explicit scene decomposition -- which allows one to model and account for the effects of light attenuation and backscattering. To train SLURPP we design a physics-based underwater image synthesis pipeline that applies varied and realistic underwater degradation effects to existing terrestrial image datasets. This approach enables the generation of diverse training data with dense medium/degradation annotations. We evaluate our method extensively on both synthetic and real-world benchmarks and demonstrate state-of-the-art performance. Notably, SLURPP is over 200X faster than existing diffusion-based methods while offering ~ 3 dB improvement in PSNR on synthetic benchmarks. It also offers compelling qualitative improvements on real-world data. Project website https://tianfwang.github.io/slurpp/.
format Preprint
id arxiv_https___arxiv_org_abs_2507_07878
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Single-Step Latent Diffusion for Underwater Image Restoration
Wu, Jiayi
Wang, Tianfu
Siddique, Md Abu Bakr
Islam, Md Jahidul
Fermuller, Cornelia
Aloimonos, Yiannis
Metzler, Christopher A.
Computer Vision and Pattern Recognition
Underwater image restoration algorithms seek to restore the color, contrast, and appearance of a scene that is imaged underwater. They are a critical tool in applications ranging from marine ecology and aquaculture to underwater construction and archaeology. While existing pixel-domain diffusion-based image restoration approaches are effective at restoring simple scenes with limited depth variation, they are computationally intensive and often generate unrealistic artifacts when applied to scenes with complex geometry and significant depth variation. In this work we overcome these limitations by combining a novel network architecture (SLURPP) with an accurate synthetic data generation pipeline. SLURPP combines pretrained latent diffusion models -- which encode strong priors on the geometry and depth of scenes -- with an explicit scene decomposition -- which allows one to model and account for the effects of light attenuation and backscattering. To train SLURPP we design a physics-based underwater image synthesis pipeline that applies varied and realistic underwater degradation effects to existing terrestrial image datasets. This approach enables the generation of diverse training data with dense medium/degradation annotations. We evaluate our method extensively on both synthetic and real-world benchmarks and demonstrate state-of-the-art performance. Notably, SLURPP is over 200X faster than existing diffusion-based methods while offering ~ 3 dB improvement in PSNR on synthetic benchmarks. It also offers compelling qualitative improvements on real-world data. Project website https://tianfwang.github.io/slurpp/.
title Single-Step Latent Diffusion for Underwater Image Restoration
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2507.07878