Real-World Atmospheric Turbulence Correction via Domain Adaptation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Wang, Xijun, López-Tapia, Santiago, Katsaggelos, Aggelos K.
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916121896026112
author Wang, Xijun
López-Tapia, Santiago
Katsaggelos, Aggelos K.
author_facet Wang, Xijun
López-Tapia, Santiago
Katsaggelos, Aggelos K.
contents Atmospheric turbulence, a common phenomenon in daily life, is primarily caused by the uneven heating of the Earth's surface. This phenomenon results in distorted and blurred acquired images or videos and can significantly impact downstream vision tasks, particularly those that rely on capturing clear, stable images or videos from outdoor environments, such as accurately detecting or recognizing objects. Therefore, people have proposed ways to simulate atmospheric turbulence and designed effective deep learning-based methods to remove the atmospheric turbulence effect. However, these synthesized turbulent images can not cover all the range of real-world turbulence effects. Though the models have achieved great performance for synthetic scenarios, there always exists a performance drop when applied to real-world cases. Moreover, reducing real-world turbulence is a more challenging task as there are no clean ground truth counterparts provided to the models during training. In this paper, we propose a real-world atmospheric turbulence mitigation model under a domain adaptation framework, which links the supervised simulated atmospheric turbulence correction with the unsupervised real-world atmospheric turbulence correction. We will show our proposed method enhances performance in real-world atmospheric turbulence scenarios, improving both image quality and downstream vision tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2402_07371
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Real-World Atmospheric Turbulence Correction via Domain Adaptation
Wang, Xijun
López-Tapia, Santiago
Katsaggelos, Aggelos K.
Computer Vision and Pattern Recognition
Image and Video Processing
Atmospheric turbulence, a common phenomenon in daily life, is primarily caused by the uneven heating of the Earth's surface. This phenomenon results in distorted and blurred acquired images or videos and can significantly impact downstream vision tasks, particularly those that rely on capturing clear, stable images or videos from outdoor environments, such as accurately detecting or recognizing objects. Therefore, people have proposed ways to simulate atmospheric turbulence and designed effective deep learning-based methods to remove the atmospheric turbulence effect. However, these synthesized turbulent images can not cover all the range of real-world turbulence effects. Though the models have achieved great performance for synthetic scenarios, there always exists a performance drop when applied to real-world cases. Moreover, reducing real-world turbulence is a more challenging task as there are no clean ground truth counterparts provided to the models during training. In this paper, we propose a real-world atmospheric turbulence mitigation model under a domain adaptation framework, which links the supervised simulated atmospheric turbulence correction with the unsupervised real-world atmospheric turbulence correction. We will show our proposed method enhances performance in real-world atmospheric turbulence scenarios, improving both image quality and downstream vision tasks.
title Real-World Atmospheric Turbulence Correction via Domain Adaptation
topic Computer Vision and Pattern Recognition
Image and Video Processing
url https://arxiv.org/abs/2402.07371