Guardado en:
Detalles Bibliográficos
Autores principales: Su, Xingzhe, Zheng, Changwen, Qiang, Wenwen, Wu, Fengge, Zhao, Junsuo, Sun, Fuchun, Xiong, Hui
Formato: Preprint
Publicado: 2023
Materias:
Acceso en línea:https://arxiv.org/abs/2305.19507
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916180901494784
author Su, Xingzhe
Zheng, Changwen
Qiang, Wenwen
Wu, Fengge
Zhao, Junsuo
Sun, Fuchun
Xiong, Hui
author_facet Su, Xingzhe
Zheng, Changwen
Qiang, Wenwen
Wu, Fengge
Zhao, Junsuo
Sun, Fuchun
Xiong, Hui
contents Generative Adversarial Networks (GANs) have shown notable accomplishments in remote sensing domain. However, this paper reveals that their performance on remote sensing images falls short when compared to their impressive results with natural images. This study identifies a previously overlooked issue: GANs exhibit a heightened susceptibility to overfitting on remote sensing images.To address this challenge, this paper analyzes the characteristics of remote sensing images and proposes manifold constraint regularization, a novel approach that tackles overfitting of GANs on remote sensing images for the first time. Our method includes a new measure for evaluating the structure of the data manifold. Leveraging this measure, we propose the manifold constraint regularization term, which not only alleviates the overfitting problem, but also promotes alignment between the generated and real data manifolds, leading to enhanced quality in the generated images. The effectiveness and versatility of this method have been corroborated through extensive validation on various remote sensing datasets and GAN models. The proposed method not only enhances the quality of the generated images, reflected in a 3.13\% improvement in Frechet Inception Distance (FID) score, but also boosts the performance of the GANs on downstream tasks, evidenced by a 3.76\% increase in classification accuracy.
format Preprint
id arxiv_https___arxiv_org_abs_2305_19507
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Manifold Constraint Regularization for Remote Sensing Image Generation
Su, Xingzhe
Zheng, Changwen
Qiang, Wenwen
Wu, Fengge
Zhao, Junsuo
Sun, Fuchun
Xiong, Hui
Computer Vision and Pattern Recognition
Image and Video Processing
Generative Adversarial Networks (GANs) have shown notable accomplishments in remote sensing domain. However, this paper reveals that their performance on remote sensing images falls short when compared to their impressive results with natural images. This study identifies a previously overlooked issue: GANs exhibit a heightened susceptibility to overfitting on remote sensing images.To address this challenge, this paper analyzes the characteristics of remote sensing images and proposes manifold constraint regularization, a novel approach that tackles overfitting of GANs on remote sensing images for the first time. Our method includes a new measure for evaluating the structure of the data manifold. Leveraging this measure, we propose the manifold constraint regularization term, which not only alleviates the overfitting problem, but also promotes alignment between the generated and real data manifolds, leading to enhanced quality in the generated images. The effectiveness and versatility of this method have been corroborated through extensive validation on various remote sensing datasets and GAN models. The proposed method not only enhances the quality of the generated images, reflected in a 3.13\% improvement in Frechet Inception Distance (FID) score, but also boosts the performance of the GANs on downstream tasks, evidenced by a 3.76\% increase in classification accuracy.
title Manifold Constraint Regularization for Remote Sensing Image Generation
topic Computer Vision and Pattern Recognition
Image and Video Processing
url https://arxiv.org/abs/2305.19507