Saved in:
Bibliographic Details
Main Authors: Alam, Mohammed Talha, Imam, Raza, Guizani, Mohsen, Karray, Fakhri
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2407.06817
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911949400309760
author Alam, Mohammed Talha
Imam, Raza
Guizani, Mohsen
Karray, Fakhri
author_facet Alam, Mohammed Talha
Imam, Raza
Guizani, Mohsen
Karray, Fakhri
contents The prevalence of AI-generated imagery has raised concerns about the authenticity of astronomical images, especially with advanced text-to-image models like Stable Diffusion producing highly realistic synthetic samples. Existing detection methods, primarily based on convolutional neural networks (CNNs) or spectral analysis, have limitations when used independently. We present AstroSpy, a hybrid model that integrates both spectral and image features to distinguish real from synthetic astronomical images. Trained on a unique dataset of real NASA images and AI-generated fakes (approximately 18k samples), AstroSpy utilizes a dual-pathway architecture to fuse spatial and spectral information. This approach enables AstroSpy to achieve superior performance in identifying authentic astronomical images. Extensive evaluations demonstrate AstroSpy's effectiveness and robustness, significantly outperforming baseline models in both in-domain and cross-domain tasks, highlighting its potential to combat misinformation in astronomy.
format Preprint
id arxiv_https___arxiv_org_abs_2407_06817
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle AstroSpy: On detecting Fake Images in Astronomy via Joint Image-Spectral Representations
Alam, Mohammed Talha
Imam, Raza
Guizani, Mohsen
Karray, Fakhri
Computer Vision and Pattern Recognition
The prevalence of AI-generated imagery has raised concerns about the authenticity of astronomical images, especially with advanced text-to-image models like Stable Diffusion producing highly realistic synthetic samples. Existing detection methods, primarily based on convolutional neural networks (CNNs) or spectral analysis, have limitations when used independently. We present AstroSpy, a hybrid model that integrates both spectral and image features to distinguish real from synthetic astronomical images. Trained on a unique dataset of real NASA images and AI-generated fakes (approximately 18k samples), AstroSpy utilizes a dual-pathway architecture to fuse spatial and spectral information. This approach enables AstroSpy to achieve superior performance in identifying authentic astronomical images. Extensive evaluations demonstrate AstroSpy's effectiveness and robustness, significantly outperforming baseline models in both in-domain and cross-domain tasks, highlighting its potential to combat misinformation in astronomy.
title AstroSpy: On detecting Fake Images in Astronomy via Joint Image-Spectral Representations
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2407.06817