Saved in:
Bibliographic Details
Main Authors: Fan, Xingzhong, Tang, Hongming, Zeng, Yue, Kouwenhoven, M. B. N., Zeng, Guangquan
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2506.16255
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915910827114496
author Fan, Xingzhong
Tang, Hongming
Zeng, Yue
Kouwenhoven, M. B. N.
Zeng, Guangquan
author_facet Fan, Xingzhong
Tang, Hongming
Zeng, Yue
Kouwenhoven, M. B. N.
Zeng, Guangquan
contents Conventional galaxy generation methods rely on semi-analytical models and hydrodynamic simulations, which are highly dependent on physical assumptions and parameter tuning. In contrast, data-driven generative models do not have explicit physical parameters pre-determined, and instead learn them efficiently from observational data, making them alternative solutions to galaxy generation. Among these, diffusion models outperform Variational Autoencoders (VAEs) and Generative Adversarial Networks (GANs) in quality and diversity. Leveraging physical prior knowledge to these models can further enhance their capabilities. In this work, we present GalCatDiff, the first framework in astronomy to leverage both galaxy image features and astrophysical properties in the network design of diffusion models. GalCatDiff incorporates an enhanced U-Net and a novel block entitled Astro-RAB (Residual Attention Block), which dynamically combines attention mechanisms with convolution operations to ensure global consistency and local feature fidelity. Moreover, GalCatDiff uses category embeddings for class-specific galaxy generation, avoiding the high computational costs of training separate models for each category. Our experimental results demonstrate that GalCatDiff significantly outperforms existing methods in terms of the consistency of sample color and size distributions, and the generated galaxies are both visually realistic and physically consistent. This framework will enhance the reliability of galaxy simulations and can potentially serve as a data augmentor to support future galaxy classification algorithm development.
format Preprint
id arxiv_https___arxiv_org_abs_2506_16255
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Category-based Galaxy Image Generation via Diffusion Models
Fan, Xingzhong
Tang, Hongming
Zeng, Yue
Kouwenhoven, M. B. N.
Zeng, Guangquan
Instrumentation and Methods for Astrophysics
Artificial Intelligence
Conventional galaxy generation methods rely on semi-analytical models and hydrodynamic simulations, which are highly dependent on physical assumptions and parameter tuning. In contrast, data-driven generative models do not have explicit physical parameters pre-determined, and instead learn them efficiently from observational data, making them alternative solutions to galaxy generation. Among these, diffusion models outperform Variational Autoencoders (VAEs) and Generative Adversarial Networks (GANs) in quality and diversity. Leveraging physical prior knowledge to these models can further enhance their capabilities. In this work, we present GalCatDiff, the first framework in astronomy to leverage both galaxy image features and astrophysical properties in the network design of diffusion models. GalCatDiff incorporates an enhanced U-Net and a novel block entitled Astro-RAB (Residual Attention Block), which dynamically combines attention mechanisms with convolution operations to ensure global consistency and local feature fidelity. Moreover, GalCatDiff uses category embeddings for class-specific galaxy generation, avoiding the high computational costs of training separate models for each category. Our experimental results demonstrate that GalCatDiff significantly outperforms existing methods in terms of the consistency of sample color and size distributions, and the generated galaxies are both visually realistic and physically consistent. This framework will enhance the reliability of galaxy simulations and can potentially serve as a data augmentor to support future galaxy classification algorithm development.
title Category-based Galaxy Image Generation via Diffusion Models
topic Instrumentation and Methods for Astrophysics
Artificial Intelligence
url https://arxiv.org/abs/2506.16255