Saved in:
Bibliographic Details
Main Authors: Sooknunan, Kimeel, Chapman, Emma, Conaboy, Luke, Mortlock, Daniel, Pritchard, Jonathan
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2412.15893
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915073575878656
author Sooknunan, Kimeel
Chapman, Emma
Conaboy, Luke
Mortlock, Daniel
Pritchard, Jonathan
author_facet Sooknunan, Kimeel
Chapman, Emma
Conaboy, Luke
Mortlock, Daniel
Pritchard, Jonathan
contents Machine learning (ML) methods have become popular for parameter inference in cosmology, although their reliance on specific training data can cause difficulties when applied across different data sets. By reproducing and testing networks previously used in the field, and applied to 21cmFast and Simfast21 simulations, we show that convolutional neural networks (CNNs) often learn to identify features of individual simulation boxes rather than the underlying physics, limiting their applicability to real observations. We examine the prediction of the neutral fraction and astrophysical parameters from 21 cm maps and find that networks typically fail to generalise to unseen simulations. We explore a number of case studies to highlight factors that improve or degrade network performance. These results emphasise the responsibility on users to ensure ML models are applied correctly in 21 cm cosmology.
format Preprint
id arxiv_https___arxiv_org_abs_2412_15893
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Reproducibility of machine learning analyses of 21 cm reionization maps
Sooknunan, Kimeel
Chapman, Emma
Conaboy, Luke
Mortlock, Daniel
Pritchard, Jonathan
Cosmology and Nongalactic Astrophysics
Machine learning (ML) methods have become popular for parameter inference in cosmology, although their reliance on specific training data can cause difficulties when applied across different data sets. By reproducing and testing networks previously used in the field, and applied to 21cmFast and Simfast21 simulations, we show that convolutional neural networks (CNNs) often learn to identify features of individual simulation boxes rather than the underlying physics, limiting their applicability to real observations. We examine the prediction of the neutral fraction and astrophysical parameters from 21 cm maps and find that networks typically fail to generalise to unseen simulations. We explore a number of case studies to highlight factors that improve or degrade network performance. These results emphasise the responsibility on users to ensure ML models are applied correctly in 21 cm cosmology.
title Reproducibility of machine learning analyses of 21 cm reionization maps
topic Cosmology and Nongalactic Astrophysics
url https://arxiv.org/abs/2412.15893