Domain Adaptive Graph Neural Networks for Constraining Cosmological Parameters Across Multiple Data Sets

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Roncoli, Andrea, Ćiprijanović, Aleksandra, Voetberg, Maggie, Villaescusa-Navarro, Francisco, Nord, Brian
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916206231945216
author Roncoli, Andrea
Ćiprijanović, Aleksandra
Voetberg, Maggie
Villaescusa-Navarro, Francisco
Nord, Brian
author_facet Roncoli, Andrea
Ćiprijanović, Aleksandra
Voetberg, Maggie
Villaescusa-Navarro, Francisco
Nord, Brian
contents Deep learning models have been shown to outperform methods that rely on summary statistics, like the power spectrum, in extracting information from complex cosmological data sets. However, due to differences in the subgrid physics implementation and numerical approximations across different simulation suites, models trained on data from one cosmological simulation show a drop in performance when tested on another. Similarly, models trained on any of the simulations would also likely experience a drop in performance when applied to observational data. Training on data from two different suites of the CAMELS hydrodynamic cosmological simulations, we examine the generalization capabilities of Domain Adaptive Graph Neural Networks (DA-GNNs). By utilizing GNNs, we capitalize on their capacity to capture structured scale-free cosmological information from galaxy distributions. Moreover, by including unsupervised domain adaptation via Maximum Mean Discrepancy (MMD), we enable our models to extract domain-invariant features. We demonstrate that DA-GNN achieves higher accuracy and robustness on cross-dataset tasks (up to $28\%$ better relative error and up to almost an order of magnitude better $χ^2$). Using data visualizations, we show the effects of domain adaptation on proper latent space data alignment. This shows that DA-GNNs are a promising method for extracting domain-independent cosmological information, a vital step toward robust deep learning for real cosmic survey data.
format Preprint
id arxiv_https___arxiv_org_abs_2311_01588
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Domain Adaptive Graph Neural Networks for Constraining Cosmological Parameters Across Multiple Data Sets
Roncoli, Andrea
Ćiprijanović, Aleksandra
Voetberg, Maggie
Villaescusa-Navarro, Francisco
Nord, Brian
Cosmology and Nongalactic Astrophysics
Artificial Intelligence
Machine Learning
Deep learning models have been shown to outperform methods that rely on summary statistics, like the power spectrum, in extracting information from complex cosmological data sets. However, due to differences in the subgrid physics implementation and numerical approximations across different simulation suites, models trained on data from one cosmological simulation show a drop in performance when tested on another. Similarly, models trained on any of the simulations would also likely experience a drop in performance when applied to observational data. Training on data from two different suites of the CAMELS hydrodynamic cosmological simulations, we examine the generalization capabilities of Domain Adaptive Graph Neural Networks (DA-GNNs). By utilizing GNNs, we capitalize on their capacity to capture structured scale-free cosmological information from galaxy distributions. Moreover, by including unsupervised domain adaptation via Maximum Mean Discrepancy (MMD), we enable our models to extract domain-invariant features. We demonstrate that DA-GNN achieves higher accuracy and robustness on cross-dataset tasks (up to $28\%$ better relative error and up to almost an order of magnitude better $χ^2$). Using data visualizations, we show the effects of domain adaptation on proper latent space data alignment. This shows that DA-GNNs are a promising method for extracting domain-independent cosmological information, a vital step toward robust deep learning for real cosmic survey data.
title Domain Adaptive Graph Neural Networks for Constraining Cosmological Parameters Across Multiple Data Sets
topic Cosmology and Nongalactic Astrophysics
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2311.01588