Self-Supervised Learning on MeerKAT Wide-Field Continuum Images
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866913558882680832 |
|---|---|
| author | Lastufka, Erica Bait, Omkar Taran, Olga Drozdova, Mariia Kinakh, Vitaliy Piras, Davide Audard, Marc Dessauges-Zavadsky, Miroslava Holotyak, Taras Schaerer, Daniel Voloshynovskiy, Svyatoslav |
| author_facet | Lastufka, Erica Bait, Omkar Taran, Olga Drozdova, Mariia Kinakh, Vitaliy Piras, Davide Audard, Marc Dessauges-Zavadsky, Miroslava Holotyak, Taras Schaerer, Daniel Voloshynovskiy, Svyatoslav |
| contents | Self-supervised learning (SSL) applied to natural images has demonstrated a remarkable ability to learn meaningful, low-dimension representations without labels, resulting in models that are adaptable to many different tasks. Until now, applications of SSL to astronomical images have been limited to Galaxy Zoo datasets, which require a significant amount of pre-processing to prepare sparse images centered on a single galaxy. With wide-field survey instruments at the forefront of the Square Kilometer Array (SKA) era, this approach to gathering training data is impractical. We demonstrate that continuum images from surveys like the MeerKAT Galactic Cluster Legacy Survey (MGCLS) can be successfully used with SSL, without extracting single-galaxy cutouts. Using the SSL framework DINO, we experiment with various preprocessing steps, augmentations, and architectures to determine the optimal approach for this data. We train both ResNet50 and Vision Transformer (ViT) backbones. Our models match state-of-the-art results (trained on Radio Galaxy Zoo) for FRI/FRII morphology classification. Furthermore, they predict the number of compact sources via linear regression with much higher accuracy. However, fine-tuning results in similar performance between our models, the state-of-the-art, and open-source models on multi-class morphology classification. Using source-rich crops from wide-field images to train multi-purpose models is an easily scalable approach that significantly reduces data preparation time. For the tasks evaluated in this work, twenty thousand crops is sufficient training data for models that produce results similar to state-of-the-art. In the future, complex tasks like source detection and characterization, together with domain-specific tasks, ought to demonstrate the true advantages of training models with radio astronomy data over natural-image foundation models. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_06147 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Self-Supervised Learning on MeerKAT Wide-Field Continuum Images Lastufka, Erica Bait, Omkar Taran, Olga Drozdova, Mariia Kinakh, Vitaliy Piras, Davide Audard, Marc Dessauges-Zavadsky, Miroslava Holotyak, Taras Schaerer, Daniel Voloshynovskiy, Svyatoslav Instrumentation and Methods for Astrophysics Self-supervised learning (SSL) applied to natural images has demonstrated a remarkable ability to learn meaningful, low-dimension representations without labels, resulting in models that are adaptable to many different tasks. Until now, applications of SSL to astronomical images have been limited to Galaxy Zoo datasets, which require a significant amount of pre-processing to prepare sparse images centered on a single galaxy. With wide-field survey instruments at the forefront of the Square Kilometer Array (SKA) era, this approach to gathering training data is impractical. We demonstrate that continuum images from surveys like the MeerKAT Galactic Cluster Legacy Survey (MGCLS) can be successfully used with SSL, without extracting single-galaxy cutouts. Using the SSL framework DINO, we experiment with various preprocessing steps, augmentations, and architectures to determine the optimal approach for this data. We train both ResNet50 and Vision Transformer (ViT) backbones. Our models match state-of-the-art results (trained on Radio Galaxy Zoo) for FRI/FRII morphology classification. Furthermore, they predict the number of compact sources via linear regression with much higher accuracy. However, fine-tuning results in similar performance between our models, the state-of-the-art, and open-source models on multi-class morphology classification. Using source-rich crops from wide-field images to train multi-purpose models is an easily scalable approach that significantly reduces data preparation time. For the tasks evaluated in this work, twenty thousand crops is sufficient training data for models that produce results similar to state-of-the-art. In the future, complex tasks like source detection and characterization, together with domain-specific tasks, ought to demonstrate the true advantages of training models with radio astronomy data over natural-image foundation models. |
| title | Self-Supervised Learning on MeerKAT Wide-Field Continuum Images |
| topic | Instrumentation and Methods for Astrophysics |
| url | https://arxiv.org/abs/2408.06147 |