Self-supervised contrastive learning of radio data for source detection, classification and peculiar object discovery

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Riggi, S., Cecconello, T., Palazzo, S., Hopkins, A. M., Gupta, N., Bordiu, C., Ingallinera, A., Buemi, C., Bufano, F., Cavallaro, F., Filipović, M. D., Leto, P., Loru, S., Ruggeri, A. C., Trigilio, C., Umana, G., Vitello, F.
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910704996450304
author Riggi, S.
Cecconello, T.
Palazzo, S.
Hopkins, A. M.
Gupta, N.
Bordiu, C.
Ingallinera, A.
Buemi, C.
Bufano, F.
Cavallaro, F.
Filipović, M. D.
Leto, P.
Loru, S.
Ruggeri, A. C.
Trigilio, C.
Umana, G.
Vitello, F.
author_facet Riggi, S.
Cecconello, T.
Palazzo, S.
Hopkins, A. M.
Gupta, N.
Bordiu, C.
Ingallinera, A.
Buemi, C.
Bufano, F.
Cavallaro, F.
Filipović, M. D.
Leto, P.
Loru, S.
Ruggeri, A. C.
Trigilio, C.
Umana, G.
Vitello, F.
contents New advancements in radio data post-processing are underway within the SKA precursor community, aiming to facilitate the extraction of scientific results from survey images through a semi-automated approach. Several of these developments leverage deep learning (DL) methodologies for diverse tasks, including source detection, object or morphology classification, and anomaly detection. Despite substantial progress, the full potential of these methods often remains untapped due to challenges associated with training large supervised models, particularly in the presence of small and class-unbalanced labelled datasets. Self-supervised learning has recently established itself as a powerful methodology to deal with some of the aforementioned challenges, by directly learning a lower-dimensional representation from large samples of unlabelled data. The resulting model and data representation can then be used for data inspection and various downstream tasks if a small subset of labelled data is available. In this work, we explored contrastive learning methods to learn suitable radio data representation from unlabelled images taken from the ASKAP EMU and SARAO MeerKAT GPS surveys. We evaluated trained models and the obtained data representation over smaller labelled datasets, also taken from different radio surveys, in selected analysis tasks: source detection and classification, and search for objects with peculiar morphology. For all explored downstream tasks, we reported and discussed the benefits brought by self-supervised foundational models built on radio data.
format Preprint
id arxiv_https___arxiv_org_abs_2404_18462
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Self-supervised contrastive learning of radio data for source detection, classification and peculiar object discovery
Riggi, S.
Cecconello, T.
Palazzo, S.
Hopkins, A. M.
Gupta, N.
Bordiu, C.
Ingallinera, A.
Buemi, C.
Bufano, F.
Cavallaro, F.
Filipović, M. D.
Leto, P.
Loru, S.
Ruggeri, A. C.
Trigilio, C.
Umana, G.
Vitello, F.
Instrumentation and Methods for Astrophysics
New advancements in radio data post-processing are underway within the SKA precursor community, aiming to facilitate the extraction of scientific results from survey images through a semi-automated approach. Several of these developments leverage deep learning (DL) methodologies for diverse tasks, including source detection, object or morphology classification, and anomaly detection. Despite substantial progress, the full potential of these methods often remains untapped due to challenges associated with training large supervised models, particularly in the presence of small and class-unbalanced labelled datasets. Self-supervised learning has recently established itself as a powerful methodology to deal with some of the aforementioned challenges, by directly learning a lower-dimensional representation from large samples of unlabelled data. The resulting model and data representation can then be used for data inspection and various downstream tasks if a small subset of labelled data is available. In this work, we explored contrastive learning methods to learn suitable radio data representation from unlabelled images taken from the ASKAP EMU and SARAO MeerKAT GPS surveys. We evaluated trained models and the obtained data representation over smaller labelled datasets, also taken from different radio surveys, in selected analysis tasks: source detection and classification, and search for objects with peculiar morphology. For all explored downstream tasks, we reported and discussed the benefits brought by self-supervised foundational models built on radio data.
title Self-supervised contrastive learning of radio data for source detection, classification and peculiar object discovery
topic Instrumentation and Methods for Astrophysics
url https://arxiv.org/abs/2404.18462