Transformers as Strong Lens Detectors- From Simulation to Surveys

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Thuruthipilly, Hareesh, Grespan, Margherita, Zadrożny, Adam
Format: Preprint
Publié: 2022
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913270671081472
author Thuruthipilly, Hareesh
Grespan, Margherita
Zadrożny, Adam
author_facet Thuruthipilly, Hareesh
Grespan, Margherita
Zadrożny, Adam
contents With the upcoming large-scale surveys like LSST, we expect to find approximately $10^5$ strong gravitational lenses among data of many orders of magnitude larger. In this scenario, the usage of non-automated techniques is too time-consuming and hence impractical for science. For this reason, machine learning techniques started becoming an alternative to previous methods. In our previous work, we proposed a new machine learning architecture based on the principle of self-attention, trained to find strong gravitational lenses on simulated data from the Bologna Lens Challenge. Self-attention-based models have clear advantages compared to simpler CNNs and highly competing performance in comparison to the current state-of-art CNN models. We apply the proposed model to the Kilo Degree Survey, identifying some new strong lens candidates. However, these have been identified among a plethora of false positives, which made the application of this model not so advantageous. Therefore, throughout this paper, we investigate the pitfalls of this approach, and possible solutions, such as transfer learning, are proposed.
format Preprint
id arxiv_https___arxiv_org_abs_2212_12915
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Transformers as Strong Lens Detectors- From Simulation to Surveys
Thuruthipilly, Hareesh
Grespan, Margherita
Zadrożny, Adam
Astrophysics of Galaxies
Instrumentation and Methods for Astrophysics
With the upcoming large-scale surveys like LSST, we expect to find approximately $10^5$ strong gravitational lenses among data of many orders of magnitude larger. In this scenario, the usage of non-automated techniques is too time-consuming and hence impractical for science. For this reason, machine learning techniques started becoming an alternative to previous methods. In our previous work, we proposed a new machine learning architecture based on the principle of self-attention, trained to find strong gravitational lenses on simulated data from the Bologna Lens Challenge. Self-attention-based models have clear advantages compared to simpler CNNs and highly competing performance in comparison to the current state-of-art CNN models. We apply the proposed model to the Kilo Degree Survey, identifying some new strong lens candidates. However, these have been identified among a plethora of false positives, which made the application of this model not so advantageous. Therefore, throughout this paper, we investigate the pitfalls of this approach, and possible solutions, such as transfer learning, are proposed.
title Transformers as Strong Lens Detectors- From Simulation to Surveys
topic Astrophysics of Galaxies
Instrumentation and Methods for Astrophysics
url https://arxiv.org/abs/2212.12915