A Semi-Supervised Learning Method for the Identification of Bad Exposures in Large Imaging Surveys
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915822485635072 |
|---|---|
| author | Luo, Yufeng Myers, Adam D. Drlica-Wagner, Alex Dematties, Dario Borchani, Salma Valdes, Francisco Dey, Arjun Schlegel, David Zhou, Rongpu Team, DESI Legacy Imaging Surveys |
| author_facet | Luo, Yufeng Myers, Adam D. Drlica-Wagner, Alex Dematties, Dario Borchani, Salma Valdes, Francisco Dey, Arjun Schlegel, David Zhou, Rongpu Team, DESI Legacy Imaging Surveys |
| contents | As the data volume of astronomical imaging surveys rapidly increases, traditional methods for image anomaly detection, such as visual inspection by human experts, are becoming impractical. We introduce a machine-learning-based approach to detect poor-quality exposures in large imaging surveys, with a focus on the DECam Legacy Survey (DECaLS) in regions of low extinction (i.e., $E(B-V)<0.04$). Our semi-supervised pipeline integrates a vision transformer (ViT), trained via self-supervised learning (SSL), with a k-Nearest Neighbor (kNN) classifier. We train and validate our pipeline using a small set of labeled exposures observed by surveys with the Dark Energy Camera (DECam). A clustering-space analysis of where our pipeline places images labeled in ``good'' and ``bad'' categories suggests that our approach can efficiently and accurately determine the quality of exposures. Applied to new imaging being reduced for DECaLS Data Release 11, our pipeline identifies 780 problematic exposures, which we subsequently verify through visual inspection. Being highly efficient and adaptable, our method offers a scalable solution for quality control in other large imaging surveys. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_12784 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | A Semi-Supervised Learning Method for the Identification of Bad Exposures in Large Imaging Surveys Luo, Yufeng Myers, Adam D. Drlica-Wagner, Alex Dematties, Dario Borchani, Salma Valdes, Francisco Dey, Arjun Schlegel, David Zhou, Rongpu Team, DESI Legacy Imaging Surveys Instrumentation and Methods for Astrophysics Artificial Intelligence As the data volume of astronomical imaging surveys rapidly increases, traditional methods for image anomaly detection, such as visual inspection by human experts, are becoming impractical. We introduce a machine-learning-based approach to detect poor-quality exposures in large imaging surveys, with a focus on the DECam Legacy Survey (DECaLS) in regions of low extinction (i.e., $E(B-V)<0.04$). Our semi-supervised pipeline integrates a vision transformer (ViT), trained via self-supervised learning (SSL), with a k-Nearest Neighbor (kNN) classifier. We train and validate our pipeline using a small set of labeled exposures observed by surveys with the Dark Energy Camera (DECam). A clustering-space analysis of where our pipeline places images labeled in ``good'' and ``bad'' categories suggests that our approach can efficiently and accurately determine the quality of exposures. Applied to new imaging being reduced for DECaLS Data Release 11, our pipeline identifies 780 problematic exposures, which we subsequently verify through visual inspection. Being highly efficient and adaptable, our method offers a scalable solution for quality control in other large imaging surveys. |
| title | A Semi-Supervised Learning Method for the Identification of Bad Exposures in Large Imaging Surveys |
| topic | Instrumentation and Methods for Astrophysics Artificial Intelligence |
| url | https://arxiv.org/abs/2507.12784 |