Applying Vision Transformers on Spectral Analysis of Astronomical Objects
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913117753049088 |
|---|---|
| author | Moraes, Luis Felipe Strano Becker, Ignacio Protopapas, Pavlos Cabrera-Vives, Guillermo |
| author_facet | Moraes, Luis Felipe Strano Becker, Ignacio Protopapas, Pavlos Cabrera-Vives, Guillermo |
| contents | We apply pre-trained Vision Transformers (ViTs), originally developed for image recognition, to the analysis of astronomical spectral data. By converting traditional one-dimensional spectra into two-dimensional image representations, we enable ViTs to capture both local and global spectral features through spatial self-attention. We fine-tune a ViT pretrained on ImageNet using millions of spectra from the SDSS and LAMOST surveys, represented as spectral plots. Our model is evaluated on key tasks including stellar object classification and redshift ($z$) estimation, where it demonstrates strong performance and scalability. We achieve classification accuracy higher than Support Vector Machines and Random Forests, and attain $R^2$ values comparable to AstroCLIP's spectrum encoder, even when generalizing across diverse object types. These results demonstrate the effectiveness of using pretrained vision models for spectroscopic data analysis. To our knowledge, this is the first application of ViTs to large-scale, which also leverages real spectroscopic data and does not rely on synthetic inputs. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_00294 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Applying Vision Transformers on Spectral Analysis of Astronomical Objects Moraes, Luis Felipe Strano Becker, Ignacio Protopapas, Pavlos Cabrera-Vives, Guillermo Instrumentation and Methods for Astrophysics Computer Vision and Pattern Recognition We apply pre-trained Vision Transformers (ViTs), originally developed for image recognition, to the analysis of astronomical spectral data. By converting traditional one-dimensional spectra into two-dimensional image representations, we enable ViTs to capture both local and global spectral features through spatial self-attention. We fine-tune a ViT pretrained on ImageNet using millions of spectra from the SDSS and LAMOST surveys, represented as spectral plots. Our model is evaluated on key tasks including stellar object classification and redshift ($z$) estimation, where it demonstrates strong performance and scalability. We achieve classification accuracy higher than Support Vector Machines and Random Forests, and attain $R^2$ values comparable to AstroCLIP's spectrum encoder, even when generalizing across diverse object types. These results demonstrate the effectiveness of using pretrained vision models for spectroscopic data analysis. To our knowledge, this is the first application of ViTs to large-scale, which also leverages real spectroscopic data and does not rely on synthetic inputs. |
| title | Applying Vision Transformers on Spectral Analysis of Astronomical Objects |
| topic | Instrumentation and Methods for Astrophysics Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2506.00294 |