AION-1: Omnimodal Foundation Model for Astronomical Sciences
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866914104957992960 |
|---|---|
| author | Parker, Liam Lanusse, Francois Shen, Jeff Liu, Ollie Hehir, Tom Sarra, Leopoldo Meyer, Lucas Bowles, Micah Wagner-Carena, Sebastian Qu, Helen Golkar, Siavash Bietti, Alberto Bourfoune, Hatim Casserau, Nathan Cornette, Pierre Hirashima, Keiya Krawezik, Geraud Ohana, Ruben Lourie, Nicholas McCabe, Michael Morel, Rudy Mukhopadhyay, Payel Pettee, Mariel Blancard, Bruno Regaldo-Saint Cho, Kyunghyun Cranmer, Miles Ho, Shirley |
| author_facet | Parker, Liam Lanusse, Francois Shen, Jeff Liu, Ollie Hehir, Tom Sarra, Leopoldo Meyer, Lucas Bowles, Micah Wagner-Carena, Sebastian Qu, Helen Golkar, Siavash Bietti, Alberto Bourfoune, Hatim Casserau, Nathan Cornette, Pierre Hirashima, Keiya Krawezik, Geraud Ohana, Ruben Lourie, Nicholas McCabe, Michael Morel, Rudy Mukhopadhyay, Payel Pettee, Mariel Blancard, Bruno Regaldo-Saint Cho, Kyunghyun Cranmer, Miles Ho, Shirley |
| contents | While foundation models have shown promise across a variety of fields, astronomy still lacks a unified framework for joint modeling across its highly diverse data modalities. In this paper, we present AION-1, a family of large-scale multimodal foundation models for astronomy. AION-1 integrates heterogeneous imaging, spectroscopic, and scalar data using a two-stage architecture: modality-specific tokenization followed by transformer-based masked modeling of cross-modal token sequences. The model is pretrained on five large-scale surveys: Legacy Survey, Hyper Suprime-Cam (HSC), Sloan Digital Sky Survey (SDSS), Dark Energy Spectroscopic Instrument (DESI), and Gaia. These span more than 200 million observations of stars, galaxies, and quasars. With a single frozen encoder, AION-1 achieves strong results on a broad suite of downstream tasks, including galaxy and stellar property estimation, galaxy morphology classification, similarity-based retrieval, galaxy image segmentation, and spectral super-resolution. We release AION-1 model variants ranging from 300 M to 3.1 B parameters. Beyond astronomy, AION-1 provides a scalable blueprint for multimodal scientific foundation models that can seamlessly integrate noisy, instrument-specific observations. All code, tokenizers, pretrained weights, and a lightweight evaluation suite are released under an open-source license. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_17960 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | AION-1: Omnimodal Foundation Model for Astronomical Sciences Parker, Liam Lanusse, Francois Shen, Jeff Liu, Ollie Hehir, Tom Sarra, Leopoldo Meyer, Lucas Bowles, Micah Wagner-Carena, Sebastian Qu, Helen Golkar, Siavash Bietti, Alberto Bourfoune, Hatim Casserau, Nathan Cornette, Pierre Hirashima, Keiya Krawezik, Geraud Ohana, Ruben Lourie, Nicholas McCabe, Michael Morel, Rudy Mukhopadhyay, Payel Pettee, Mariel Blancard, Bruno Regaldo-Saint Cho, Kyunghyun Cranmer, Miles Ho, Shirley Instrumentation and Methods for Astrophysics Cosmology and Nongalactic Astrophysics While foundation models have shown promise across a variety of fields, astronomy still lacks a unified framework for joint modeling across its highly diverse data modalities. In this paper, we present AION-1, a family of large-scale multimodal foundation models for astronomy. AION-1 integrates heterogeneous imaging, spectroscopic, and scalar data using a two-stage architecture: modality-specific tokenization followed by transformer-based masked modeling of cross-modal token sequences. The model is pretrained on five large-scale surveys: Legacy Survey, Hyper Suprime-Cam (HSC), Sloan Digital Sky Survey (SDSS), Dark Energy Spectroscopic Instrument (DESI), and Gaia. These span more than 200 million observations of stars, galaxies, and quasars. With a single frozen encoder, AION-1 achieves strong results on a broad suite of downstream tasks, including galaxy and stellar property estimation, galaxy morphology classification, similarity-based retrieval, galaxy image segmentation, and spectral super-resolution. We release AION-1 model variants ranging from 300 M to 3.1 B parameters. Beyond astronomy, AION-1 provides a scalable blueprint for multimodal scientific foundation models that can seamlessly integrate noisy, instrument-specific observations. All code, tokenizers, pretrained weights, and a lightweight evaluation suite are released under an open-source license. |
| title | AION-1: Omnimodal Foundation Model for Astronomical Sciences |
| topic | Instrumentation and Methods for Astrophysics Cosmology and Nongalactic Astrophysics |
| url | https://arxiv.org/abs/2510.17960 |