Unsupervised Machine Learning for Scientific Discovery: Workflow and Best Practices

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Chang, Andersen, Tang, Tiffany M., Zikry, Tarek M., Allen, Genevera I.
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916780746735616
author Chang, Andersen
Tang, Tiffany M.
Zikry, Tarek M.
Allen, Genevera I.
author_facet Chang, Andersen
Tang, Tiffany M.
Zikry, Tarek M.
Allen, Genevera I.
contents Unsupervised machine learning is widely used to mine large, unlabeled datasets to make data-driven discoveries in critical domains such as climate science, biomedicine, astronomy, chemistry, and more. However, despite its widespread utilization, there is a lack of standardization in unsupervised learning workflows for making reliable and reproducible scientific discoveries. In this paper, we present a structured workflow for using unsupervised learning techniques in science. We highlight and discuss best practices starting with formulating validatable scientific questions, conducting robust data preparation and exploration, using a range of modeling techniques, performing rigorous validation by evaluating the stability and generalizability of unsupervised learning conclusions, and promoting effective communication and documentation of results to ensure reproducible scientific discoveries. To illustrate our proposed workflow, we present a case study from astronomy, seeking to refine globular clusters of Milky Way stars based upon their chemical composition. Our case study highlights the importance of validation and illustrates how the benefits of a carefully-designed workflow for unsupervised learning can advance scientific discovery.
format Preprint
id arxiv_https___arxiv_org_abs_2506_04553
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Unsupervised Machine Learning for Scientific Discovery: Workflow and Best Practices
Chang, Andersen
Tang, Tiffany M.
Zikry, Tarek M.
Allen, Genevera I.
Machine Learning
Applications
Computation
Unsupervised machine learning is widely used to mine large, unlabeled datasets to make data-driven discoveries in critical domains such as climate science, biomedicine, astronomy, chemistry, and more. However, despite its widespread utilization, there is a lack of standardization in unsupervised learning workflows for making reliable and reproducible scientific discoveries. In this paper, we present a structured workflow for using unsupervised learning techniques in science. We highlight and discuss best practices starting with formulating validatable scientific questions, conducting robust data preparation and exploration, using a range of modeling techniques, performing rigorous validation by evaluating the stability and generalizability of unsupervised learning conclusions, and promoting effective communication and documentation of results to ensure reproducible scientific discoveries. To illustrate our proposed workflow, we present a case study from astronomy, seeking to refine globular clusters of Milky Way stars based upon their chemical composition. Our case study highlights the importance of validation and illustrates how the benefits of a carefully-designed workflow for unsupervised learning can advance scientific discovery.
title Unsupervised Machine Learning for Scientific Discovery: Workflow and Best Practices
topic Machine Learning
Applications
Computation
url https://arxiv.org/abs/2506.04553