PAL -- Parallel active learning for machine-learned potentials
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916501196374016 |
|---|---|
| author | Zhou, Chen Neubert, Marlen Koide, Yuri Zhang, Yumeng Vuong, Van-Quan Schlöder, Tobias Dehnen, Stefanie Friederich, Pascal |
| author_facet | Zhou, Chen Neubert, Marlen Koide, Yuri Zhang, Yumeng Vuong, Van-Quan Schlöder, Tobias Dehnen, Stefanie Friederich, Pascal |
| contents | Constructing datasets representative of the target domain is essential for training effective machine learning models. Active learning (AL) is a promising method that iteratively extends training data to enhance model performance while minimizing data acquisition costs. However, current AL workflows often require human intervention and lack parallelism, leading to inefficiencies and underutilization of modern computational resources. In this work, we introduce PAL, an automated, modular, and parallel active learning library that integrates AL tasks and manages their execution and communication on shared- and distributed-memory systems using the Message Passing Interface (MPI). PAL provides users with the flexibility to design and customize all components of their active learning scenarios, including machine learning models with uncertainty estimation, oracles for ground truth labeling, and strategies for exploring the target space. We demonstrate that PAL significantly reduces computational overhead and improves scalability, achieving substantial speed-ups through asynchronous parallelization on CPU and GPU hardware. Applications of PAL to several real-world scenarios - including ground-state reactions in biomolecular systems, excited-state dynamics of molecules, simulations of inorganic clusters, and thermo-fluid dynamics - illustrate its effectiveness in accelerating the development of machine learning models. Our results show that PAL enables efficient utilization of high-performance computing resources in active learning workflows, fostering advancements in scientific research and engineering applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_00401 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | PAL -- Parallel active learning for machine-learned potentials Zhou, Chen Neubert, Marlen Koide, Yuri Zhang, Yumeng Vuong, Van-Quan Schlöder, Tobias Dehnen, Stefanie Friederich, Pascal Machine Learning Materials Science Distributed, Parallel, and Cluster Computing Chemical Physics Computational Physics Constructing datasets representative of the target domain is essential for training effective machine learning models. Active learning (AL) is a promising method that iteratively extends training data to enhance model performance while minimizing data acquisition costs. However, current AL workflows often require human intervention and lack parallelism, leading to inefficiencies and underutilization of modern computational resources. In this work, we introduce PAL, an automated, modular, and parallel active learning library that integrates AL tasks and manages their execution and communication on shared- and distributed-memory systems using the Message Passing Interface (MPI). PAL provides users with the flexibility to design and customize all components of their active learning scenarios, including machine learning models with uncertainty estimation, oracles for ground truth labeling, and strategies for exploring the target space. We demonstrate that PAL significantly reduces computational overhead and improves scalability, achieving substantial speed-ups through asynchronous parallelization on CPU and GPU hardware. Applications of PAL to several real-world scenarios - including ground-state reactions in biomolecular systems, excited-state dynamics of molecules, simulations of inorganic clusters, and thermo-fluid dynamics - illustrate its effectiveness in accelerating the development of machine learning models. Our results show that PAL enables efficient utilization of high-performance computing resources in active learning workflows, fostering advancements in scientific research and engineering applications. |
| title | PAL -- Parallel active learning for machine-learned potentials |
| topic | Machine Learning Materials Science Distributed, Parallel, and Cluster Computing Chemical Physics Computational Physics |
| url | https://arxiv.org/abs/2412.00401 |