Transformer-Powered Surrogates Close the ICF Simulation-Experiment Gap with Extremely Limited Data
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2023
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866914814482186240 |
|---|---|
| author | Olson, Matthew L. Liu, Shusen Thiagarajan, Jayaraman J. Kustowski, Bogdan Wong, Weng-Keen Anirudh, Rushil |
| author_facet | Olson, Matthew L. Liu, Shusen Thiagarajan, Jayaraman J. Kustowski, Bogdan Wong, Weng-Keen Anirudh, Rushil |
| contents | Recent advances in machine learning, specifically transformer architecture, have led to significant advancements in commercial domains. These powerful models have demonstrated superior capability to learn complex relationships and often generalize better to new data and problems. This paper presents a novel transformer-powered approach for enhancing prediction accuracy in multi-modal output scenarios, where sparse experimental data is supplemented with simulation data. The proposed approach integrates transformer-based architecture with a novel graph-based hyper-parameter optimization technique. The resulting system not only effectively reduces simulation bias, but also achieves superior prediction accuracy compared to the prior method. We demonstrate the efficacy of our approach on inertial confinement fusion experiments, where only 10 shots of real-world data are available, as well as synthetic versions of these experiments. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2312_03642 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Transformer-Powered Surrogates Close the ICF Simulation-Experiment Gap with Extremely Limited Data Olson, Matthew L. Liu, Shusen Thiagarajan, Jayaraman J. Kustowski, Bogdan Wong, Weng-Keen Anirudh, Rushil Machine Learning Recent advances in machine learning, specifically transformer architecture, have led to significant advancements in commercial domains. These powerful models have demonstrated superior capability to learn complex relationships and often generalize better to new data and problems. This paper presents a novel transformer-powered approach for enhancing prediction accuracy in multi-modal output scenarios, where sparse experimental data is supplemented with simulation data. The proposed approach integrates transformer-based architecture with a novel graph-based hyper-parameter optimization technique. The resulting system not only effectively reduces simulation bias, but also achieves superior prediction accuracy compared to the prior method. We demonstrate the efficacy of our approach on inertial confinement fusion experiments, where only 10 shots of real-world data are available, as well as synthetic versions of these experiments. |
| title | Transformer-Powered Surrogates Close the ICF Simulation-Experiment Gap with Extremely Limited Data |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2312.03642 |