Enregistré dans:
Détails bibliographiques
Auteurs principaux: Van Essendelft, Dirk, Almolyki, Hayl, Shi, Wei, Jordan, Terry, Wang, Mei-Yu, Saidi, Wissam A.
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:https://arxiv.org/abs/2404.16990
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866929333295120384
author Van Essendelft, Dirk
Almolyki, Hayl
Shi, Wei
Jordan, Terry
Wang, Mei-Yu
Saidi, Wissam A.
author_facet Van Essendelft, Dirk
Almolyki, Hayl
Shi, Wei
Jordan, Terry
Wang, Mei-Yu
Saidi, Wissam A.
contents The versatility and wide-ranging applicability of the Ising model, originally introduced to study phase transitions in magnetic materials, have made it a cornerstone in statistical physics and a valuable tool for evaluating the performance of emerging computer hardware. Here, we present a novel implementation of the two-dimensional Ising model on a Cerebras Wafer-Scale Engine (WSE), a revolutionary processor that is opening new frontiers in computing. In our deployment of the checkerboard algorithm, we optimized the Ising model to take advantage of the unique WSE architecture. Specifically, we employed a compressed bit representation storing 16 spins on each int16 word, and efficiently distributed the spins over the processing units enabling seamless weak scaling and limiting communications to only immediate neighboring units. Our implementation can handle up to 754 simulations in parallel, achieving an aggregate of over 61.8 trillion flip attempts per second for Ising models with up to 200 million spins. This represents a gain of up to 148 times over previously reported single-device with a highly optimized implementation on NVIDIA V100 and up to 88 times in productivity compared to NVIDIA H100. Our findings highlight the significant potential of the WSE in scientific computing, particularly in the field of materials modeling.
format Preprint
id arxiv_https___arxiv_org_abs_2404_16990
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Record Acceleration of the Two-Dimensional Ising Model Using High-Performance Wafer Scale Engine
Van Essendelft, Dirk
Almolyki, Hayl
Shi, Wei
Jordan, Terry
Wang, Mei-Yu
Saidi, Wissam A.
Hardware Architecture
Materials Science
The versatility and wide-ranging applicability of the Ising model, originally introduced to study phase transitions in magnetic materials, have made it a cornerstone in statistical physics and a valuable tool for evaluating the performance of emerging computer hardware. Here, we present a novel implementation of the two-dimensional Ising model on a Cerebras Wafer-Scale Engine (WSE), a revolutionary processor that is opening new frontiers in computing. In our deployment of the checkerboard algorithm, we optimized the Ising model to take advantage of the unique WSE architecture. Specifically, we employed a compressed bit representation storing 16 spins on each int16 word, and efficiently distributed the spins over the processing units enabling seamless weak scaling and limiting communications to only immediate neighboring units. Our implementation can handle up to 754 simulations in parallel, achieving an aggregate of over 61.8 trillion flip attempts per second for Ising models with up to 200 million spins. This represents a gain of up to 148 times over previously reported single-device with a highly optimized implementation on NVIDIA V100 and up to 88 times in productivity compared to NVIDIA H100. Our findings highlight the significant potential of the WSE in scientific computing, particularly in the field of materials modeling.
title Record Acceleration of the Two-Dimensional Ising Model Using High-Performance Wafer Scale Engine
topic Hardware Architecture
Materials Science
url https://arxiv.org/abs/2404.16990