Scalable Construction of Spiking Neural Networks using up to thousands of GPUs
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866917497916096512 |
|---|---|
| author | Golosio, Bruno Tiddia, Gianmarco Villamar, José Pontisso, Luca Sergi, Luca Simula, Francesco Babu, Pooja Pastorelli, Elena Morrison, Abigail Diesmann, Markus Lonardo, Alessandro Paolucci, Pier Stanislao Senk, Johanna |
| author_facet | Golosio, Bruno Tiddia, Gianmarco Villamar, José Pontisso, Luca Sergi, Luca Simula, Francesco Babu, Pooja Pastorelli, Elena Morrison, Abigail Diesmann, Markus Lonardo, Alessandro Paolucci, Pier Stanislao Senk, Johanna |
| contents | Diverse scientific and engineering research areas deal with discrete, time-stamped changes in large systems of interacting delay differential equations. Simulating such complex systems at scale on high-performance computing clusters demands efficient management of communication and memory. Inspired by the human cerebral cortex -- a sparsely connected network of $\mathcal{O}(10^{10})$ neurons, each forming $\mathcal{O}(10^{3})$--$\mathcal{O}(10^{4})$ synapses and communicating via short electrical pulses called spikes -- we study the simulation of large-scale spiking neural networks for computational neuroscience research. This work presents a novel network construction method for multi-GPU clusters and upcoming exascale supercomputers using the Message Passing Interface (MPI), where each process builds its local connectivity and prepares the data structures for efficient spike exchange across the cluster during state propagation. We demonstrate scaling performance of two cortical models using point-to-point and collective communication, respectively. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_09502 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Scalable Construction of Spiking Neural Networks using up to thousands of GPUs Golosio, Bruno Tiddia, Gianmarco Villamar, José Pontisso, Luca Sergi, Luca Simula, Francesco Babu, Pooja Pastorelli, Elena Morrison, Abigail Diesmann, Markus Lonardo, Alessandro Paolucci, Pier Stanislao Senk, Johanna Distributed, Parallel, and Cluster Computing Neural and Evolutionary Computing Computational Physics Neurons and Cognition Diverse scientific and engineering research areas deal with discrete, time-stamped changes in large systems of interacting delay differential equations. Simulating such complex systems at scale on high-performance computing clusters demands efficient management of communication and memory. Inspired by the human cerebral cortex -- a sparsely connected network of $\mathcal{O}(10^{10})$ neurons, each forming $\mathcal{O}(10^{3})$--$\mathcal{O}(10^{4})$ synapses and communicating via short electrical pulses called spikes -- we study the simulation of large-scale spiking neural networks for computational neuroscience research. This work presents a novel network construction method for multi-GPU clusters and upcoming exascale supercomputers using the Message Passing Interface (MPI), where each process builds its local connectivity and prepares the data structures for efficient spike exchange across the cluster during state propagation. We demonstrate scaling performance of two cortical models using point-to-point and collective communication, respectively. |
| title | Scalable Construction of Spiking Neural Networks using up to thousands of GPUs |
| topic | Distributed, Parallel, and Cluster Computing Neural and Evolutionary Computing Computational Physics Neurons and Cognition |
| url | https://arxiv.org/abs/2512.09502 |