Optimizing Offload Performance in Heterogeneous MPSoCs

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Colagrande, Luca, Benini, Luca
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866918192465575936
author Colagrande, Luca
Benini, Luca
author_facet Colagrande, Luca
Benini, Luca
contents Heterogeneous multi-core architectures combine a few "host" cores, optimized for single-thread performance, with many small energy-efficient "accelerator" cores for data-parallel processing, on a single chip. Offloading a computation to the many-core acceleration fabric introduces a communication and synchronization cost which reduces the speedup attainable on the accelerator, particularly for small and fine-grained parallel tasks. We demonstrate that by co-designing the hardware and offload routines, we can increase the speedup of an offloaded DAXPY kernel by as much as 47.9%. Furthermore, we show that it is possible to accurately model the runtime of an offloaded application, accounting for the offload overheads, with as low as 1% MAPE error, enabling optimal offload decisions under offload execution time constraints.
format Preprint
id arxiv_https___arxiv_org_abs_2404_01908
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Optimizing Offload Performance in Heterogeneous MPSoCs
Colagrande, Luca
Benini, Luca
Hardware Architecture
Distributed, Parallel, and Cluster Computing
Heterogeneous multi-core architectures combine a few "host" cores, optimized for single-thread performance, with many small energy-efficient "accelerator" cores for data-parallel processing, on a single chip. Offloading a computation to the many-core acceleration fabric introduces a communication and synchronization cost which reduces the speedup attainable on the accelerator, particularly for small and fine-grained parallel tasks. We demonstrate that by co-designing the hardware and offload routines, we can increase the speedup of an offloaded DAXPY kernel by as much as 47.9%. Furthermore, we show that it is possible to accurately model the runtime of an offloaded application, accounting for the offload overheads, with as low as 1% MAPE error, enabling optimal offload decisions under offload execution time constraints.
title Optimizing Offload Performance in Heterogeneous MPSoCs
topic Hardware Architecture
Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2404.01908