AraOS: Analyzing the Impact of Virtual Memory Management on Vector Unit Performance

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Perotti, Matteo, Maisto, Vincenzo, Imfeld, Moritz, Wistoff, Nils, Cilardo, Alessandro, Benini, Luca
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912326658031616
author Perotti, Matteo
Maisto, Vincenzo
Imfeld, Moritz
Wistoff, Nils
Cilardo, Alessandro
Benini, Luca
author_facet Perotti, Matteo
Maisto, Vincenzo
Imfeld, Moritz
Wistoff, Nils
Cilardo, Alessandro
Benini, Luca
contents Vector processor architectures offer an efficient solution for accelerating data-parallel workloads (e.g., ML, AI), reducing instruction count, and enhancing processing efficiency. This is evidenced by the increasing adoption of vector ISAs, such as Arm's SVE/SVE2 and RISC-V's RVV, not only in high-performance computers but also in embedded systems. The open-source nature of RVV has particularly encouraged the development of numerous vector processor designs across industry and academia. However, despite the growing number of open-source RVV processors, there is a lack of published data on their performance in a complex application environment hosted by a full-fledged operating system (Linux). In this work, we add OS support to the open-source bare-metal Ara2 vector processor (AraOS) by sharing the MMU of CVA6, the scalar core used for instruction dispatch to Ara2, and integrate AraOS into the open-source Cheshire SoC platform. We evaluate the performance overhead of virtual-to-physical address translation by benchmarking matrix multiplication kernels across several problem sizes and translation lookaside buffer (TLB) configurations in CVA6's shared MMU, providing insights into vector performance in a full-system environment with virtual memory. With at least 16 TLB entries, the virtual memory overhead remains below 3.5%. Finally, we benchmark a 2-lane AraOS instance with the open-source RiVEC benchmark suite for RVV architectures, with peak average speedups of 3.2x against scalar-only execution.
format Preprint
id arxiv_https___arxiv_org_abs_2504_10345
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle AraOS: Analyzing the Impact of Virtual Memory Management on Vector Unit Performance
Perotti, Matteo
Maisto, Vincenzo
Imfeld, Moritz
Wistoff, Nils
Cilardo, Alessandro
Benini, Luca
Hardware Architecture
Vector processor architectures offer an efficient solution for accelerating data-parallel workloads (e.g., ML, AI), reducing instruction count, and enhancing processing efficiency. This is evidenced by the increasing adoption of vector ISAs, such as Arm's SVE/SVE2 and RISC-V's RVV, not only in high-performance computers but also in embedded systems. The open-source nature of RVV has particularly encouraged the development of numerous vector processor designs across industry and academia. However, despite the growing number of open-source RVV processors, there is a lack of published data on their performance in a complex application environment hosted by a full-fledged operating system (Linux). In this work, we add OS support to the open-source bare-metal Ara2 vector processor (AraOS) by sharing the MMU of CVA6, the scalar core used for instruction dispatch to Ara2, and integrate AraOS into the open-source Cheshire SoC platform. We evaluate the performance overhead of virtual-to-physical address translation by benchmarking matrix multiplication kernels across several problem sizes and translation lookaside buffer (TLB) configurations in CVA6's shared MMU, providing insights into vector performance in a full-system environment with virtual memory. With at least 16 TLB entries, the virtual memory overhead remains below 3.5%. Finally, we benchmark a 2-lane AraOS instance with the open-source RiVEC benchmark suite for RVV architectures, with peak average speedups of 3.2x against scalar-only execution.
title AraOS: Analyzing the Impact of Virtual Memory Management on Vector Unit Performance
topic Hardware Architecture
url https://arxiv.org/abs/2504.10345