PAAM: A Framework for Coordinated and Priority-Driven Accelerator Management in ROS 2

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Enright, Daniel, Xiang, Yecheng, Choi, Hyunjong, Kim, Hyoseung
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914746376126464
author Enright, Daniel
Xiang, Yecheng
Choi, Hyunjong
Kim, Hyoseung
author_facet Enright, Daniel
Xiang, Yecheng
Choi, Hyunjong
Kim, Hyoseung
contents This paper proposes a Priority-driven Accelerator Access Management (PAAM) framework for multi-process robotic applications built on top of the Robot Operating System (ROS) 2 middleware platform. The framework addresses the issue of predictable execution of time- and safety-critical callback chains that require hardware accelerators such as GPUs and TPUs. PAAM provides a standalone ROS executor that acts as an accelerator resource server, arbitrating accelerator access requests from all other callbacks at the application layer. This approach enables coordinated and priority-driven accelerator access management in multi-process robotic systems. The framework design is directly applicable to all types of accelerators and enables granular control over how specific chains access accelerators, making it possible to achieve predictable real-time support for accelerators used by safety-critical callback chains without making changes to underlying accelerator device drivers. The paper shows that PAAM also offers a theoretical analysis that can upper bound the worst-case response time of safety-critical callback chains that necessitate accelerator access. This paper also demonstrates that complex robotic systems with extensive accelerator usage that are integrated with PAAM may achieve up to a 91\% reduction in end-to-end response time of their critical callback chains.
format Preprint
id arxiv_https___arxiv_org_abs_2404_06452
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle PAAM: A Framework for Coordinated and Priority-Driven Accelerator Management in ROS 2
Enright, Daniel
Xiang, Yecheng
Choi, Hyunjong
Kim, Hyoseung
Robotics
Systems and Control
This paper proposes a Priority-driven Accelerator Access Management (PAAM) framework for multi-process robotic applications built on top of the Robot Operating System (ROS) 2 middleware platform. The framework addresses the issue of predictable execution of time- and safety-critical callback chains that require hardware accelerators such as GPUs and TPUs. PAAM provides a standalone ROS executor that acts as an accelerator resource server, arbitrating accelerator access requests from all other callbacks at the application layer. This approach enables coordinated and priority-driven accelerator access management in multi-process robotic systems. The framework design is directly applicable to all types of accelerators and enables granular control over how specific chains access accelerators, making it possible to achieve predictable real-time support for accelerators used by safety-critical callback chains without making changes to underlying accelerator device drivers. The paper shows that PAAM also offers a theoretical analysis that can upper bound the worst-case response time of safety-critical callback chains that necessitate accelerator access. This paper also demonstrates that complex robotic systems with extensive accelerator usage that are integrated with PAAM may achieve up to a 91\% reduction in end-to-end response time of their critical callback chains.
title PAAM: A Framework for Coordinated and Priority-Driven Accelerator Management in ROS 2
topic Robotics
Systems and Control
url https://arxiv.org/abs/2404.06452