Contemplating a Lightweight Communication Interface for Asynchronous Many-Task Systems

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yan, Jiakun, Snir, Marc
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917962035757056
author Yan, Jiakun
Snir, Marc
author_facet Yan, Jiakun
Snir, Marc
contents Asynchronous Many-Task Systems (AMTs) exhibit different communication patterns from traditional High-Performance Computing (HPC) applications, characterized by asynchrony, concurrency, and multithreading. Existing communication libraries usually do not support AMTs' communication requirements in the most direct and efficient ways. The Lightweight Communication Interface (LCI) is an experimental communication library aiming to push for efficient communication support for AMTs. This paper presents the design for a new LCI C++ interface and its rationale. With a new C++ \emph{objectized flexible functions} idiom, the new interface aims for the following features: (a) a concise but expressive interface for all common point-to-point communication primitives and completion mechanisms, (b) a fine-grained resource mapping scheme for library interoperation, multithreaded performance isolation, and flexibility (c) a set of optional parameters and overridable classes for users to incrementally fine-tune the runtime behavior.
format Preprint
id arxiv_https___arxiv_org_abs_2503_15400
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Contemplating a Lightweight Communication Interface for Asynchronous Many-Task Systems
Yan, Jiakun
Snir, Marc
Distributed, Parallel, and Cluster Computing
Asynchronous Many-Task Systems (AMTs) exhibit different communication patterns from traditional High-Performance Computing (HPC) applications, characterized by asynchrony, concurrency, and multithreading. Existing communication libraries usually do not support AMTs' communication requirements in the most direct and efficient ways. The Lightweight Communication Interface (LCI) is an experimental communication library aiming to push for efficient communication support for AMTs. This paper presents the design for a new LCI C++ interface and its rationale. With a new C++ \emph{objectized flexible functions} idiom, the new interface aims for the following features: (a) a concise but expressive interface for all common point-to-point communication primitives and completion mechanisms, (b) a fine-grained resource mapping scheme for library interoperation, multithreaded performance isolation, and flexibility (c) a set of optional parameters and overridable classes for users to incrementally fine-tune the runtime behavior.
title Contemplating a Lightweight Communication Interface for Asynchronous Many-Task Systems
topic Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2503.15400