Adaptive Migration Decision for Multi-Tenant Memory Systems

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Cho, Hyungjun, Kim, Igjae, Choi, Kwanghoon, Kim, Hongjin, Lee, Wonjae, Im, Junhyeok, So, Jinin, Huh, Jaehyuk
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908362985177088
author Cho, Hyungjun
Kim, Igjae
Choi, Kwanghoon
Kim, Hongjin
Lee, Wonjae
Im, Junhyeok
So, Jinin
Huh, Jaehyuk
author_facet Cho, Hyungjun
Kim, Igjae
Choi, Kwanghoon
Kim, Hongjin
Lee, Wonjae
Im, Junhyeok
So, Jinin
Huh, Jaehyuk
contents Tiered memory systems consisting of fast small memory and slow large memory have emerged to provide high capacity memory in a cost-effective way. The effectiveness of tiered memory systems relies on how many memory accesses can be absorbed by the fast first-tier memory by page migration. The recent studies proposed several different ways of detecting hot pages and migrating them efficiently. However, our investigation shows that page migration is not always beneficial as it has the associated cost of detecting and migrating hot pages. When an application is unfriendly to migration, it is often better not to migrate pages at all. Based on the observation on migration friendliness, this paper proposes a migration control framework for multi-tenant tiered memory systems. First, it proposes a detection mechanism for migration friendliness, using per-page ping-pong status. Ping-pong pages which are promoted and demoted repeatedly in a short period of time tells migration effectiveness. Based on their change behaviors, migration is stopped or continued. After the page migration is stopped, the second mechanism detects changes of memory access patterns in a low cost way to determine whether migration needs to be resumed. Finally, as each application has a different behavior, our framework provides per-process migration control to selectively stop and start migration depending on application characteristics. We implement the framework in the Linux kernel. The evaluation with a commercial CXL-based tiered memory system shows that it effectively controls migration in single and multi-tenant environments.
format Preprint
id arxiv_https___arxiv_org_abs_2505_09164
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Adaptive Migration Decision for Multi-Tenant Memory Systems
Cho, Hyungjun
Kim, Igjae
Choi, Kwanghoon
Kim, Hongjin
Lee, Wonjae
Im, Junhyeok
So, Jinin
Huh, Jaehyuk
Operating Systems
Tiered memory systems consisting of fast small memory and slow large memory have emerged to provide high capacity memory in a cost-effective way. The effectiveness of tiered memory systems relies on how many memory accesses can be absorbed by the fast first-tier memory by page migration. The recent studies proposed several different ways of detecting hot pages and migrating them efficiently. However, our investigation shows that page migration is not always beneficial as it has the associated cost of detecting and migrating hot pages. When an application is unfriendly to migration, it is often better not to migrate pages at all. Based on the observation on migration friendliness, this paper proposes a migration control framework for multi-tenant tiered memory systems. First, it proposes a detection mechanism for migration friendliness, using per-page ping-pong status. Ping-pong pages which are promoted and demoted repeatedly in a short period of time tells migration effectiveness. Based on their change behaviors, migration is stopped or continued. After the page migration is stopped, the second mechanism detects changes of memory access patterns in a low cost way to determine whether migration needs to be resumed. Finally, as each application has a different behavior, our framework provides per-process migration control to selectively stop and start migration depending on application characteristics. We implement the framework in the Linux kernel. The evaluation with a commercial CXL-based tiered memory system shows that it effectively controls migration in single and multi-tenant environments.
title Adaptive Migration Decision for Multi-Tenant Memory Systems
topic Operating Systems
url https://arxiv.org/abs/2505.09164