Equilibria: Fair Multi-Tenant CXL Memory Tiering At Scale

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zhao, Kaiyang, Gholkar, Neha, Maruf, Hasan, Dhanotia, Abhishek, Weiner, Johannes, Price, Gregory, Sun, Ning, Dwivedi, Bhavya, Clark, Stuart, Skarlatos, Dimitrios
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913046847291392
author Zhao, Kaiyang
Gholkar, Neha
Maruf, Hasan
Dhanotia, Abhishek
Weiner, Johannes
Price, Gregory
Sun, Ning
Dwivedi, Bhavya
Clark, Stuart
Skarlatos, Dimitrios
author_facet Zhao, Kaiyang
Gholkar, Neha
Maruf, Hasan
Dhanotia, Abhishek
Weiner, Johannes
Price, Gregory
Sun, Ning
Dwivedi, Bhavya
Clark, Stuart
Skarlatos, Dimitrios
contents Memory dominates datacenter system cost and power. Memory expansion via Compute Express Link (CXL) is an effective way to provide additional memory at lower cost and power, but its effective use requires software-level tiering for hyperscaler workloads. Existing tiering solutions, including current Linux support, face fundamental limitations in production deployments. First, they lack multi-tenancy support, failing to handle stacked homogeneous or heterogeneous workloads. Second, limited control-plane flexibility leads to fairness violations and performance variability. Finally, insufficient observability prevents operators from diagnosing performance pathologies at scale. We present Equilibria, an OS framework enabling fair, multi-tenant CXL tiering at datacenter scale. Equilibria provides per-container controls for memory fair-share allocation and fine-grained observability of tiered-memory usage and operations. It further enforces flexible, user-specified fairness policies through regulated promotion and demotion, and mitigates noisy-neighbor interference by suppressing thrashing. Evaluated in a large hyperscaler fleet using production workloads and benchmarks, Equilibria helps workloads meet service level objectives (SLOs) while avoiding performance interference. It improves performance over the state-of-the-art Linux solution, TPP, by up to 52% for production workloads and 1.7x for benchmarks. All Equilibria patches have been released to the Linux community.
format Preprint
id arxiv_https___arxiv_org_abs_2602_08800
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Equilibria: Fair Multi-Tenant CXL Memory Tiering At Scale
Zhao, Kaiyang
Gholkar, Neha
Maruf, Hasan
Dhanotia, Abhishek
Weiner, Johannes
Price, Gregory
Sun, Ning
Dwivedi, Bhavya
Clark, Stuart
Skarlatos, Dimitrios
Operating Systems
Distributed, Parallel, and Cluster Computing
Memory dominates datacenter system cost and power. Memory expansion via Compute Express Link (CXL) is an effective way to provide additional memory at lower cost and power, but its effective use requires software-level tiering for hyperscaler workloads. Existing tiering solutions, including current Linux support, face fundamental limitations in production deployments. First, they lack multi-tenancy support, failing to handle stacked homogeneous or heterogeneous workloads. Second, limited control-plane flexibility leads to fairness violations and performance variability. Finally, insufficient observability prevents operators from diagnosing performance pathologies at scale. We present Equilibria, an OS framework enabling fair, multi-tenant CXL tiering at datacenter scale. Equilibria provides per-container controls for memory fair-share allocation and fine-grained observability of tiered-memory usage and operations. It further enforces flexible, user-specified fairness policies through regulated promotion and demotion, and mitigates noisy-neighbor interference by suppressing thrashing. Evaluated in a large hyperscaler fleet using production workloads and benchmarks, Equilibria helps workloads meet service level objectives (SLOs) while avoiding performance interference. It improves performance over the state-of-the-art Linux solution, TPP, by up to 52% for production workloads and 1.7x for benchmarks. All Equilibria patches have been released to the Linux community.
title Equilibria: Fair Multi-Tenant CXL Memory Tiering At Scale
topic Operating Systems
Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2602.08800