Idiosyncrasies of Programmable Caching Engines
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866911517830545408 |
|---|---|
| author | Peixoto, José Gonzalez, Alexis Bhimani, Janki Rangaswami, Raju Brito, Cláudia Paulo, João Macedo, Ricardo |
| author_facet | Peixoto, José Gonzalez, Alexis Bhimani, Janki Rangaswami, Raju Brito, Cláudia Paulo, João Macedo, Ricardo |
| contents | Programmable caching engines like CacheLib are widely used in production systems to support diverse workloads in multi-tenant environments. CacheLib's design focuses on performance, portability, and configurability, allowing applications to inherit caching improvements with minimal implementation effort. However, its behavior under dynamic and evolving workloads remains largely unexplored. This paper presents an empirical study of CacheLib with multi-tenant settings under dynamic and volatile environments. Our evaluation across multiple CacheLib configurations reveals several limitations that hinder its effectiveness under such environments, including rigid configurations, limited runtime adaptability, lack of quality-of-service support and coordination, which lead to suboptimal performance, inefficient memory usage, and tenant starvation. Based on these findings, we outline future research directions to improve the adaptability, fairness, and programmability of future caching engines. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_14357 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Idiosyncrasies of Programmable Caching Engines Peixoto, José Gonzalez, Alexis Bhimani, Janki Rangaswami, Raju Brito, Cláudia Paulo, João Macedo, Ricardo Operating Systems Distributed, Parallel, and Cluster Computing Programmable caching engines like CacheLib are widely used in production systems to support diverse workloads in multi-tenant environments. CacheLib's design focuses on performance, portability, and configurability, allowing applications to inherit caching improvements with minimal implementation effort. However, its behavior under dynamic and evolving workloads remains largely unexplored. This paper presents an empirical study of CacheLib with multi-tenant settings under dynamic and volatile environments. Our evaluation across multiple CacheLib configurations reveals several limitations that hinder its effectiveness under such environments, including rigid configurations, limited runtime adaptability, lack of quality-of-service support and coordination, which lead to suboptimal performance, inefficient memory usage, and tenant starvation. Based on these findings, we outline future research directions to improve the adaptability, fairness, and programmability of future caching engines. |
| title | Idiosyncrasies of Programmable Caching Engines |
| topic | Operating Systems Distributed, Parallel, and Cluster Computing |
| url | https://arxiv.org/abs/2603.14357 |