Is Intelligence the Right Direction in New OS Scheduling for Multiple Resources in Cloud Environments?

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Dou, Xinglei, Liu, Lei, Xiao, Limin
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913801197060096
author Dou, Xinglei
Liu, Lei
Xiao, Limin
author_facet Dou, Xinglei
Liu, Lei
Xiao, Limin
contents Making it intelligent is a promising way in System/OS design. This paper proposes OSML+, a new ML-based resource scheduling mechanism for co-located cloud services. OSML+ intelligently schedules the cache and main memory bandwidth resources at the memory hierarchy and the computing core resources simultaneously. OSML+ uses a multi-model collaborative learning approach during its scheduling and thus can handle complicated cases, e.g., avoiding resource cliffs, sharing resources among applications, enabling different scheduling policies for applications with different priorities, etc. OSML+ can converge faster using ML models than previous studies. Moreover, OSML+ can automatically learn on the fly and handle dynamically changing workloads accordingly. Using transfer learning technologies, we show our design can work well across various cloud servers, including the latest off-the-shelf large-scale servers. Our experimental results show that OSML+ supports higher loads and meets QoS targets with lower overheads than previous studies.
format Preprint
id arxiv_https___arxiv_org_abs_2504_15021
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Is Intelligence the Right Direction in New OS Scheduling for Multiple Resources in Cloud Environments?
Dou, Xinglei
Liu, Lei
Xiao, Limin
Distributed, Parallel, and Cluster Computing
Machine Learning
Performance
Making it intelligent is a promising way in System/OS design. This paper proposes OSML+, a new ML-based resource scheduling mechanism for co-located cloud services. OSML+ intelligently schedules the cache and main memory bandwidth resources at the memory hierarchy and the computing core resources simultaneously. OSML+ uses a multi-model collaborative learning approach during its scheduling and thus can handle complicated cases, e.g., avoiding resource cliffs, sharing resources among applications, enabling different scheduling policies for applications with different priorities, etc. OSML+ can converge faster using ML models than previous studies. Moreover, OSML+ can automatically learn on the fly and handle dynamically changing workloads accordingly. Using transfer learning technologies, we show our design can work well across various cloud servers, including the latest off-the-shelf large-scale servers. Our experimental results show that OSML+ supports higher loads and meets QoS targets with lower overheads than previous studies.
title Is Intelligence the Right Direction in New OS Scheduling for Multiple Resources in Cloud Environments?
topic Distributed, Parallel, and Cluster Computing
Machine Learning
Performance
url https://arxiv.org/abs/2504.15021