Columbo: Low Level End-to-End System Traces through Modular Full-System Simulation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Görgen, Jakob, Anand, Vaastav, Li, Hejing, Li, Jialin, Kaufmann, Antoine
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910563665182720
author Görgen, Jakob
Anand, Vaastav
Li, Hejing
Li, Jialin
Kaufmann, Antoine
author_facet Görgen, Jakob
Anand, Vaastav
Li, Hejing
Li, Jialin
Kaufmann, Antoine
contents Fully understanding performance is a growing challenge when building next-generation cloud systems. Often these systems build on next-generation hardware, and evaluation in realistic physical testbeds is out of reach. Even when physical testbeds are available, visibility into essential system aspects is a challenge in modern systems where system performance depends on often sub-$μs$ interactions between HW and SW components. Existing tools such as performance counters, logging, and distributed tracing provide aggregate or sampled information, but remain insufficient for understanding individual requests in-depth. In this paper, we explore a fundamentally different approach to enable in-depth understanding of cloud system behavior at the software and hardware level, with (almost) arbitrarily fine-grained visibility. Our proposal is to run cloud systems in detailed full-system simulations, configure the simulators to collect detailed events without affecting the system, and finally assemble these events into end-to-end system traces that can be analyzed by existing distributed tracing tools.
format Preprint
id arxiv_https___arxiv_org_abs_2408_05251
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Columbo: Low Level End-to-End System Traces through Modular Full-System Simulation
Görgen, Jakob
Anand, Vaastav
Li, Hejing
Li, Jialin
Kaufmann, Antoine
Performance
Operating Systems
Fully understanding performance is a growing challenge when building next-generation cloud systems. Often these systems build on next-generation hardware, and evaluation in realistic physical testbeds is out of reach. Even when physical testbeds are available, visibility into essential system aspects is a challenge in modern systems where system performance depends on often sub-$μs$ interactions between HW and SW components. Existing tools such as performance counters, logging, and distributed tracing provide aggregate or sampled information, but remain insufficient for understanding individual requests in-depth. In this paper, we explore a fundamentally different approach to enable in-depth understanding of cloud system behavior at the software and hardware level, with (almost) arbitrarily fine-grained visibility. Our proposal is to run cloud systems in detailed full-system simulations, configure the simulators to collect detailed events without affecting the system, and finally assemble these events into end-to-end system traces that can be analyzed by existing distributed tracing tools.
title Columbo: Low Level End-to-End System Traces through Modular Full-System Simulation
topic Performance
Operating Systems
url https://arxiv.org/abs/2408.05251