Visualizing Distributed Traces in Aggregate

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Samanta, Adrita, Han, Henry, Huye, Darby, Liu, Lan, Zhang, Zhaoqi, Sambasivan, Raja R.
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912149904818176
author Samanta, Adrita
Han, Henry
Huye, Darby
Liu, Lan
Zhang, Zhaoqi
Sambasivan, Raja R.
author_facet Samanta, Adrita
Han, Henry
Huye, Darby
Liu, Lan
Zhang, Zhaoqi
Sambasivan, Raja R.
contents Distributed systems are comprised of many components that communicate together to form an application. Distributed tracing gives us visibility into these complex interactions, but it can be difficult to reason about the system's behavior, even with traces. Systems collect large amounts of tracing data even with low sampling rates. Even when there are patterns in the system, it is often difficult to detect similarities in traces since current tools mainly allow developers to visualize individual traces. Debugging and system optimization is difficult for developers without an understanding of the whole trace dataset. In order to help present these similarities, this paper proposes a method to aggregate traces in a way that groups together and visualizes similar traces. We do so by assigning a few traces that are representative of each set. We suggest that traces can be grouped based on how many services they share, how many levels the graph has, how structurally similar they are, or how close their latencies are. We also develop an aggregate trace data structure as a way to comprehensively visualize these groups and a method for filtering out incomplete traces if a more complete version of the trace exists. The unique traces of each group are especially useful to developers for troubleshooting. Overall, our approach allows for a more efficient method of analyzing system behavior.
format Preprint
id arxiv_https___arxiv_org_abs_2412_07036
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Visualizing Distributed Traces in Aggregate
Samanta, Adrita
Han, Henry
Huye, Darby
Liu, Lan
Zhang, Zhaoqi
Sambasivan, Raja R.
Distributed, Parallel, and Cluster Computing
Distributed systems are comprised of many components that communicate together to form an application. Distributed tracing gives us visibility into these complex interactions, but it can be difficult to reason about the system's behavior, even with traces. Systems collect large amounts of tracing data even with low sampling rates. Even when there are patterns in the system, it is often difficult to detect similarities in traces since current tools mainly allow developers to visualize individual traces. Debugging and system optimization is difficult for developers without an understanding of the whole trace dataset. In order to help present these similarities, this paper proposes a method to aggregate traces in a way that groups together and visualizes similar traces. We do so by assigning a few traces that are representative of each set. We suggest that traces can be grouped based on how many services they share, how many levels the graph has, how structurally similar they are, or how close their latencies are. We also develop an aggregate trace data structure as a way to comprehensively visualize these groups and a method for filtering out incomplete traces if a more complete version of the trace exists. The unique traces of each group are especially useful to developers for troubleshooting. Overall, our approach allows for a more efficient method of analyzing system behavior.
title Visualizing Distributed Traces in Aggregate
topic Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2412.07036