Large Language Models as Realistic Microservice Trace Generators
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866914047994101760 |
|---|---|
| author | Kim, Donghyun Ravula, Sriram Ha, Taemin Dimakis, Alexandros G. Kim, Daehyeok Akella, Aditya |
| author_facet | Kim, Donghyun Ravula, Sriram Ha, Taemin Dimakis, Alexandros G. Kim, Daehyeok Akella, Aditya |
| contents | Workload traces are essential to understand complex computer systems' behavior and manage processing and memory resources. Since real-world traces are hard to obtain, synthetic trace generation is a promising alternative. This paper proposes a first-of-a-kind approach that relies on training a large language model (LLM) to generate synthetic workload traces, specifically microservice call graphs. To capture complex and arbitrary hierarchical structures and implicit constraints in such traces, we propose to train LLMs to generate recursively, making call graph generation a sequence of more manageable steps. To further enforce learning constraints on the traces and generate uncommon situations, we apply additional instruction tuning steps to align our model with the desired trace features. With this method, we train TraceLLM, an LLM for microservice trace generation, and demonstrate that it produces diverse, realistic traces under varied conditions, outperforming existing approaches in both accuracy and validity. The synthetically generated traces can effectively replace real data to optimize important microservice management tasks. Additionally, TraceLLM adapts to downstream trace-related tasks, such as predicting key trace features and infilling missing data. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_17439 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Large Language Models as Realistic Microservice Trace Generators Kim, Donghyun Ravula, Sriram Ha, Taemin Dimakis, Alexandros G. Kim, Daehyeok Akella, Aditya Software Engineering Artificial Intelligence Distributed, Parallel, and Cluster Computing Operating Systems Workload traces are essential to understand complex computer systems' behavior and manage processing and memory resources. Since real-world traces are hard to obtain, synthetic trace generation is a promising alternative. This paper proposes a first-of-a-kind approach that relies on training a large language model (LLM) to generate synthetic workload traces, specifically microservice call graphs. To capture complex and arbitrary hierarchical structures and implicit constraints in such traces, we propose to train LLMs to generate recursively, making call graph generation a sequence of more manageable steps. To further enforce learning constraints on the traces and generate uncommon situations, we apply additional instruction tuning steps to align our model with the desired trace features. With this method, we train TraceLLM, an LLM for microservice trace generation, and demonstrate that it produces diverse, realistic traces under varied conditions, outperforming existing approaches in both accuracy and validity. The synthetically generated traces can effectively replace real data to optimize important microservice management tasks. Additionally, TraceLLM adapts to downstream trace-related tasks, such as predicting key trace features and infilling missing data. |
| title | Large Language Models as Realistic Microservice Trace Generators |
| topic | Software Engineering Artificial Intelligence Distributed, Parallel, and Cluster Computing Operating Systems |
| url | https://arxiv.org/abs/2502.17439 |