Enregistré dans:
| Auteurs principaux: | , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | https://arxiv.org/abs/2407.14532 |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866913439093358592 |
|---|---|
| author | Sun, Yongqian Wang, Jiaju Li, Zhengdan Nie, Xiaohui Ma, Minghua Zhang, Shenglin Ji, Yuhe Zhang, Lu Long, Wen Chen, Hengmao Luo, Yongnan Pei, Dan |
| author_facet | Sun, Yongqian Wang, Jiaju Li, Zhengdan Nie, Xiaohui Ma, Minghua Zhang, Shenglin Ji, Yuhe Zhang, Lu Long, Wen Chen, Hengmao Luo, Yongnan Pei, Dan |
| contents | AIOps algorithms play a crucial role in the maintenance of microservice systems. Many previous benchmarks' performance leaderboard provides valuable guidance for selecting appropriate algorithms. However, existing AIOps benchmarks mainly utilize offline datasets to evaluate algorithms. They cannot consistently evaluate the performance of algorithms using real-time datasets, and the operation scenarios for evaluation are static, which is insufficient for effective algorithm selection. To address these issues, we propose an evaluation-consistent and scenario-oriented evaluation framework named MicroServo. The core idea is to build a live microservice benchmark to generate real-time datasets and consistently simulate the specific operation scenarios on it. MicroServo supports different leaderboards by selecting specific algorithms and datasets according to the operation scenarios. It also supports the deployment of various types of algorithms, enabling algorithms hot-plugging. At last, we test MicroServo with three typical microservice operation scenarios to demonstrate its efficiency and usability. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_14532 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A Scenario-Oriented Benchmark for Assessing AIOps Algorithms in Microservice Management Sun, Yongqian Wang, Jiaju Li, Zhengdan Nie, Xiaohui Ma, Minghua Zhang, Shenglin Ji, Yuhe Zhang, Lu Long, Wen Chen, Hengmao Luo, Yongnan Pei, Dan Distributed, Parallel, and Cluster Computing Machine Learning AIOps algorithms play a crucial role in the maintenance of microservice systems. Many previous benchmarks' performance leaderboard provides valuable guidance for selecting appropriate algorithms. However, existing AIOps benchmarks mainly utilize offline datasets to evaluate algorithms. They cannot consistently evaluate the performance of algorithms using real-time datasets, and the operation scenarios for evaluation are static, which is insufficient for effective algorithm selection. To address these issues, we propose an evaluation-consistent and scenario-oriented evaluation framework named MicroServo. The core idea is to build a live microservice benchmark to generate real-time datasets and consistently simulate the specific operation scenarios on it. MicroServo supports different leaderboards by selecting specific algorithms and datasets according to the operation scenarios. It also supports the deployment of various types of algorithms, enabling algorithms hot-plugging. At last, we test MicroServo with three typical microservice operation scenarios to demonstrate its efficiency and usability. |
| title | A Scenario-Oriented Benchmark for Assessing AIOps Algorithms in Microservice Management |
| topic | Distributed, Parallel, and Cluster Computing Machine Learning |
| url | https://arxiv.org/abs/2407.14532 |