Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Yang, Yitao, Deng, Yangtao, Xiong, Yifan, Li, Baochun, Xu, Hong, Cheng, Peng
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2506.01481
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910194903023616
author Yang, Yitao
Deng, Yangtao
Xiong, Yifan
Li, Baochun
Xu, Hong
Cheng, Peng
author_facet Yang, Yitao
Deng, Yangtao
Xiong, Yifan
Li, Baochun
Xu, Hong
Cheng, Peng
contents AI workloads incur frequent failures and incidents from the underlying infrastructure. The current incident management workflow follows a provider-centric paradigm, where users report incidents to the infrastructure provider who then conducts troubleshooting. Due to the large number of incidents and the manual nature of the troubleshooting process, the provider often takes several days to resolve an incident, resulting in operational delays and productivity loss. To address these challenges, we present TSGuard, a user-centric multi-agent system that delivers immediate incident diagnosis to users who deploy the workloads. The core innovation of TSGuard is twofold: (1) constructing domain-specific knowledge bases by mining historical on-call experiences in the offline phase, and (2) mimicking human expert diagnosis via structured reasoning and iterative trial-and-error in the online phase. Evaluation using production incident records from Microsoft Azure demonstrates that TSGuard significantly outperforms state-of-the-art baselines, improving diagnostic accuracy by 19.8%. Furthermore, TSGuard reduces the average verification time by 63.4% compared to the sequential execution baseline.
format Preprint
id arxiv_https___arxiv_org_abs_2506_01481
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle TSGuard: Automated User-Centric Incident Diagnosis for AI Workloads in the Cloud
Yang, Yitao
Deng, Yangtao
Xiong, Yifan
Li, Baochun
Xu, Hong
Cheng, Peng
Software Engineering
AI workloads incur frequent failures and incidents from the underlying infrastructure. The current incident management workflow follows a provider-centric paradigm, where users report incidents to the infrastructure provider who then conducts troubleshooting. Due to the large number of incidents and the manual nature of the troubleshooting process, the provider often takes several days to resolve an incident, resulting in operational delays and productivity loss. To address these challenges, we present TSGuard, a user-centric multi-agent system that delivers immediate incident diagnosis to users who deploy the workloads. The core innovation of TSGuard is twofold: (1) constructing domain-specific knowledge bases by mining historical on-call experiences in the offline phase, and (2) mimicking human expert diagnosis via structured reasoning and iterative trial-and-error in the online phase. Evaluation using production incident records from Microsoft Azure demonstrates that TSGuard significantly outperforms state-of-the-art baselines, improving diagnostic accuracy by 19.8%. Furthermore, TSGuard reduces the average verification time by 63.4% compared to the sequential execution baseline.
title TSGuard: Automated User-Centric Incident Diagnosis for AI Workloads in the Cloud
topic Software Engineering
url https://arxiv.org/abs/2506.01481