Copertina

OpsEval: A Comprehensive IT Operations Benchmark Suite for Large Language Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Liu, Yuhe, Pei, Changhua, Xu, Longlong, Chen, Bohan, Sun, Mingze, Zhang, Zhirui, Sun, Yongqian, Zhang, Shenglin, Wang, Kun, Zhang, Haiming, Li, Jianhui, Xie, Gaogang, Wen, Xidao, Nie, Xiaohui, Ma, Minghua, Pei, Dan
Natura:	Preprint
Pubblicazione:	2023
Soggetti:	Artificial Intelligence Networking and Internet Architecture
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

OpsAgent: An Evolving Multi-agent System for Incident Management in Microservices
di: Luo, Yu, et al.
Pubblicazione: (2025)

TimeSeriesBench: An Industrial-Grade Benchmark for Time Series Anomaly Detection Models
di: Si, Haotian, et al.
Pubblicazione: (2024)

A Survey on AgentOps: Categorization, Challenges, and Future Directions
di: Wang, Zexin, et al.
Pubblicazione: (2025)

KAN-AD: Time Series Anomaly Detection with Kolmogorov-Arnold Networks
di: Zhou, Quan, et al.
Pubblicazione: (2024)

CMoS: Rethinking Time Series Prediction Through the Lens of Chunk-wise Spatial Correlations
di: Si, Haotian, et al.
Pubblicazione: (2025)

LogEval: A Comprehensive Benchmark Suite for Large Language Models In Log Analysis
di: Cui, Tianyu, et al.
Pubblicazione: (2024)

TrioXpert: An Automated Incident Management Framework for Microservice System
di: Sun, Yongqian, et al.
Pubblicazione: (2025)

Revisiting VAE for Unsupervised Time Series Anomaly Detection: A Frequency Perspective
di: Wang, Zexin, et al.
Pubblicazione: (2024)

A Scenario-Oriented Benchmark for Assessing AIOps Algorithms in Microservice Management
di: Sun, Yongqian, et al.
Pubblicazione: (2024)

Enhancing Interpretability in Software Change Management with Chain-of-Thought Reasoning
di: Sun, Yongqian, et al.
Pubblicazione: (2025)

Failure Diagnosis in Microservice Systems: A Comprehensive Survey and Analysis
di: Zhang, Shenglin, et al.
Pubblicazione: (2024)

Triage in Software Engineering: A Systematic Review of Research and Practice
di: Zhao, Yongxin, et al.
Pubblicazione: (2025)

EvidenT: An Evidence-Preserving Framework for Iterative System-Level Package Repair
di: Zhao, Chenyu, et al.
Pubblicazione: (2026)

Graph of States: Solving Abductive Tasks with Large Language Models
di: Luo, Yu, et al.
Pubblicazione: (2026)

TimeSense:Making Large Language Models Proficient in Time-Series Analysis
di: Zhang, Zhirui, et al.
Pubblicazione: (2025)

TShape: Rescuing Machine Learning Models from Complex Shapelet Anomalies
di: Cui, Hang, et al.
Pubblicazione: (2025)

Debugging the Debuggers: Failure-Anchored Structured Recovery for Software Engineering Agents
di: Zhao, Chenyu, et al.
Pubblicazione: (2026)

Can Language Models Go Beyond Coding? Assessing the Capability of Language Models to Build Real-World Systems
di: Zhao, Chenyu, et al.
Pubblicazione: (2025)

Agent System Operations: Categorization, Challenges, and Future Directions
di: Wang, Zexin, et al.
Pubblicazione: (2026)

GeoMag: A Vision-Language Model for Pixel-level Fine-Grained Remote Sensing Image Parsing
di: Ma, Xianzhi, et al.
Pubblicazione: (2025)

LEC-KG: An LLM-Embedding Collaborative Framework for Domain-Specific Knowledge Graph Construction -- A Case Study on SDGs
di: Zeng, Yikai, et al.
Pubblicazione: (2026)

KairosVL: Orchestrating Time Series and Semantics for Unified Reasoning
di: Si, Haotian, et al.
Pubblicazione: (2026)

Flow-of-Action: SOP Enhanced LLM-Based Multi-Agent System for Root Cause Analysis
di: Pei, Changhua, et al.
Pubblicazione: (2025)

ViTs: Teaching Machines to See Time Series Anomalies Like Human Experts
di: Wang, Zexin, et al.
Pubblicazione: (2025)

LogPurge: Log Data Purification for Anomaly Detection via Rule-Enhanced Filtering
di: Zhang, Shenglin, et al.
Pubblicazione: (2025)

Enhanced Fine-Tuning of Lightweight Domain-Specific Q&A Model Based on Large Language Models
di: Zhang, Shenglin, et al.
Pubblicazione: (2024)

ChatTS: Aligning Time Series with LLMs via Synthetic Data for Enhanced Understanding and Reasoning
di: Xie, Zhe, et al.
Pubblicazione: (2024)

Suite-IN++: A FlexiWear BodyNet Integrating Global and Local Motion Features from Apple Suite for Robust Inertial Navigation
di: Sun, Lan, et al.
Pubblicazione: (2025)

LogLM: From Task-based to Instruction-based Automated Log Analysis
di: Liu, Yilun, et al.
Pubblicazione: (2024)

Reductive Catalytic Fractionation of Lignocellulose Toward Propyl‐ or Propenyl‐Substituted Monomers and Mechanistic Understanding
di: Haiyun Huang, et al.
Pubblicazione: (2025)

A Benchmark for Language Models in Real-World System Building
di: Jin, Weilin, et al.
Pubblicazione: (2026)

Suite-IN: Aggregating Motion Features from Apple Suite for Robust Inertial Navigation
di: Sun, Lan, et al.
Pubblicazione: (2024)

Service Characteristic Evolution of 3D Four‐Directional Braided C/SiC Ceramic Matrix Composites Under Space Electron Radiation Erosion Environment
di: Pei Zhang, et al.
Pubblicazione: (2024)

SuiteEval: Simplifying Retrieval Benchmarks
di: Parry, Andrew, et al.
Pubblicazione: (2026)

FTibSuite: A Comprehensive Resource Suite for Tibetan Vision-Language Modeling
di: Xu, Guixian, et al.
Pubblicazione: (2026)

KFinEval-Pilot: A Comprehensive Benchmark Suite for Korean Financial Language Understanding
di: Hwang, Bokwang, et al.
Pubblicazione: (2025)

VideoEval: Comprehensive Benchmark Suite for Low-Cost Evaluation of Video Foundation Model
di: Li, Xinhao, et al.
Pubblicazione: (2024)

ViLLM-Eval: A Comprehensive Evaluation Suite for Vietnamese Large Language Models
di: Nguyen, Trong-Hieu, et al.
Pubblicazione: (2024)

A Test Suite for Efficient Robustness Evaluation of Face Recognition Systems
di: Zhang, Ruihan, et al.
Pubblicazione: (2025)

Adapting Large Language Models to Log Analysis with Interpretable Domain Knowledge
di: Ji, Yuhe, et al.
Pubblicazione: (2024)