Automatic Database Configuration Debugging using Retrieval-Augmented Language Models

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Chen, Sibei, Fan, Ju, Wu, Bin, Tang, Nan, Deng, Chao, Wang, Pengyi, Li, Ye, Tan, Jian, Li, Feifei, Zhou, Jingren, Du, Xiaoyong
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912191602491392
author Chen, Sibei
Fan, Ju
Wu, Bin
Tang, Nan
Deng, Chao
Wang, Pengyi
Li, Ye
Tan, Jian
Li, Feifei
Zhou, Jingren
Du, Xiaoyong
author_facet Chen, Sibei
Fan, Ju
Wu, Bin
Tang, Nan
Deng, Chao
Wang, Pengyi
Li, Ye
Tan, Jian
Li, Feifei
Zhou, Jingren
Du, Xiaoyong
contents Database management system (DBMS) configuration debugging, e.g., diagnosing poorly configured DBMS knobs and generating troubleshooting recommendations, is crucial in optimizing DBMS performance. However, the configuration debugging process is tedious and, sometimes challenging, even for seasoned database administrators (DBAs) with sufficient experience in DBMS configurations and good understandings of the DBMS internals (e.g., MySQL or Oracle). To address this difficulty, we propose Andromeda, a framework that utilizes large language models (LLMs) to enable automatic DBMS configuration debugging. Andromeda serves as a natural surrogate of DBAs to answer a wide range of natural language (NL) questions on DBMS configuration issues, and to generate diagnostic suggestions to fix these issues. Nevertheless, directly prompting LLMs with these professional questions may result in overly generic and often unsatisfying answers. To this end, we propose a retrieval-augmented generation (RAG) strategy that effectively provides matched domain-specific contexts for the question from multiple sources. They come from related historical questions, troubleshooting manuals and DBMS telemetries, which significantly improve the performance of configuration debugging. To support the RAG strategy, we develop a document retrieval mechanism addressing heterogeneous documents and design an effective method for telemetry analysis. Extensive experiments on real-world DBMS configuration debugging datasets show that Andromeda significantly outperforms existing solutions.
format Preprint
id arxiv_https___arxiv_org_abs_2412_07548
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Automatic Database Configuration Debugging using Retrieval-Augmented Language Models
Chen, Sibei
Fan, Ju
Wu, Bin
Tang, Nan
Deng, Chao
Wang, Pengyi
Li, Ye
Tan, Jian
Li, Feifei
Zhou, Jingren
Du, Xiaoyong
Databases
Database management system (DBMS) configuration debugging, e.g., diagnosing poorly configured DBMS knobs and generating troubleshooting recommendations, is crucial in optimizing DBMS performance. However, the configuration debugging process is tedious and, sometimes challenging, even for seasoned database administrators (DBAs) with sufficient experience in DBMS configurations and good understandings of the DBMS internals (e.g., MySQL or Oracle). To address this difficulty, we propose Andromeda, a framework that utilizes large language models (LLMs) to enable automatic DBMS configuration debugging. Andromeda serves as a natural surrogate of DBAs to answer a wide range of natural language (NL) questions on DBMS configuration issues, and to generate diagnostic suggestions to fix these issues. Nevertheless, directly prompting LLMs with these professional questions may result in overly generic and often unsatisfying answers. To this end, we propose a retrieval-augmented generation (RAG) strategy that effectively provides matched domain-specific contexts for the question from multiple sources. They come from related historical questions, troubleshooting manuals and DBMS telemetries, which significantly improve the performance of configuration debugging. To support the RAG strategy, we develop a document retrieval mechanism addressing heterogeneous documents and design an effective method for telemetry analysis. Extensive experiments on real-world DBMS configuration debugging datasets show that Andromeda significantly outperforms existing solutions.
title Automatic Database Configuration Debugging using Retrieval-Augmented Language Models
topic Databases
url https://arxiv.org/abs/2412.07548