Engineering LLM Powered Multi-agent Framework for Autonomous CloudOps
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866910784192249856 |
|---|---|
| author | Parthasarathy, Kannan Vaidhyanathan, Karthik Dhar, Rudra Krishnamachari, Venkat Muhammed, Basil Kakran, Adyansh Akshathala, Sreemaee Arun, Shrikara Dubey, Sumant Veerubhotla, Mohan Karan, Amey |
| author_facet | Parthasarathy, Kannan Vaidhyanathan, Karthik Dhar, Rudra Krishnamachari, Venkat Muhammed, Basil Kakran, Adyansh Akshathala, Sreemaee Arun, Shrikara Dubey, Sumant Veerubhotla, Mohan Karan, Amey |
| contents | Cloud Operations (CloudOps) is a rapidly growing field focused on the automated management and optimization of cloud infrastructure which is essential for organizations navigating increasingly complex cloud environments. MontyCloud Inc. is one of the major companies in the CloudOps domain that leverages autonomous bots to manage cloud compliance, security, and continuous operations. To make the platform more accessible and effective to the customers, we leveraged the use of GenAI.
Developing a GenAI-based solution for autonomous CloudOps for the existing MontyCloud system presented us with various challenges such as i) diverse data sources; ii) orchestration of multiple processes; and iii) handling complex workflows to automate routine tasks. To this end, we developed MOYA, a multi-agent framework that leverages GenAI and balances autonomy with the necessary human control. This framework integrates various internal and external systems and is optimized for factors like task orchestration, security, and error mitigation while producing accurate, reliable, and relevant insights by utilizing Retrieval Augmented Generation (RAG). Evaluations of our multi-agent system with the help of practitioners as well as using automated checks demonstrate enhanced accuracy, responsiveness, and effectiveness over non-agentic approaches across complex workflows. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_08243 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Engineering LLM Powered Multi-agent Framework for Autonomous CloudOps Parthasarathy, Kannan Vaidhyanathan, Karthik Dhar, Rudra Krishnamachari, Venkat Muhammed, Basil Kakran, Adyansh Akshathala, Sreemaee Arun, Shrikara Dubey, Sumant Veerubhotla, Mohan Karan, Amey Software Engineering Artificial Intelligence Machine Learning Cloud Operations (CloudOps) is a rapidly growing field focused on the automated management and optimization of cloud infrastructure which is essential for organizations navigating increasingly complex cloud environments. MontyCloud Inc. is one of the major companies in the CloudOps domain that leverages autonomous bots to manage cloud compliance, security, and continuous operations. To make the platform more accessible and effective to the customers, we leveraged the use of GenAI. Developing a GenAI-based solution for autonomous CloudOps for the existing MontyCloud system presented us with various challenges such as i) diverse data sources; ii) orchestration of multiple processes; and iii) handling complex workflows to automate routine tasks. To this end, we developed MOYA, a multi-agent framework that leverages GenAI and balances autonomy with the necessary human control. This framework integrates various internal and external systems and is optimized for factors like task orchestration, security, and error mitigation while producing accurate, reliable, and relevant insights by utilizing Retrieval Augmented Generation (RAG). Evaluations of our multi-agent system with the help of practitioners as well as using automated checks demonstrate enhanced accuracy, responsiveness, and effectiveness over non-agentic approaches across complex workflows. |
| title | Engineering LLM Powered Multi-agent Framework for Autonomous CloudOps |
| topic | Software Engineering Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2501.08243 |