OWL: A Large Language Model for IT Operations

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Guo, Hongcheng, Yang, Jian, Liu, Jiaheng, Yang, Liqun, Chai, Linzheng, Bai, Jiaqi, Peng, Junran, Hu, Xiaorong, Chen, Chao, Zhang, Dongfeng, Shi, Xu, Zheng, Tieqiao, Zheng, Liangfan, Zhang, Bo, Xu, Ke, Li, Zhoujun
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917787782348800
author Guo, Hongcheng
Yang, Jian
Liu, Jiaheng
Yang, Liqun
Chai, Linzheng
Bai, Jiaqi
Peng, Junran
Hu, Xiaorong
Chen, Chao
Zhang, Dongfeng
Shi, Xu
Zheng, Tieqiao
Zheng, Liangfan
Zhang, Bo
Xu, Ke
Li, Zhoujun
author_facet Guo, Hongcheng
Yang, Jian
Liu, Jiaheng
Yang, Liqun
Chai, Linzheng
Bai, Jiaqi
Peng, Junran
Hu, Xiaorong
Chen, Chao
Zhang, Dongfeng
Shi, Xu
Zheng, Tieqiao
Zheng, Liangfan
Zhang, Bo
Xu, Ke
Li, Zhoujun
contents With the rapid development of IT operations, it has become increasingly crucial to efficiently manage and analyze large volumes of data for practical applications. The techniques of Natural Language Processing (NLP) have shown remarkable capabilities for various tasks, including named entity recognition, machine translation and dialogue systems. Recently, Large Language Models (LLMs) have achieved significant improvements across various NLP downstream tasks. However, there is a lack of specialized LLMs for IT operations. In this paper, we introduce the OWL, a large language model trained on our collected OWL-Instruct dataset with a wide range of IT-related information, where the mixture-of-adapter strategy is proposed to improve the parameter-efficient tuning across different domains or tasks. Furthermore, we evaluate the performance of our OWL on the OWL-Bench established by us and open IT-related benchmarks. OWL demonstrates superior performance results on IT tasks, which outperforms existing models by significant margins. Moreover, we hope that the findings of our work will provide more insights to revolutionize the techniques of IT operations with specialized LLMs.
format Preprint
id arxiv_https___arxiv_org_abs_2309_09298
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle OWL: A Large Language Model for IT Operations
Guo, Hongcheng
Yang, Jian
Liu, Jiaheng
Yang, Liqun
Chai, Linzheng
Bai, Jiaqi
Peng, Junran
Hu, Xiaorong
Chen, Chao
Zhang, Dongfeng
Shi, Xu
Zheng, Tieqiao
Zheng, Liangfan
Zhang, Bo
Xu, Ke
Li, Zhoujun
Computation and Language
With the rapid development of IT operations, it has become increasingly crucial to efficiently manage and analyze large volumes of data for practical applications. The techniques of Natural Language Processing (NLP) have shown remarkable capabilities for various tasks, including named entity recognition, machine translation and dialogue systems. Recently, Large Language Models (LLMs) have achieved significant improvements across various NLP downstream tasks. However, there is a lack of specialized LLMs for IT operations. In this paper, we introduce the OWL, a large language model trained on our collected OWL-Instruct dataset with a wide range of IT-related information, where the mixture-of-adapter strategy is proposed to improve the parameter-efficient tuning across different domains or tasks. Furthermore, we evaluate the performance of our OWL on the OWL-Bench established by us and open IT-related benchmarks. OWL demonstrates superior performance results on IT tasks, which outperforms existing models by significant margins. Moreover, we hope that the findings of our work will provide more insights to revolutionize the techniques of IT operations with specialized LLMs.
title OWL: A Large Language Model for IT Operations
topic Computation and Language
url https://arxiv.org/abs/2309.09298