LogFormer: A Pre-train and Tuning Pipeline for Log Anomaly Detection
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866917563420639232 |
|---|---|
| author | Guo, Hongcheng Yang, Jian Liu, Jiaheng Bai, Jiaqi Wang, Boyang Li, Zhoujun Zheng, Tieqiao Zhang, Bo peng, Junran Tian, Qi |
| author_facet | Guo, Hongcheng Yang, Jian Liu, Jiaheng Bai, Jiaqi Wang, Boyang Li, Zhoujun Zheng, Tieqiao Zhang, Bo peng, Junran Tian, Qi |
| contents | Log anomaly detection is a key component in the field of artificial intelligence for IT operations (AIOps). Considering log data of variant domains, retraining the whole network for unknown domains is inefficient in real industrial scenarios. However, previous deep models merely focused on extracting the semantics of log sequences in the same domain, leading to poor generalization on multi-domain logs. To alleviate this issue, we propose a unified Transformer-based framework for Log anomaly detection (LogFormer) to improve the generalization ability across different domains, where we establish a two-stage process including the pre-training and adapter-based tuning stage. Specifically, our model is first pre-trained on the source domain to obtain shared semantic knowledge of log data. Then, we transfer such knowledge to the target domain via shared parameters. Besides, the Log-Attention module is proposed to supplement the information ignored by the log-paring. The proposed method is evaluated on three public and one real-world datasets. Experimental results on multiple benchmarks demonstrate the effectiveness of our LogFormer with fewer trainable parameters and lower training costs. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_04749 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | LogFormer: A Pre-train and Tuning Pipeline for Log Anomaly Detection Guo, Hongcheng Yang, Jian Liu, Jiaheng Bai, Jiaqi Wang, Boyang Li, Zhoujun Zheng, Tieqiao Zhang, Bo peng, Junran Tian, Qi Machine Learning Artificial Intelligence Software Engineering Log anomaly detection is a key component in the field of artificial intelligence for IT operations (AIOps). Considering log data of variant domains, retraining the whole network for unknown domains is inefficient in real industrial scenarios. However, previous deep models merely focused on extracting the semantics of log sequences in the same domain, leading to poor generalization on multi-domain logs. To alleviate this issue, we propose a unified Transformer-based framework for Log anomaly detection (LogFormer) to improve the generalization ability across different domains, where we establish a two-stage process including the pre-training and adapter-based tuning stage. Specifically, our model is first pre-trained on the source domain to obtain shared semantic knowledge of log data. Then, we transfer such knowledge to the target domain via shared parameters. Besides, the Log-Attention module is proposed to supplement the information ignored by the log-paring. The proposed method is evaluated on three public and one real-world datasets. Experimental results on multiple benchmarks demonstrate the effectiveness of our LogFormer with fewer trainable parameters and lower training costs. |
| title | LogFormer: A Pre-train and Tuning Pipeline for Log Anomaly Detection |
| topic | Machine Learning Artificial Intelligence Software Engineering |
| url | https://arxiv.org/abs/2401.04749 |