LogPTR: Variable-Aware Log Parsing with Pointer Network
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866908882330189824 |
|---|---|
| author | Wu, Yifan Chai, Bingxu Yu, Siyu Li, Ying He, Pinjia Jiang, Wei Li, Jianguo |
| author_facet | Wu, Yifan Chai, Bingxu Yu, Siyu Li, Ying He, Pinjia Jiang, Wei Li, Jianguo |
| contents | Due to the sheer size of software logs, developers rely on automated log analysis. Log parsing, which parses semi-structured logs into a structured format, is a prerequisite of automated log analysis. However, existing log parsers are unsatisfactory when applied in practice because they 1) ignore categories of variables, and 2) need labor-intensive model tuning. To address these limitations, we propose LogPTR, a variable-aware log parser that can extract the static and dynamic parts in logs, and further identify categories of variables. The key of LogPTR is formulating log parsing as a text summarization problem and using a pointer mechanism to copy words from the log message and label tokens indicating categories of variables. The experimental results on widely-used benchmark datasets show that LogPTR outperforms state-of-the-art log parsers on both general log parsing that extracts log templates and variable-aware log parsing that further identifies categories of variables. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_05986 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | LogPTR: Variable-Aware Log Parsing with Pointer Network Wu, Yifan Chai, Bingxu Yu, Siyu Li, Ying He, Pinjia Jiang, Wei Li, Jianguo Software Engineering Due to the sheer size of software logs, developers rely on automated log analysis. Log parsing, which parses semi-structured logs into a structured format, is a prerequisite of automated log analysis. However, existing log parsers are unsatisfactory when applied in practice because they 1) ignore categories of variables, and 2) need labor-intensive model tuning. To address these limitations, we propose LogPTR, a variable-aware log parser that can extract the static and dynamic parts in logs, and further identify categories of variables. The key of LogPTR is formulating log parsing as a text summarization problem and using a pointer mechanism to copy words from the log message and label tokens indicating categories of variables. The experimental results on widely-used benchmark datasets show that LogPTR outperforms state-of-the-art log parsers on both general log parsing that extracts log templates and variable-aware log parsing that further identifies categories of variables. |
| title | LogPTR: Variable-Aware Log Parsing with Pointer Network |
| topic | Software Engineering |
| url | https://arxiv.org/abs/2401.05986 |