Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2504.04877 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915288184782848 |
|---|---|
| author | Beck, Viktor Landauer, Max Wurzenberger, Markus Skopik, Florian Rauber, Andreas |
| author_facet | Beck, Viktor Landauer, Max Wurzenberger, Markus Skopik, Florian Rauber, Andreas |
| contents | Log data provides crucial insights for tasks like monitoring, root cause analysis, and anomaly detection. Due to the vast volume of logs, automated log parsing is essential to transform semi-structured log messages into structured representations. Recent advances in large language models (LLMs) have introduced the new research field of LLM-based log parsing. Despite promising results, there is no structured overview of the approaches in this relatively new research field with the earliest advances published in late 2023. This work systematically reviews 29 LLM-based log parsing methods. We benchmark seven of them on public datasets and critically assess their comparability and the reproducibility of their reported results. Our findings summarize the advances of this new research field, with insights on how to report results, which data sets, metrics and which terminology to use, and which inconsistencies to avoid, with code and results made publicly available for transparency. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_04877 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | System Log Parsing with Large Language Models: A Review Beck, Viktor Landauer, Max Wurzenberger, Markus Skopik, Florian Rauber, Andreas Machine Learning I.2; I.5 Log data provides crucial insights for tasks like monitoring, root cause analysis, and anomaly detection. Due to the vast volume of logs, automated log parsing is essential to transform semi-structured log messages into structured representations. Recent advances in large language models (LLMs) have introduced the new research field of LLM-based log parsing. Despite promising results, there is no structured overview of the approaches in this relatively new research field with the earliest advances published in late 2023. This work systematically reviews 29 LLM-based log parsing methods. We benchmark seven of them on public datasets and critically assess their comparability and the reproducibility of their reported results. Our findings summarize the advances of this new research field, with insights on how to report results, which data sets, metrics and which terminology to use, and which inconsistencies to avoid, with code and results made publicly available for transparency. |
| title | System Log Parsing with Large Language Models: A Review |
| topic | Machine Learning I.2; I.5 |
| url | https://arxiv.org/abs/2504.04877 |