Cover Image

Defects4Log: Benchmarking LLMs for Logging Code Defect Detection and Reasoning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wang, Xin, Li, Zhenhao, Ding, Zishuo
Format:	Preprint
Published:	2025
Subjects:	Software Engineering
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Towards Secure Logging: Characterizing and Benchmarking Logging Code Security Issues with LLMs
by: Yuan, He Yang, et al.
Published: (2026)

Logging Like Humans for LLMs: Rethinking Logging via Execution and Runtime Feedback
by: Wang, Xin, et al.
Published: (2026)

LogUpdater: Automated Detection and Repair of Specific Defects in Logging Statements
by: Zhong, Renyi, et al.
Published: (2024)

LLM4Perf: Large Language Models Are Effective Samplers for Multi-Objective Performance Modeling
by: Wang, Xin, et al.
Published: (2025)

Log Summarisation for Defect Evolution Analysis
by: Dolga, Rares, et al.
Published: (2024)

Studying and Benchmarking Large Language Models For Log Level Suggestion
by: Heng, Yi Wen, et al.
Published: (2024)

LogICL: Distilling LLM Reasoning to Bridge the Semantic Gap in Cross-Domain Log Anomaly Detection
by: Ye, Jingwei, et al.
Published: (2025)

LogReasoner: Empowering LLMs with Expert-like Coarse-to-Fine Reasoning for Automated Log Analysis
by: Ma, Lipeng, et al.
Published: (2025)

A Comparative Study of Semantic Log Representations for Software Log-based Anomaly Detection
by: Wang, Yuqing, et al.
Published: (2026)

From Feedback to Failure: Automated Android Performance Issue Reproduction
by: Li, Zhengquan, et al.
Published: (2025)

BioDefect: The First Dataset for Defect Detection in Bioinformatics Software
by: Xu, Tianxiang, et al.
Published: (2026)

R-Log: Incentivizing Log Analysis Capability in LLMs via Reasoning-based Reinforcement Learning
by: Liu, Yilun, et al.
Published: (2025)

On the Effectiveness of Log Representation for Log-based Anomaly Detection
by: Wu, Xingfang, et al.
Published: (2023)

ZeroLog: Zero-Label Generalizable Cross-System Log-based Anomaly Detection
by: Zhao, Xinlong, et al.
Published: (2025)

AnomalyGen: Enhancing Log-Based Anomaly Detection with Code-Guided Data Augmentation
by: Li, Xinyu, et al.
Published: (2026)

Practitioners' Expectations on Log Anomaly Detection
by: Ma, Xiaoxue, et al.
Published: (2024)

LogPTR: Variable-Aware Log Parsing with Pointer Network
by: Wu, Yifan, et al.
Published: (2024)

Empirical Characterization of Logging Smells in Machine Learning Code
by: Foalem, Patrick Loic, et al.
Published: (2026)

Empirical Characterization of Logging Smells in Machine Learning Code
by: Foalem, Patrick Loic, et al.
Published: (2026)

Single-Language Evidence Is Insufficient for Automated Logging: A Multilingual Benchmark and Empirical Study with LLMs
by: Zhong, Renyi, et al.
Published: (2026)

AL-Bench: A Benchmark for Automatic Logging
by: Tan, Boyin, et al.
Published: (2025)

LogFold: Compressing Logs with Structured Tokens and Hybrid Encoding
by: Shan, Shiwen, et al.
Published: (2026)

CelerLog: Fast Log Parsing via Dynamic Routing
by: Shan, Shiwen, et al.
Published: (2026)

LLM-SrcLog: Towards Proactive and Unified Log Template Extraction via Large Language Models
by: Sun, Jiaqi, et al.
Published: (2025)

LogELECTRA: Self-supervised Anomaly Detection for Unstructured Logs
by: Yamanaka, Yuuki, et al.
Published: (2024)

AndroLog: Android Instrumentation and Code Coverage Analysis
by: Samhi, Jordan, et al.
Published: (2024)

LogDB: Multivariate Log-based Failure Diagnosis for Distributed Databases (Extended from MultiLog)
by: Zhang, Lingzhe, et al.
Published: (2025)

Stronger, Cheaper and Demonstration-Free Log Parsing with LLMs
by: Xiao, Yi, et al.
Published: (2024)

Exploring the Effectiveness of LLMs in Automated Logging Generation: An Empirical Study
by: Li, Yichen, et al.
Published: (2023)

LILAC: Log Parsing using LLMs with Adaptive Parsing Cache
by: Jiang, Zhihan, et al.
Published: (2023)

Scalable Defect Detection via Traversal on Code Graph
by: Liu, Zhengyao, et al.
Published: (2024)

Multivariate Log-based Anomaly Detection for Distributed Database
by: Zhang, Lingzhe, et al.
Published: (2024)

Do AI Coding Agents Log Like Humans? An Empirical Study
by: Ouatiti, Youssef Esseddiq, et al.
Published: (2026)

LogDx-CI: Benchmarking Log Reduction Tools for LLM Root-Cause Diagnosis
by: Qin, Bowen
Published: (2026)

LogLSHD: Fast Log Parsing with Locality-Sensitive Hashing and Dynamic Time Warping
by: Huang, Shu-Wei, et al.
Published: (2025)

CodeAD: Synthesize Code of Rules for Log-based Anomaly Detection with LLMs
by: Huang, Junjie, et al.
Published: (2025)

LogSD: Detecting Anomalies from System Logs through Self-supervised Learning and Frequency-based Masking
by: Xie, Yongzheng, et al.
Published: (2024)

LogPurge: Log Data Purification for Anomaly Detection via Rule-Enhanced Filtering
by: Zhang, Shenglin, et al.
Published: (2025)

LogPrism: Unifying Structure and Variable Encoding for Effective Log Compression
by: Liu, Yang, et al.
Published: (2026)

Is Your Private Information Logged? An Empirical Study on Android App Logs
by: Chen, Zhiyuan, et al.
Published: (2026)