Cover Image

PM-LLM-Benchmark: Evaluating Large Language Models on Process Mining Tasks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Berti, Alessandro, Kourani, Humam, van der Aalst, Wil M. P.
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Databases
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

ProMoAI: Process Modeling with Generative AI
by: Kourani, Humam, et al.
Published: (2024)

Evaluating Large Language Models on Business Process Modeling: Framework, Benchmark, and Self-Improvement Analysis
by: Kourani, Humam, et al.
Published: (2024)

Process Modeling With Large Language Models
by: Kourani, Humam, et al.
Published: (2024)

Evaluating Large Language Models in Process Mining: Capabilities, Benchmarks, and Evaluation Strategies
by: Berti, Alessandro, et al.
Published: (2024)

Revealing Inherent Concurrency in Event Data: A Partial Order Approach to Process Discovery
by: Kourani, Humam, et al.
Published: (2025)

Bridging Domain Knowledge and Process Discovery Using Large Language Models
by: Norouzifar, Ali, et al.
Published: (2024)

Hierarchical Decomposition of Separable Workflow-Nets
by: Kourani, Humam, et al.
Published: (2026)

Leveraging Large Language Models for Enhanced Process Model Comprehension
by: Kourani, Humam, et al.
Published: (2024)

Knowledge-Driven Hallucination in Large Language Models: An Empirical Study on Process Modeling
by: Kourani, Humam, et al.
Published: (2025)

CPN-Py: A Python-Based Tool for Modeling and Analyzing Colored Petri Nets
by: Berti, Alessandro, et al.
Published: (2025)

Applying Process Mining on Scientific Workflows: a Case Study on High Performance Computing Data
by: Sadeghibogar, Zahra, et al.
Published: (2023)

PMAx: An Agentic Framework for AI-Driven Process Mining
by: Antonov, Anton, et al.
Published: (2026)

Translating Workflow Nets into the Partially Ordered Workflow Language
by: Kourani, Humam, et al.
Published: (2025)

Integrating Domain Knowledge into Process Discovery Using Large Language Models
by: Norouzifar, Ali, et al.
Published: (2025)

Unlocking Non-Block-Structured Decisions: Inductive Mining with Choice Graphs
by: Kourani, Humam, et al.
Published: (2025)

High-Level Event Mining: Overview and Future Work
by: Bakullari, Bianka, et al.
Published: (2024)

Evaluation of Study Plans using Partial Orders
by: Rennert, Christian, et al.
Published: (2024)

Challenges of Anomaly Detection in the Object-Centric Setting: Dimensions and the Role of Domain Knowledge
by: Berti, Alessandro, et al.
Published: (2024)

OCPQ: Object-Centric Process Querying & Constraints
by: Küsters, Aaron, et al.
Published: (2025)

Discovering Process Models With Long-Term Dependencies While Providing Guarantees and Filtering Infrequent Behavior Patterns
by: Mannel, Lisa Luise, et al.
Published: (2022)

Object-Centric Local Process Models
by: Peeva, Viki, et al.
Published: (2024)

Tailoring Machine Learning for Process Mining
by: Ceravolo, Paolo, et al.
Published: (2023)

PM4Py.LLM: a Comprehensive Module for Implementing PM on LLMs
by: Berti, Alessandro
Published: (2024)

Imposing Rules in Process Discovery: an Inductive Mining Approach
by: Norouzifar, Ali, et al.
Published: (2024)

Computing Alignments for Partially-ordered Traces Through Petri Net Unfoldings
by: Siddiqui, Ariba, et al.
Published: (2025)

On the Potential of Large Language Models to Solve Semantics-Aware Process Mining Tasks
by: Rebmann, Adrian, et al.
Published: (2025)

MEBench: Benchmarking Large Language Models for Cross-Document Multi-Entity Question Answering
by: Lin, Teng, et al.
Published: (2025)

Skill Learning Using Process Mining for Large Language Model Plan Generation
by: Redis, Andrei Cosmin, et al.
Published: (2024)

RelationalFactQA: A Benchmark for Evaluating Tabular Fact Retrieval from Large Language Models
by: Satriani, Dario, et al.
Published: (2025)

eST$^2$ Miner -- Process Discovery Based on Firing Partial Orders
by: Folz-Weinstein, Sabine, et al.
Published: (2025)

No AI Without PI! Object-Centric Process Mining as the Enabler for Generative, Predictive, and Prescriptive Artificial Intelligence
by: van der Aalst, Wil M. P.
Published: (2025)

Beyond Control-Flow: Integrating the Resource Perspective into Multi-Collaborative Process Modeling from Text
by: Antonov, Anton, et al.
Published: (2026)

RADAR: Benchmarking Language Models on Imperfect Tabular Data
by: Gu, Ken, et al.
Published: (2025)

MatTools: Benchmarking Large Language Models for Materials Science Tools
by: Liu, Siyu, et al.
Published: (2025)

LLM-R2: A Large Language Model Enhanced Rule-based Rewrite System for Boosting Query Efficiency
by: Li, Zhaodonghui, et al.
Published: (2024)

People Make Better Edits: Measuring the Efficacy of LLM-Generated Counterfactually Augmented Data for Harmful Language Detection
by: Sen, Indira, et al.
Published: (2023)

Relational Database Augmented Large Language Model
by: Qin, Zongyue, et al.
Published: (2024)

Schema Lineage Extraction at Scale: Multilingual Pipelines, Composite Evaluation, and Language-Model Benchmarks
by: Yin, Jiaqi, et al.
Published: (2025)

Advancing Spatial Reasoning in Large Language Models: An In-Depth Evaluation and Enhancement Using the StepGame Benchmark
by: Li, Fangjun, et al.
Published: (2024)

Confidence Estimation for Text-to-SQL in Large Language Models
by: Maleki, Sepideh Entezari, et al.
Published: (2025)