Imagen de Portada

AgentEval: DAG-Structured Step-Level Evaluation for Agentic Workflows with Error Propagation Tracking

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Guo, Dongxin, Wu, Jikun, Yiu, Siu Ming
Formato:	Preprint
Publicado:	2026
Materias:	Software Engineering Computation and Language I.2.7; D.2.5; D.2.4
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Towards a Probabilistic Framework for Analyzing and Improving LLM-Enabled Software
por: Baldonado, Juan Manuel, et al.
Publicado: (2025)

Automated structural testing of LLM-based agents: methods, framework, and case studies
por: Kohl, Jens, et al.
Publicado: (2026)

AgentModernize: Preserving Business Logic in Legacy Modernization with Multi-Agent LLMs and Behavioral Specification Graphs
por: Ahmed, Sheikh Nazib, et al.
Publicado: (2026)

Reducing Maintenance Burden in Behaviour-Driven Development: A Paraphrase-Robust Duplicate-Step Detector with a 1.1M-Step Open Benchmark
por: Mughal, Ali Hassaan, et al.
Publicado: (2026)

Addressing Data Leakage in HumanEval Using Combinatorial Test Design
por: Bradbury, Jeremy S., et al.
Publicado: (2024)

Towards Observation Lakehouses: Living, Interactive Archives of Software Behavior
por: Kessel, Marcus
Publicado: (2025)

Towards Single-System Illusion in Software-Defined Vehicles -- Automated, AI-Powered Workflow
por: Lebioda, Krzysztof, et al.
Publicado: (2024)

Secure coding for web applications: Frameworks, challenges, and the role of LLMs
por: Kiashemshaki, Kiana, et al.
Publicado: (2025)

ComplianceNLP: Knowledge-Graph-Augmented RAG for Multi-Framework Regulatory Gap Detection
por: Guo, Dongxin, et al.
Publicado: (2026)

RelRepair: Enhancing Automated Program Repair by Retrieving Relevant Code
por: Liu, Shunyu, et al.
Publicado: (2025)

When Retrieval Hurts Code Completion: A Diagnostic Study of Stale Repository Context
por: Weng, Haojun, et al.
Publicado: (2026)

Toward Architecture-Aware Evaluation Metrics for LLM Agents
por: Souza, Débora, et al.
Publicado: (2026)

LLM-Assisted Translation of Legacy FORTRAN Codes to C++: A Cross-Platform Study
por: Ranasinghe, Nishath Rajiv, et al.
Publicado: (2025)

Test-driven Software Experimentation with LASSO: an LLM Prompt Benchmarking Example
por: Kessel, Marcus
Publicado: (2024)

N-Version Assessment and Enhancement of Generative AI
por: Kessel, Marcus, et al.
Publicado: (2024)

Morescient GAI for Software Engineering (Extended Version)
por: Kessel, Marcus, et al.
Publicado: (2024)

FORGE: An LLM-driven Framework for Large-Scale Smart Contract Vulnerability Dataset Construction
por: Chen, Jiachi, et al.
Publicado: (2025)

LLMs as Idiomatic Decompilers: Recovering High-Level Code from x86-64 Assembly for Dart
por: Abualazm, Raafat, et al.
Publicado: (2026)

AuditRepairBench: A Paired-Execution Trace Corpus for Evaluator-Channel Ranking Instability in Agent Repair
por: Hu, Yuelin, et al.
Publicado: (2026)

A History Equivalence Algorithm for Dynamic Process Migration
por: Bakshi, Gargi, et al.
Publicado: (2024)

SmellBench: Evaluating LLM Agents on Architectural Code Smell Repair
por: Dinu, Ion George, et al.
Publicado: (2026)

GALA: Multimodal Graph Alignment for Bug Localization in Automated Program Repair
por: Liu, Zhuoyao, et al.
Publicado: (2026)

Rango: Adaptive Retrieval-Augmented Proving for Automated Software Verification
por: Thompson, Kyle, et al.
Publicado: (2024)

From Untestable to Testable: Metamorphic Testing in the Age of LLMs
por: Terragni, Valerio
Publicado: (2026)

Assessing Data Augmentation-Induced Bias in Training and Testing of Machine Learning Models
por: More, Riddhi, et al.
Publicado: (2025)

An Analysis of LLM Fine-Tuning and Few-Shot Learning for Flaky Test Detection and Classification
por: More, Riddhi, et al.
Publicado: (2025)

A Systematic Approach for Assessing Large Language Models' Test Case Generation Capability
por: Chang, Hung-Fu, et al.
Publicado: (2025)

Synergy of Large Language Model and Model Driven Engineering for Automated Development of Centralized Vehicular Systems
por: Petrovic, Nenad, et al.
Publicado: (2024)

CIFE: Code Instruction-Following Evaluation
por: Gunnu, Sravani, et al.
Publicado: (2025)

Automated Bug Triaging using Instruction-Tuned Large Language Models
por: Kiashemshaki, Kiana, et al.
Publicado: (2025)

Feedback-Normalized Developer Memory for Reinforcement-Learning Coding Agents: A Safety-Gated MCP Architecture
por: Iscan, Mehmet
Publicado: (2026)

Generative transformations and patterns in LLM-native approaches for software verification and falsification
por: Braberman, Víctor A., et al.
Publicado: (2024)

Beyond Greenfield: The D3 Framework for AI-Driven Productivity in Brownfield Engineering
por: Sharma, Krishna Kumaar
Publicado: (2025)

The Kieker Observability Framework Version 2
por: Yang, Shinhyung, et al.
Publicado: (2025)

From Scientific Texts to Verifiable Code: Automating the Process with Transformers
por: Wang, Changjie, et al.
Publicado: (2025)

Analyzing the Adoption of Database Management Systems Throughout the History of Open Source Projects
por: Paiva, Camila A., et al.
Publicado: (2026)

Site Reliability Engineering (SRE) and Observations on SRE Process to Make Tasks Easier
por: Puli, Balaram
Publicado: (2025)

Who Writes the Docs in SE 3.0? Agent vs. Human Documentation Pull Requests
por: Yamasaki, Kazuma, et al.
Publicado: (2026)

Monitoring Agentic Systems Before They're Reliable
por: Boston, Marisa Ferrara, et al.
Publicado: (2026)

The Specification as Quality Gate: Three Hypotheses on AI-Assisted Code Review
por: Zietsman, Christo
Publicado: (2026)