Image de couverture de livre

Evaluating LLM-Generated Code: A Benchmark and Developer Study

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Szych, Joanna, Schwerk, Anne
Format:	Preprint
Publié:	2026
Sujets:	Software Engineering
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Benchmarking and Studying the LLM-based Code Review
par: Zeng, Zhengran, et autres
Publié: (2025)

A Survey of Code Review Benchmarks and Evaluation Practices in Pre-LLM and LLM Era
par: Khan, Taufiqul Islam, et autres
Publié: (2026)

CodeArena: A Collective Evaluation Platform for LLM Code Generation
par: Du, Mingzhe, et autres
Publié: (2025)

Tests as Prompt: A Test-Driven-Development Benchmark for LLM Code Generation
par: Cui, Yi
Publié: (2025)

Automatic Generation of Benchmarks and Reliable LLM Judgment for Code Tasks
par: Farchi, Eitan, et autres
Publié: (2024)

LLM-Based Test-Driven Interactive Code Generation: User Study and Empirical Evaluation
par: Fakhoury, Sarah, et autres
Publié: (2024)

DSL or Code? Evaluating the Quality of LLM-Generated Algebraic Specifications: A Case Study in Optimization at Kinaxis
par: Ayoughi, Negin, et autres
Publié: (2026)

COFFE: A Code Efficiency Benchmark for Code Generation
par: Peng, Yun, et autres
Publié: (2025)

Evaluating Efficiency and Novelty of LLM-Generated Code for Graph Analysis
par: Nia, Atieh Barati, et autres
Publié: (2025)

Comparing Developer and LLM Biases in Code Evaluation
par: Mittal, Aditya, et autres
Publié: (2026)

Continuous Benchmark Generation for Evaluating Enterprise-scale LLM Agents
par: Saxena, Divyanshu, et autres
Publié: (2025)

The Fault in our Stars: Quality Assessment of Code Generation Benchmarks
par: Siddiq, Mohammed Latif, et autres
Publié: (2024)

Human or LLM? A Comparative Study on Accessible Code Generation Capability
par: Suh, Hyunjae, et autres
Publié: (2025)

SolContractEval: A Benchmark for Evaluating Contract-Level Solidity Code Generation
par: Ye, Zhifan, et autres
Publié: (2025)

Development and Benchmarking of Multilingual Code Clone Detector
par: Zhu, Wenqing, et autres
Publié: (2024)

HumanEvalComm: Benchmarking the Communication Competence of Code Generation for LLMs and LLM Agent
par: Wu, Jie JW, et autres
Publié: (2024)

Beyond Code Similarity: Benchmarking the Plausibility, Efficiency, and Complexity of LLM-Generated Smart Contracts
par: Salzano, Francesco, et autres
Publié: (2025)

Assessing Small Language Models for Code Generation: An Empirical Study with Benchmarks
par: Hasan, Md Mahade, et autres
Publié: (2025)

ComplexCodeEval: A Benchmark for Evaluating Large Code Models on More Complex Code
par: Feng, Jia, et autres
Publié: (2024)

Re-Evaluating Code LLM Benchmarks Under Semantic Mutation
par: Pan, Zhiyuan, et autres
Publié: (2025)

Benchmarking and Studying the LLM-based Agent System in End-to-End Software Development
par: Zeng, Zhengran, et autres
Publié: (2025)

UA-Code-Bench: A Competitive Programming Benchmark for Evaluating LLM Code Generation in Ukrainian
par: Syromiatnikov, Mykyta, et autres
Publié: (2025)

A Differential Fuzzing-Based Evaluation of Functional Equivalence in LLM-Generated Code Refactorings
par: Dristi, Simantika Bhattacharjee, et autres
Publié: (2026)

LLMs in Web Development: Evaluating LLM-Generated PHP Code Unveiling Vulnerabilities and Limitations
par: Tóth, Rebeka, et autres
Publié: (2024)

Are They All Good? Evaluating the Quality of CoTs in LLM-based Code Generation
par: Zhang, Binquan, et autres
Publié: (2025)

SemGuard: Real-Time Semantic Evaluator for Correcting LLM-Generated Code
par: Wang, Qinglin, et autres
Publié: (2025)

Cross-Task Benchmarking and Evaluation of General-Purpose and Code-Specific Large Language Models
par: Das, Gunjan, et autres
Publié: (2025)

Benchmarks and Metrics for Evaluations of Code Generation: A Critical Review
par: Paul, Debalina Ghosh, et autres
Publié: (2024)

Inducing Vulnerable Code Generation in LLM Coding Assistants
par: Zeng, Binqi, et autres
Publié: (2025)

RealBench: A Repo-Level Code Generation Benchmark Aligned with Real-World Software Development Practices
par: Li, Jia, et autres
Publié: (2026)

HumanEvo: An Evolution-aware Benchmark for More Realistic Evaluation of Repository-level Code Generation
par: Zheng, Dewu, et autres
Publié: (2024)

On the Effectiveness of Training Data Optimization for LLM-based Code Generation: An Empirical Study
par: Kuang, Shiqi, et autres
Publié: (2025)

A Performance Study of LLM-Generated Code on Leetcode
par: Coignion, Tristan, et autres
Publié: (2024)

Copilot Arena: A Platform for Code LLM Evaluation in the Wild
par: Chi, Wayne, et autres
Publié: (2025)

EvoCodeBench: An Evolving Code Generation Benchmark with Domain-Specific Evaluations
par: Li, Jia, et autres
Publié: (2024)

Detect Repair Verify for Securing LLM Generated Code: A Multi-Language Empirical Study
par: Cheng, Cheng
Publié: (2026)

Beyond Code Generation: Assessing Code LLM Maturity with Postconditions
par: He, Fusen, et autres
Publié: (2024)

CodeScore: Evaluating Code Generation by Learning Code Execution
par: Dong, Yihong, et autres
Publié: (2023)

A Taxonomy of Inefficiencies in LLM-Generated Python Code
par: Abbassi, Altaf Allah, et autres
Publié: (2025)

ScenEval: A Benchmark for Scenario-Based Evaluation of Code Generation
par: Paul, Debalina Ghosh, et autres
Publié: (2024)