Imagen de Portada

Software Development Life Cycle Perspective: A Survey of Benchmarks for Code Large Language Models and Agents

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Wang, Kaixin, Li, Tianlin, Zhang, Xiaoyu, Wang, Chong, Sun, Weisong, Liu, Yang, Liu, Aishan, Liu, Xianglong, Shen, Chao, Shi, Bin
Formato:	Preprint
Publicado:	2025
Materias:	Software Engineering Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

CodeChemist: Functional Knowledge Transfer for Low-Resource Code Generation via Test-Time Scaling
por: Wang, Kaixin, et al.
Publicado: (2025)

Latent Imitator: Generating Natural Individual Discriminatory Instances for Black-Box Fairness Testing
por: Xiao, Yisong, et al.
Publicado: (2023)

Knowledge-Guided Multi-Agent Framework for Application-Level Software Code Generation
por: Xiong, Qian, et al.
Publicado: (2025)

From Context to Intent: Reasoning-Guided Function-Level Code Completion
por: Li, Yanzhou, et al.
Publicado: (2025)

Teaching Code LLMs to Use Autocompletion Tools in Repository-Level Code Generation
por: Wang, Chong, et al.
Publicado: (2024)

Exploring the Power of Diffusion Large Language Models for Software Engineering: An Empirical Investigation
por: Zhang, Jingyao, et al.
Publicado: (2025)

Fairness Mediator: Neutralize Stereotype Associations to Mitigate Bias in Large Language Models
por: Xiao, Yisong, et al.
Publicado: (2025)

Benchmarking and Revisiting Code Generation Assessment: A Mutation-Based Approach
por: Wang, Longtian, et al.
Publicado: (2025)

Large Language Model-Based Agents for Software Engineering: A Survey
por: Liu, Junwei, et al.
Publicado: (2024)

BDefects4NN: A Backdoor Defect Database for Controlled Localization Studies in Neural Networks
por: Xiao, Yisong, et al.
Publicado: (2024)

Ensemble-Based Uncertainty Estimation for Code Correctness Estimation
por: Wei, Yunxiang, et al.
Publicado: (2026)

Promptware Engineering: Software Engineering for Prompt-Enabled Systems
por: Chen, Zhenpeng, et al.
Publicado: (2025)

Investigating Training Data Detection in AI Coders
por: Li, Tianlin, et al.
Publicado: (2025)

Towards Trustworthy LLMs for Code: A Data-Centric Synergistic Auditing Framework
por: Wang, Chong, et al.
Publicado: (2024)

Knowledge-Based Multi-Agent Framework for Automated Software Architecture Design
por: Zhang, Yiran, et al.
Publicado: (2025)

SWE-Cycle: Benchmarking Code Agents across the Complete Issue Resolution Cycle
por: Guan, Hao, et al.
Publicado: (2026)

Code Digital Twin: Empowering LLMs with Tacit Knowledge for Complex Software Development
por: Peng, Xin, et al.
Publicado: (2025)

Requirements Development and Formalization for Reliable Code Generation: A Multi-Agent Vision
por: Lu, Xu, et al.
Publicado: (2025)

REprompt: Prompt Generation for Intelligent Software Development Guided by Requirements Engineering
por: Shi, Junjie, et al.
Publicado: (2026)

Rethinking Technology Stack Selection with AI Coding Proficiency
por: Zhang, Xiaoyu, et al.
Publicado: (2025)

Code Digital Twin: A Knowledge Infrastructure for AI-Assisted Complex Software Development
por: Peng, Xin, et al.
Publicado: (2025)

Code2Bench: Scaling Source and Rigor for Dynamic Benchmark Construction
por: Zhang, Zhe, et al.
Publicado: (2025)

ComplexCodeEval: A Benchmark for Evaluating Large Code Models on More Complex Code
por: Feng, Jia, et al.
Publicado: (2024)

An Empirical Study of Bugs in Modern LLM Agent Frameworks
por: Zhu, Xinxue, et al.
Publicado: (2026)

A Survey on Large Language Models for Software Engineering
por: Zhang, Quanjun, et al.
Publicado: (2023)

Software Testing with Large Language Models: Survey, Landscape, and Vision
por: Wang, Junjie, et al.
Publicado: (2023)

QuanBench: Benchmarking Quantum Code Generation with Large Language Models
por: Guo, Xiaoyu, et al.
Publicado: (2025)

Unveiling the Role of ChatGPT in Software Development: Insights from Developer-ChatGPT Interactions on GitHub
por: Li, Ruiyin, et al.
Publicado: (2025)

FeedbackEval: A Benchmark for Evaluating Large Language Models in Feedback-Driven Code Repair Tasks
por: Dai, Dekun, et al.
Publicado: (2025)

Peer Code Review in Research Software Development: The Research Software Engineer Perspective
por: Malik, Md Ariful Islam, et al.
Publicado: (2025)

Understanding the Effectiveness of Coverage Criteria for Large Language Models: A Special Angle from Jailbreak Attacks
por: Zhou, Shide, et al.
Publicado: (2024)

TIGER: A Generating-Then-Ranking Framework for Practical Python Type Inference
por: Wang, Chong, et al.
Publicado: (2024)

A Hierarchical and Evolvable Benchmark for Fine-Grained Code Instruction Following with Multi-Turn Feedback
por: Duan, Guoliang, et al.
Publicado: (2025)

RealBench: A Repo-Level Code Generation Benchmark Aligned with Real-World Software Development Practices
por: Li, Jia, et al.
Publicado: (2026)

CodePori: Large-Scale System for Autonomous Software Development Using Multi-Agent Technology
por: Rasheed, Zeeshan, et al.
Publicado: (2024)

From Code Foundation Models to Agents and Applications: A Comprehensive Survey and Practical Guide to Code Intelligence
por: Yang, Jian, et al.
Publicado: (2025)

Unifying the Perspectives of NLP and Software Engineering: A Survey on Language Models for Code
por: Zhang, Ziyin, et al.
Publicado: (2023)

AI IDEs or Autonomous Agents? Measuring the Impact of Coding Agents on Software Development
por: Agarwal, Shyam, et al.
Publicado: (2026)

CodeCoR: An LLM-Based Self-Reflective Multi-Agent Framework for Code Generation
por: Pan, Ruwei, et al.
Publicado: (2025)

Empirical Analysis of Vulnerabilities Life Cycle in Golang Ecosystem
por: Hu, Jinchang, et al.
Publicado: (2023)