Copertina

Codev-Bench: How Do LLMs Understand Developer-Centric Code Completion?

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Pan, Zhenyu, Cao, Rongyu, Cao, Yongchang, Ma, Yingwei, Li, Binhua, Huang, Fei, Liu, Han, Li, Yongbin
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Software Engineering Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Do Code LLMs Understand Design Patterns?
di: Pan, Zhenyu, et al.
Pubblicazione: (2025)

Lingma SWE-GPT: An Open Development-Process-Centric Language Model for Automated Software Improvement
di: Ma, Yingwei, et al.
Pubblicazione: (2024)

LLMs as Continuous Learners: Improving the Reproduction of Defective Code in Software Issues
di: Lin, Yalan, et al.
Pubblicazione: (2024)

Alibaba LingmaAgent: Improving Automated Issue Resolution via Comprehensive Repository Exploration
di: Ma, Yingwei, et al.
Pubblicazione: (2024)

Thinking Longer, Not Larger: Enhancing Software Engineering Agents via Scaling Test-Time Compute
di: Ma, Yingwei, et al.
Pubblicazione: (2025)

Large Language Model Unlearning for Source Code
di: Jiang, Xue, et al.
Pubblicazione: (2025)

To Diff or Not to Diff? Structure-Aware and Adaptive Output Formats for Efficient LLM-based Code Editing
di: Cheng, Wei, et al.
Pubblicazione: (2026)

EvoCodeBench: An Evolving Code Generation Benchmark with Domain-Specific Evaluations
di: Li, Jia, et al.
Pubblicazione: (2024)

CodeRL+: Improving Code Generation via Reinforcement with Execution Semantics Alignment
di: Jiang, Xue, et al.
Pubblicazione: (2025)

InspectCoder: Dynamic Analysis-Enabled Self Repair through interactive LLM-Debugger Collaboration
di: Wang, Yunkun, et al.
Pubblicazione: (2025)

ExploraCoder: Advancing code generation for multiple unseen APIs via planning and chained exploration
di: Wang, Yunkun, et al.
Pubblicazione: (2024)

Saber: An Efficient Sampling with Adaptive Acceleration and Backtracking Enhanced Remasking for Diffusion Language Model
di: Dong, Yihong, et al.
Pubblicazione: (2025)

Empowering RepoQA-Agent based on Reinforcement Learning Driven by Monte-carlo Tree Search
di: Li, Guochang, et al.
Pubblicazione: (2025)

JMigBench: A Benchmark for Evaluating LLMs on Source Code Migration (Java 8 to Java 11)
di: Amin, Nishil, et al.
Pubblicazione: (2026)

Think Anywhere in Code Generation
di: Jiang, Xue, et al.
Pubblicazione: (2026)

AOCI: Symbolic-Semantic Indexing for Practical Repository-Scale Code Understanding with LLMs
di: Liu, Jinshi, et al.
Pubblicazione: (2026)

SynthCoder: A Synthetical Strategy to Tune LLMs for Code Completion
di: Yu, Dongjun, et al.
Pubblicazione: (2025)

Towards Trustworthy LLMs for Code: A Data-Centric Synergistic Auditing Framework
di: Wang, Chong, et al.
Pubblicazione: (2024)

CriterAlign: Criterion-Centric Rationale Alignment for Code Preference Judging
di: Li, Zhenyu, et al.
Pubblicazione: (2026)

SWE-Bench+: Enhanced Coding Benchmark for LLMs
di: Aleithan, Reem, et al.
Pubblicazione: (2024)

Do Code LLMs Do Static Analysis?
di: Su, Chia-Yi, et al.
Pubblicazione: (2025)

How Do Developers Use Code Suggestions in Pull Request Reviews?
di: Bouraffa, Abir, et al.
Pubblicazione: (2025)

Understanding LLM-Centric Challenges for Deep Learning Frameworks: An Empirical Analysis
di: Mu, Yanzhou, et al.
Pubblicazione: (2025)

DevEval: A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories
di: Li, Jia, et al.
Pubblicazione: (2024)

LLMs are Bug Replicators: An Empirical Study on LLMs' Capability in Completing Bug-prone Code
di: Guo, Liwei, et al.
Pubblicazione: (2025)

Chart2Code-MoLA: Efficient Multi-Modal Code Generation via Adaptive Expert Routing
di: Wang, Yifei, et al.
Pubblicazione: (2025)

When LLMs Meet API Documentation: Can Retrieval Augmentation Aid Code Generation Just as It Helps Developers?
di: Chen, Jingyi, et al.
Pubblicazione: (2025)

Bridging Developer Instructions and Code Completion Through Instruction-Aware Fill-in-the-Middle Paradigm
di: Sun, Zhensu, et al.
Pubblicazione: (2025)

LiveCodeBench Pro: How Do Olympiad Medalists Judge LLMs in Competitive Programming?
di: Zheng, Zihan, et al.
Pubblicazione: (2025)

CodeGlance: Understanding Code Reasoning Challenges in LLMs through Multi-Dimensional Feature Analysis
di: Wang, Yunkun, et al.
Pubblicazione: (2026)

FeatureBench: Benchmarking Agentic Coding for Complex Feature Development
di: Zhou, Qixing, et al.
Pubblicazione: (2026)

Enhancing and Reporting Robustness Boundary of Neural Code Models for Intelligent Code Understanding
di: Han, Tingxu, et al.
Pubblicazione: (2026)

Completion by Comprehension: Guiding Code Generation with Multi-Granularity Understanding
di: Zhao, Xinkui, et al.
Pubblicazione: (2025)

Do Fine-Tuned LLMs Understand Vulnerabilities? An Investigation into the Semantic Trap
di: Huang, Feiyang, et al.
Pubblicazione: (2026)

Model Editing for LLMs4Code: How Far are We?
di: Li, Xiaopeng, et al.
Pubblicazione: (2024)

LLMs Meet Library Evolution: Evaluating Deprecated API Usage in LLM-based Code Completion
di: Wang, Chong, et al.
Pubblicazione: (2024)

FastCode: Fast and Cost-Efficient Code Understanding and Reasoning
di: Li, Zhonghang, et al.
Pubblicazione: (2026)

SynConfRoute: Syntax-Aware Routing for Efficient Code Completion with Small CodeLLMs
di: Thangarajah, Kishanthan, et al.
Pubblicazione: (2026)

OSS-Bench: Benchmark Generator for Coding LLMs
di: Jiang, Yuancheng, et al.
Pubblicazione: (2025)

Coding-PTMs: How to Find Optimal Code Pre-trained Models for Code Embedding in Vulnerability Detection?
di: Zhao, Yu, et al.
Pubblicazione: (2024)