Cover Image

Changes in Coding Behavior and Performance Since the Introduction of LLMs

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Yufan, Savelka, Jaromir, Goldstein, Seth Copen, Conway, Michael
Format:	Preprint
Published:	2026
Subjects:	Software Engineering
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Exploring the Capabilities of LLMs for Code Change Related Tasks
by: Fan, Lishui, et al.
Published: (2024)

Unprecedented Code Change Automation: The Fusion of LLMs and Transformation by Example
by: Dilhara, Malinda, et al.
Published: (2024)

ChangeGuard: Validating Code Changes via Pairwise Learning-Guided Execution
by: Gröninger, Lars, et al.
Published: (2024)

Analysis on LLMs Performance for Code Summarization
by: Akib, Md. Ahnaf, et al.
Published: (2024)

Understanding Code Change with Micro-Changes
by: Chen, Lei, et al.
Published: (2024)

Causal Inference for the Effect of Code Coverage on Bug Introduction
by: Schulte, Lukas, et al.
Published: (2026)

Process-Supervised Reinforcement Learning for Code Generation
by: Ye, Yufan, et al.
Published: (2025)

ChangePrism: Visualizing the Essence of Code Changes
by: Chen, Lei, et al.
Published: (2025)

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems
by: Guimaraes, Everton, et al.
Published: (2025)

Debug2Fix: Can Interactive Debugging Help Coding Agents Fix More Bugs?
by: Garg, Spandan, et al.
Published: (2026)

What Makes Good In-context Demonstrations for Code Intelligence Tasks with LLMs?
by: Gao, Shuzheng, et al.
Published: (2023)

On Evaluating the Efficiency of Source Code Generated by LLMs
by: Niu, Changan, et al.
Published: (2024)

GNN-Coder: Boosting Semantic Code Retrieval with Combined GNNs and Transformer
by: Ye, Yufan, et al.
Published: (2025)

Teaching Code LLMs to Use Autocompletion Tools in Repository-Level Code Generation
by: Wang, Chong, et al.
Published: (2024)

LLMs are Bug Replicators: An Empirical Study on LLMs' Capability in Completing Bug-prone Code
by: Guo, Liwei, et al.
Published: (2025)

CodeSpecBench: Benchmarking LLMs for Executable Behavioral Specification Generation
by: Chen, Zaoyu, et al.
Published: (2026)

CodeGlance: Understanding Code Reasoning Challenges in LLMs through Multi-Dimensional Feature Analysis
by: Wang, Yunkun, et al.
Published: (2026)

Compiling Code LLMs into Lightweight Executables
by: Shi, Jieke, et al.
Published: (2026)

Code Comprehension with GitHub Copilot: Performance Gains, Comprehension Trade-offs, and Behavioral Predictors in Brownfield Programming
by: Qiao, Yunhan, et al.
Published: (2025)

Analyzing Dependency Distribution Changes Arising from Code Smell Interactions
by: Zhang, Zushuai, et al.
Published: (2025)

Does AI Code Review Lead to Code Changes? A Case Study of GitHub Actions
by: Sun, Kexin, et al.
Published: (2025)

MUCOCO: Automated Consistency Testing of Code LLMs
by: Chou, Chua Jin, et al.
Published: (2026)

Capturing the Effects of Quantization on Trojans in Code LLMs
by: Hussain, Aftab, et al.
Published: (2025)

SWE-Bench+: Enhanced Coding Benchmark for LLMs
by: Aleithan, Reem, et al.
Published: (2024)

Do Code LLMs Do Static Analysis?
by: Su, Chia-Yi, et al.
Published: (2025)

CodeMMLU: A Multi-Task Benchmark for Assessing Code Understanding & Reasoning Capabilities of CodeLLMs
by: Manh, Dung Nguyen, et al.
Published: (2024)

Terminus-4B: Can a Smaller Model Replace Frontier LLMs at Agentic Execution Tasks?
by: Garg, Spandan, et al.
Published: (2026)

When to Stop? Towards Efficient Code Generation in LLMs with Excess Token Prevention
by: Guo, Lianghong, et al.
Published: (2024)

ABTest: Behavior-Driven Testing for AI Coding Agents
by: Dai, Wuyang, et al.
Published: (2026)

Brevity is the Soul of Wit: Condensing Code Changes to Improve Commit Message Generation
by: Kuang, Hongyu, et al.
Published: (2025)

Evolving Triple Knowledge-Augmented LLMs for Code Translation in Repository Context
by: Ou, Guangsheng, et al.
Published: (2025)

On the Road to Personalized Code Intelligence: Portraiting and Assisting Developers Based on Their In-IDE Behaviors
by: Liu, Yuhong, et al.
Published: (2026)

SynthCoder: A Synthetical Strategy to Tune LLMs for Code Completion
by: Yu, Dongjun, et al.
Published: (2025)

Information-Theoretic Detection of Unusual Source Code Changes
by: Torres, Adriano, et al.
Published: (2025)

LLMs in Code Vulnerability Analysis: A Proof of Concept
by: Sultana, Shaznin, et al.
Published: (2026)

Learned or Memorized ? Quantifying Memorization Advantage in Code LLMs
by: Euraste, Djiré Albérick, et al.
Published: (2026)

AOCI: Symbolic-Semantic Indexing for Practical Repository-Scale Code Understanding with LLMs
by: Liu, Jinshi, et al.
Published: (2026)

How do Humans and LLMs Process Confusing Code?
by: Abdelsalam, Youssef, et al.
Published: (2025)

Assertion Messages with Large Language Models (LLMs) for Code
by: Aljohani, Ahmed, et al.
Published: (2025)

How Quantization Impacts Privacy Risk on LLMs for Code?
by: Haque, Md Nazmul, et al.
Published: (2025)