Cover Image

Can It Edit? Evaluating the Ability of Large Language Models to Follow Code Editing Instructions

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Cassano, Federico, Li, Luisa, Sethi, Akul, Shinn, Noah, Brennan-Jones, Abby, Ginesin, Jacob, Berman, Edward, Chakhnashvili, George, Lozhkov, Anton, Anderson, Carolyn Jane, Guha, Arjun
Format:	Preprint
Published:	2023
Subjects:	Software Engineering Artificial Intelligence Machine Learning Programming Languages
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

The State of Julia for Scientific Machine Learning
by: Berman, Edward, et al.
Published: (2024)

"I Would Have Written My Code Differently'': Beginners Struggle to Understand LLM-Generated Code
by: Zi, Yangtian, et al.
Published: (2025)

On Uncertainty Calibration for Equivariant Functions
by: Berman, Edward, et al.
Published: (2025)

ReasoningWeekly: A General Knowledge and Verbal Reasoning Challenge for Large Language Models
by: Wu, Zixuan, et al.
Published: (2025)

InsightEdit: Towards Better Instruction Following for Image Editing
by: Xu, Yingjing, et al.
Published: (2024)

EditWorld: Simulating World Dynamics for Instruction-Following Image Editing
by: Yang, Ling, et al.
Published: (2024)

Substance Beats Style: Why Beginning Students Fail to Code with LLMs
by: Lucchetti, Francesca, et al.
Published: (2024)

Study of magnification and angular resolution of a single water droplet placed on a glass surface
by: Chakhnashvili, Luka, et al.
Published: (2025)

Knowledge Transfer from High-Resource to Low-Resource Programming Languages for Code LLMs
by: Cassano, Federico, et al.
Published: (2023)

The Matrix Reloaded: A Mechanized Formal Analysis of the Matrix Cryptographic Suite
by: Ginesin, Jacob, et al.
Published: (2024)

ExpertEdit: Learning Skill-Aware Motion Editing from Expert Videos
by: Somayazulu, Arjun, et al.
Published: (2026)

Agnostics: Learning to Code in Any Programming Language via Reinforcement with a Universal Learning Environment
by: Boruch-Gruszecki, Aleksander, et al.
Published: (2025)

How Beginning Programmers and Code LLMs (Mis)read Each Other
by: Nguyen, Sydney, et al.
Published: (2024)

SuperEdit: Rectifying and Facilitating Supervision for Instruction-Based Image Editing
by: Li, Ming, et al.
Published: (2025)

Reasoning to Edit: Hypothetical Instruction-Based Image Editing with Visual Reasoning
by: He, Qingdong, et al.
Published: (2025)

Kiwi-Edit: Versatile Video Editing via Instruction and Reference Guidance
by: Lin, Yiqi, et al.
Published: (2026)

LocateEdit-Bench: A Benchmark for Instruction-Based Editing Localization
by: Wu, Shiyu, et al.
Published: (2026)

SliderEdit: Continuous Image Editing with Fine-Grained Instruction Control
by: Zarei, Arman, et al.
Published: (2025)

UltraEdit: Instruction-based Fine-Grained Image Editing at Scale
by: Zhao, Haozhe, et al.
Published: (2024)

InstructEdit: Instruction-based Knowledge Editing for Large Language Models
by: Zhang, Ningyu, et al.
Published: (2024)

Automated Channel Fault Analysis with Tofu
by: Ginesin, Jacob, et al.
Published: (2026)

RIFT: Reordered Instruction Following Testbed To Evaluate Instruction Following in Singular Multistep Prompt Structures
by: Jaffe, Andrew, et al.
Published: (2026)

ChartEditBench: Evaluating Grounded Multi-Turn Chart Editing in Multimodal Language Models
by: Kapadnis, Manav Nitin, et al.
Published: (2026)

Robo-Instruct: Simulator-Augmented Instruction Alignment For Finetuning Code LLMs
by: Hu, Zichao, et al.
Published: (2024)

MultiEdit: Advancing Instruction-based Image Editing on Diverse and Challenging Tasks
by: Li, Mingsong, et al.
Published: (2025)

HQ-Edit: A High-Quality Dataset for Instruction-based Image Editing
by: Hui, Mude, et al.
Published: (2024)

WikiTableEdit: A Benchmark for Table Editing by Natural Language Instruction
by: Li, Zheng, et al.
Published: (2024)

EditShield: Protecting Unauthorized Image Editing by Instruction-guided Diffusion Models
by: Chen, Ruoxi, et al.
Published: (2023)

Rethinking Where to Edit: Task-Aware Localization for Instruction-Based Image Editing
by: He, Jingxuan, et al.
Published: (2026)

HyperEdit: Unlocking Instruction-based Text Editing in LLMs via Hypernetworks
by: Zeng, Yiming, et al.
Published: (2025)

Beyond Simple Edits: X-Planner for Complex Instruction-Based Image Editing
by: Yeh, Chun-Hsiao, et al.
Published: (2025)

VectorEdits: A Dataset and Benchmark for Instruction-Based Editing of Vector Graphics
by: Kuchař, Josef, et al.
Published: (2025)

DLEBench: Evaluating Small-scale Object Editing Ability for Instruction-based Image Editing Model
by: Hong, Shibo, et al.
Published: (2026)

Evaluating Computational Representations of Character: An Austen Character Similarity Benchmark
by: Yang, Funing, et al.
Published: (2024)

Rage Music Classification and Analysis using K-Nearest Neighbour, Random Forest, Support Vector Machine, Convolutional Neural Networks, and Gradient Boosting
by: Kumar, Akul
Published: (2024)

The Evolution of RWKV: Advancements in Efficient Language Modeling
by: Datta, Akul
Published: (2024)

Coherent Audio-Visual Editing via Conditional Audio Generation Following Video Edits
by: Ishii, Masato, et al.
Published: (2025)

Understanding How CodeLLMs (Mis)Predict Types with Activation Steering
by: Lucchetti, Francesca, et al.
Published: (2024)

SEED-Data-Edit Technical Report: A Hybrid Dataset for Instructional Image Editing
by: Ge, Yuying, et al.
Published: (2024)

FreeEdit: Mask-free Reference-based Image Editing with Multi-modal Instruction
by: He, Runze, et al.
Published: (2024)