Image de couverture de livre

Measuring Emergent Capabilities of LLMs for Software Engineering: How Far Are We?

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	O'Brien, Conor, Rodriguez-Cardenas, Daniel, Velasco, Alejandro, Palacio, David N., Poshyvanyk, Denys
Format:	Preprint
Publié:	2024
Sujets:	Software Engineering
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Which Syntactic Capabilities Are Statistically Learned by Masked Language Models for Code?
par: Velasco, Alejandro, et autres
Publié: (2024)

Towards Enabling An Artificial Self-Construction Software Life-cycle via Autopoietic Architectures
par: Rodriguez-Cardenas, Daniel, et autres
Publié: (2026)

SnipGen: A Mining Repository Framework for Evaluating LLMs for Code
par: Rodriguez-Cardenas, Daniel, et autres
Publié: (2025)

On Interpreting the Effectiveness of Unsupervised Software Traceability with Information Theory
par: Palacio, David N., et autres
Publié: (2024)

How Propense Are Large Language Models at Producing Code Smells? A Benchmarking Study
par: Velasco, Alejandro, et autres
Publié: (2024)

A Causal Perspective on Measuring, Explaining and Mitigating Smells in LLM-Generated Code
par: Velasco, Alejandro, et autres
Publié: (2025)

Mapping the Trust Terrain: LLMs in Software Engineering -- Insights and Perspectives
par: Khati, Dipin, et autres
Publié: (2025)

Enabling Global, Human-Centered Explanations for LLMs:From Tokens to Interpretable Code and Test Generation
par: Khati, Dipin, et autres
Publié: (2025)

Towards More Trustworthy and Interpretable LLMs for Code through Syntax-Grounded Explanations
par: Palacio, David N., et autres
Publié: (2024)

A Path Less Traveled: Reimagining Software Engineering Automation via a Neurosymbolic Paradigm
par: Mastropaolo, Antonio, et autres
Publié: (2025)

Towards Comprehensive Benchmarking Infrastructure for LLMs In Software Engineering
par: Rodriguez-Cardenas, Daniel, et autres
Publié: (2026)

Toward Neurosymbolic Program Comprehension
par: Velasco, Alejandro, et autres
Publié: (2025)

Rethinking Software Empirical Studies with Structural Causal Models
par: Rodriguez-Cardenas, Daniel, et autres
Publié: (2026)

Bridging the Quantum Divide: Aligning Academic and Industry Goals in Software Engineering
par: Zappin, Jake, et autres
Publié: (2025)

Perspective of Software Engineering Researchers on Machine Learning Practices Regarding Research, Review, and Education
par: Mojica-Hanke, Anamaria, et autres
Publié: (2024)

Toward a Theory of Causation for Interpreting Neural Code Models
par: Palacio, David N., et autres
Publié: (2023)

Challenges and Practices in Quantum Software Testing and Debugging: Insights from Practitioners
par: Zappin, Jake, et autres
Publié: (2025)

Prompting in Practice: Investigating Software Practitioners' Use of Generative AI Tools
par: Otten, Daniel, et autres
Publié: (2025)

Detecting and Correcting Hallucinations in LLM-Generated Code via Deterministic AST Analysis
par: Khati, Dipin, et autres
Publié: (2026)

Tricky$^2$: Towards a Benchmark for Evaluating Human and LLM Error Interactions
par: Granger, Cole, et autres
Publié: (2026)

How Do Semantically Equivalent Code Transformations Impact Membership Inference on LLMs for Code?
par: Yang, Hua, et autres
Publié: (2025)

"Don't Be Afraid, Just Learn": Insights from Industry Practitioners to Prepare Software Engineers in the Age of Generative AI
par: Otten, Daniel, et autres
Publié: (2026)

On the Effectiveness of LLM-as-a-judge for Code Generation and Summarization
par: Crupi, Giuseppe, et autres
Publié: (2025)

How Far Are We? The Triumphs and Trials of Generative AI in Learning Software Engineering
par: Choudhuri, Rudrajit, et autres
Publié: (2023)

Testing Practices, Challenges, and Developer Perspectives in Open-Source IoT Platforms
par: Rodriguez-Cardenas, Daniel, et autres
Publié: (2025)

"The Law Doesn't Work Like a Computer": Exploring Software Licensing Issues Faced by Legal Practitioners
par: Wintersgill, Nathan, et autres
Publié: (2024)

BOMs Away! Inside the Minds of Stakeholders: A Comprehensive Study of Bills of Materials for Software Systems
par: Stalnaker, Trevor, et autres
Publié: (2023)

Understanding Privacy Risks in Code Models Through Training Dynamics: A Causal Approach
par: Yang, Hua, et autres
Publié: (2025)

Toward Explaining Large Language Models in Software Engineering Tasks
par: Vitale, Antonio, et autres
Publié: (2025)

Towards a Science of Causal Interpretability in Deep Learning for Software Engineering
par: Palacio, David N.
Publié: (2025)

When Quantum Meets Classical: Characterizing Hybrid Quantum-Classical Issues Discussed in Developer Forums
par: Zappin, Jake, et autres
Publié: (2024)

On the Generalizability of Transformer Models to Code Completions of Different Lengths
par: Cooper, Nathan, et autres
Publié: (2025)

Towards More Trustworthy Deep Code Models by Enabling Out-of-Distribution Detection
par: Yan, Yanfu, et autres
Publié: (2025)

Duplicate Bug Report Detection: How Far Are We?
par: Zhang, Ting, et autres
Publié: (2022)

Model Editing for LLMs4Code: How Far are We?
par: Li, Xiaopeng, et autres
Publié: (2024)

Using LLMs for Security Advisory Investigations: How Far Are We?
par: Abdullah, Bayu Fedra, et autres
Publié: (2025)

Developers' Perspectives on Software Licensing: Current Practices, Challenges, and Tools
par: Wintersgill, Nathan, et autres
Publié: (2025)

Representation Learning for Stack Overflow Posts: How Far are We?
par: He, Junda, et autres
Publié: (2023)

Vulnerability-Affected Versions Identification: How Far Are We?
par: Chen, Xingchu, et autres
Publié: (2025)

How Scientists Use Large Language Models to Program
par: O'Brien, Gabrielle
Publié: (2025)