Evaluating perturbation robustness of generative systems that use COBOL code inputs
Fuente:
arXiv
Saved in:
| Main Authors: | Ackerman, Samuel, Ibraheem, Wesam, Raz, Orna, Zalmanovici, Marcel |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Quality Evaluation of COBOL to Java Code Transformation
by: Froimovich, Shmulik, et al.
Published: (2025)
by: Froimovich, Shmulik, et al.
Published: (2025)
PACIFIC: a framework for generating benchmarks to check Precise Automatically Checked Instruction Following In Code
by: Dreyfuss, Itay, et al.
Published: (2025)
by: Dreyfuss, Itay, et al.
Published: (2025)
Vintage Code, Modern Judges: Meta-Validation in Low Data Regimes
by: Fandina, Ora Nova, et al.
Published: (2025)
by: Fandina, Ora Nova, et al.
Published: (2025)
Uncovering Code Insights: Leveraging GitHub Artifacts for Deeper Code Understanding
by: Nevo, Ziv, et al.
Published: (2025)
by: Nevo, Ziv, et al.
Published: (2025)
Automated Testing of COBOL to Java Transformation
by: Hans, Sandeep, et al.
Published: (2025)
by: Hans, Sandeep, et al.
Published: (2025)
Automated Validation of COBOL to Java Transformation
by: Kumar, Atul, et al.
Published: (2025)
by: Kumar, Atul, et al.
Published: (2025)
Beyond Blind Spots: Analytic Hints for Mitigating LLM-Based Evaluation Pitfalls
by: Fandina, Ora Nova, et al.
Published: (2025)
by: Fandina, Ora Nova, et al.
Published: (2025)
Automated Validation of LLM-based Evaluators for Software Engineering Artifacts
by: Fandina, Ora Nova, et al.
Published: (2025)
by: Fandina, Ora Nova, et al.
Published: (2025)
Code Reborn AI-Driven Legacy Systems Modernization from COBOL to Java
by: Bandarupalli, Gopichand
Published: (2025)
by: Bandarupalli, Gopichand
Published: (2025)
Generating Unseen Code Tests In Infinitum
by: Zalmanovici, Marcel, et al.
Published: (2024)
by: Zalmanovici, Marcel, et al.
Published: (2024)
Evaluating AI-generated code for C++, Fortran, Go, Java, Julia, Matlab, Python, R, and Rust
by: Diehl, Patrick, et al.
Published: (2024)
by: Diehl, Patrick, et al.
Published: (2024)
Assessing LLM code generation quality through path planning tasks
by: Chen, Wanyi, et al.
Published: (2025)
by: Chen, Wanyi, et al.
Published: (2025)
Lifecycle-Aware code generation: Leveraging Software Engineering Phases in LLMs
by: Xing, Xing, et al.
Published: (2025)
by: Xing, Xing, et al.
Published: (2025)
Canonical Intermediate Representation for LLM-based optimization problem formulation and code generation
by: Lyu, Zhongyuan, et al.
Published: (2026)
by: Lyu, Zhongyuan, et al.
Published: (2026)
NeSy is alive and well: A LLM-driven symbolic approach for better code comment data generation and classification
by: Akl, Hanna Abi
Published: (2024)
by: Akl, Hanna Abi
Published: (2024)
REMODEL-LLM: Transforming C code to Java using LLMs
by: Gupta, Aryan, et al.
Published: (2025)
by: Gupta, Aryan, et al.
Published: (2025)
Diffusion is a code repair operator and generator
by: Singh, Mukul, et al.
Published: (2025)
by: Singh, Mukul, et al.
Published: (2025)
PyBench: Evaluating LLM Agent on various real-world coding tasks
by: Zhang, Yaolun, et al.
Published: (2024)
by: Zhang, Yaolun, et al.
Published: (2024)
Automatic Generation of Benchmarks and Reliable LLM Judgment for Code Tasks
by: Farchi, Eitan, et al.
Published: (2024)
by: Farchi, Eitan, et al.
Published: (2024)
An evaluation of LLM code generation capabilities through graded exercises
by: Jiménez, Álvaro Barbero
Published: (2024)
by: Jiménez, Álvaro Barbero
Published: (2024)
Generating executable oracles to check conformance of client code to requirements of JDK Javadocs using LLMs
by: Jiang, Shan, et al.
Published: (2024)
by: Jiang, Shan, et al.
Published: (2024)
COBOL-Coder: Domain-Adapted Large Language Models for COBOL Code Generation and Translation
by: Dau, Anh T. V., et al.
Published: (2026)
by: Dau, Anh T. V., et al.
Published: (2026)
PEFA-AI: Advancing Open-source LLMs for RTL generation using Progressive Error Feedback Agentic-AI
by: Narayanan, Athma, et al.
Published: (2025)
by: Narayanan, Athma, et al.
Published: (2025)
Generating Energy-efficient code with LLMs
by: Cappendijk, Tom, et al.
Published: (2024)
by: Cappendijk, Tom, et al.
Published: (2024)
Do not copy and paste! Rewriting strategies for code retrieval
by: Gurioli, Andrea, et al.
Published: (2026)
by: Gurioli, Andrea, et al.
Published: (2026)
Out of style: Misadventures with LLMs and code style transfer
by: Munson, Karl, et al.
Published: (2024)
by: Munson, Karl, et al.
Published: (2024)
LLM as a code generator in Agile Model Driven Development
by: Sadik, Ahmed R., et al.
Published: (2024)
by: Sadik, Ahmed R., et al.
Published: (2024)
ToolPRMBench: Evaluating and Advancing Process Reward Models for Tool-using Agents
by: Li, Dawei, et al.
Published: (2026)
by: Li, Dawei, et al.
Published: (2026)
LOCOFY Large Design Models -- Design to code conversion solution
by: Muhammad, Sohaib, et al.
Published: (2025)
by: Muhammad, Sohaib, et al.
Published: (2025)
Automated QoR improvement in OpenROAD with coding agents
by: Ghose, Amur, et al.
Published: (2026)
by: Ghose, Amur, et al.
Published: (2026)
RefleXGen:The unexamined code is not worth using
by: Wang, Bin, et al.
Published: (2025)
by: Wang, Bin, et al.
Published: (2025)
The importance of visual modelling languages in generative software engineering
by: Rossi, Roberto
Published: (2024)
by: Rossi, Roberto
Published: (2024)
Empirical Computation
by: Tang, Eric, et al.
Published: (2025)
by: Tang, Eric, et al.
Published: (2025)
A Case Study on AI Engineering Practices: Developing an Autonomous Stock Trading System
by: Grote, Marcel, et al.
Published: (2023)
by: Grote, Marcel, et al.
Published: (2023)
Taming Scylla: Understanding the multi-headed agentic daemon of the coding seas
by: Villmow, Micah
Published: (2026)
by: Villmow, Micah
Published: (2026)
Project resilience as network robustness
by: Piccolo, Sebastiano A., et al.
Published: (2026)
by: Piccolo, Sebastiano A., et al.
Published: (2026)
A systematic review of generative AI usage for IT project management
by: Anghel, Ionut, et al.
Published: (2026)
by: Anghel, Ionut, et al.
Published: (2026)
PELLI: Framework to effectively integrate LLMs for quality software generation
by: Krebs, Rasmus, et al.
Published: (2026)
by: Krebs, Rasmus, et al.
Published: (2026)
Automating the Correctness Assessment of AI-generated Code for Security Contexts
by: Cotroneo, Domenico, et al.
Published: (2023)
by: Cotroneo, Domenico, et al.
Published: (2023)
Guiding the retraining of convolutional neural networks against adversarial inputs
by: López, Francisco Durán, et al.
Published: (2022)
by: López, Francisco Durán, et al.
Published: (2022)
Similar Items
-
Quality Evaluation of COBOL to Java Code Transformation
by: Froimovich, Shmulik, et al.
Published: (2025) -
PACIFIC: a framework for generating benchmarks to check Precise Automatically Checked Instruction Following In Code
by: Dreyfuss, Itay, et al.
Published: (2025) -
Vintage Code, Modern Judges: Meta-Validation in Low Data Regimes
by: Fandina, Ora Nova, et al.
Published: (2025) -
Uncovering Code Insights: Leveraging GitHub Artifacts for Deeper Code Understanding
by: Nevo, Ziv, et al.
Published: (2025) -
Automated Testing of COBOL to Java Transformation
by: Hans, Sandeep, et al.
Published: (2025)