Quality Evaluation of COBOL to Java Code Transformation
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866915418793312256 |
|---|---|
| author | Froimovich, Shmulik Gal, Raviv Ibraheem, Wesam Ziv, Avi |
| author_facet | Froimovich, Shmulik Gal, Raviv Ibraheem, Wesam Ziv, Avi |
| contents | We present an automated evaluation system for assessing COBOL-to-Java code translation within IBM's watsonx Code Assistant for Z (WCA4Z). The system addresses key challenges in evaluating LLM-based translators, including model opacity and the complexity of translation quality assessment. Our approach combines analytic checkers with LLM-as-a-judge (LaaJ) techniques to deliver scalable, multi-faceted evaluations. The system supports continuous integration workflows, enables large-scale benchmarking, and reduces reliance on manual review. We describe the system architecture, evaluation strategies, and reporting mechanisms that provide actionable insights for developers and project managers, facilitating the evolution of high-quality, modernized codebases. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_23356 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Quality Evaluation of COBOL to Java Code Transformation Froimovich, Shmulik Gal, Raviv Ibraheem, Wesam Ziv, Avi Software Engineering Artificial Intelligence We present an automated evaluation system for assessing COBOL-to-Java code translation within IBM's watsonx Code Assistant for Z (WCA4Z). The system addresses key challenges in evaluating LLM-based translators, including model opacity and the complexity of translation quality assessment. Our approach combines analytic checkers with LLM-as-a-judge (LaaJ) techniques to deliver scalable, multi-faceted evaluations. The system supports continuous integration workflows, enables large-scale benchmarking, and reduces reliance on manual review. We describe the system architecture, evaluation strategies, and reporting mechanisms that provide actionable insights for developers and project managers, facilitating the evolution of high-quality, modernized codebases. |
| title | Quality Evaluation of COBOL to Java Code Transformation |
| topic | Software Engineering Artificial Intelligence |
| url | https://arxiv.org/abs/2507.23356 |