From Articles to Code: On-Demand Generation of Core Algorithms from Scientific Publications
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911083575377920 |
|---|---|
| author | Movassaghi, Cameron S. Momenzadeh, Amanda Meyer, Jesse G. |
| author_facet | Movassaghi, Cameron S. Momenzadeh, Amanda Meyer, Jesse G. |
| contents | Maintaining software packages imposes significant costs due to dependency management, bug fixes, and versioning. We show that rich method descriptions in scientific publications can serve as standalone specifications for modern large language models (LLMs), enabling on-demand code generation that could supplant human-maintained libraries. We benchmark state-of-the-art models (GPT-o4-mini-high, Gemini Pro 2.5, Claude Sonnet 4) by tasking them with implementing a diverse set of core algorithms drawn from original publications. Our results demonstrate that current LLMs can reliably reproduce package functionality with performance indistinguishable from conventional libraries. These findings foreshadow a paradigm shift toward flexible, on-demand code generation and away from static, human-maintained packages, which will result in reduced maintenance overhead by leveraging published articles as sufficient context for the automated implementation of analytical workflows. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_22324 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | From Articles to Code: On-Demand Generation of Core Algorithms from Scientific Publications Movassaghi, Cameron S. Momenzadeh, Amanda Meyer, Jesse G. Software Engineering Artificial Intelligence Maintaining software packages imposes significant costs due to dependency management, bug fixes, and versioning. We show that rich method descriptions in scientific publications can serve as standalone specifications for modern large language models (LLMs), enabling on-demand code generation that could supplant human-maintained libraries. We benchmark state-of-the-art models (GPT-o4-mini-high, Gemini Pro 2.5, Claude Sonnet 4) by tasking them with implementing a diverse set of core algorithms drawn from original publications. Our results demonstrate that current LLMs can reliably reproduce package functionality with performance indistinguishable from conventional libraries. These findings foreshadow a paradigm shift toward flexible, on-demand code generation and away from static, human-maintained packages, which will result in reduced maintenance overhead by leveraging published articles as sufficient context for the automated implementation of analytical workflows. |
| title | From Articles to Code: On-Demand Generation of Core Algorithms from Scientific Publications |
| topic | Software Engineering Artificial Intelligence |
| url | https://arxiv.org/abs/2507.22324 |