RESCORE: LLM-Driven Simulation Recovery in Control Systems Research Papers

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Bhat, Vineet, Wei, Shiqing, Kaypak, Ali Umut, Krishnamurthy, Prashanth, Karri, Ramesh, Khorrami, Farshad
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915917617692672
author Bhat, Vineet
Wei, Shiqing
Kaypak, Ali Umut
Krishnamurthy, Prashanth
Karri, Ramesh
Khorrami, Farshad
author_facet Bhat, Vineet
Wei, Shiqing
Kaypak, Ali Umut
Krishnamurthy, Prashanth
Karri, Ramesh
Khorrami, Farshad
contents Reconstructing numerical simulations from control systems research papers is often hindered by underspecified parameters and ambiguous implementation details. We define the task of Paper to Simulation Recoverability, the ability of an automated system to generate executable code that faithfully reproduces a paper's results. We curate a benchmark of 500 papers from the IEEE Conference on Decision and Control (CDC) and propose RESCORE, a three component LLM agentic framework, Analyzer, Coder, and Verifier. RESCORE uses iterative execution feedback and visual comparison to improve reconstruction fidelity. Our method successfully recovers task coherent simulations for 40.7% of benchmark instances, outperforming single pass generation. Notably, the RESCORE automated pipeline achieves an estimated 10X speedup over manual human replication, drastically cutting the time and effort required to verify published control methodologies. We will release our benchmark and agents to foster community progress in automated research replication.
format Preprint
id arxiv_https___arxiv_org_abs_2604_04324
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle RESCORE: LLM-Driven Simulation Recovery in Control Systems Research Papers
Bhat, Vineet
Wei, Shiqing
Kaypak, Ali Umut
Krishnamurthy, Prashanth
Karri, Ramesh
Khorrami, Farshad
Artificial Intelligence
Software Engineering
Reconstructing numerical simulations from control systems research papers is often hindered by underspecified parameters and ambiguous implementation details. We define the task of Paper to Simulation Recoverability, the ability of an automated system to generate executable code that faithfully reproduces a paper's results. We curate a benchmark of 500 papers from the IEEE Conference on Decision and Control (CDC) and propose RESCORE, a three component LLM agentic framework, Analyzer, Coder, and Verifier. RESCORE uses iterative execution feedback and visual comparison to improve reconstruction fidelity. Our method successfully recovers task coherent simulations for 40.7% of benchmark instances, outperforming single pass generation. Notably, the RESCORE automated pipeline achieves an estimated 10X speedup over manual human replication, drastically cutting the time and effort required to verify published control methodologies. We will release our benchmark and agents to foster community progress in automated research replication.
title RESCORE: LLM-Driven Simulation Recovery in Control Systems Research Papers
topic Artificial Intelligence
Software Engineering
url https://arxiv.org/abs/2604.04324