AstroReview: An LLM-driven Multi-Agent Framework for Telescope Proposal Peer Review and Refinement
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909979011710976 |
|---|---|
| author | Wang, Yutong Xiao, Yunxiang Tian, Yonglin Li, Junyong Wang, Jing Lv, Yisheng |
| author_facet | Wang, Yutong Xiao, Yunxiang Tian, Yonglin Li, Junyong Wang, Jing Lv, Yisheng |
| contents | Competitive access to modern observatories has intensified as proposal volumes outpace available telescope time, making timely, consistent, and transparent peer review a critical bottleneck for the advancement of astronomy. Automating parts of this process is therefore both scientifically significant and operationally necessary to ensure fair allocation and reproducible decisions at scale. We present AstroReview, an open-source, agent-based framework that automates proposal review in three stages: (i) novelty and scientific merit, (ii) feasibility and expected yield, and (iii) meta-review and reliability verification. Task isolation and explicit reasoning traces curb hallucinations and improve transparency. Without any domain specific fine tuning, AstroReview used in our experiments only for the last stage, correctly identifies genuinely accepted proposals with an accuracy of 87%. The AstroReview in Action module replicates the review and refinement loop; with its integrated Proposal Authoring Agent, the acceptance rate of revised drafts increases by 66% after two iterations, showing that iterative feedback combined with automated meta-review and reliability verification delivers measurable quality gains. Together, these results point to a practical path toward scalable, auditable, and higher throughput proposal review for resource limited facilities. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_24754 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | AstroReview: An LLM-driven Multi-Agent Framework for Telescope Proposal Peer Review and Refinement Wang, Yutong Xiao, Yunxiang Tian, Yonglin Li, Junyong Wang, Jing Lv, Yisheng Instrumentation and Methods for Astrophysics Artificial Intelligence Competitive access to modern observatories has intensified as proposal volumes outpace available telescope time, making timely, consistent, and transparent peer review a critical bottleneck for the advancement of astronomy. Automating parts of this process is therefore both scientifically significant and operationally necessary to ensure fair allocation and reproducible decisions at scale. We present AstroReview, an open-source, agent-based framework that automates proposal review in three stages: (i) novelty and scientific merit, (ii) feasibility and expected yield, and (iii) meta-review and reliability verification. Task isolation and explicit reasoning traces curb hallucinations and improve transparency. Without any domain specific fine tuning, AstroReview used in our experiments only for the last stage, correctly identifies genuinely accepted proposals with an accuracy of 87%. The AstroReview in Action module replicates the review and refinement loop; with its integrated Proposal Authoring Agent, the acceptance rate of revised drafts increases by 66% after two iterations, showing that iterative feedback combined with automated meta-review and reliability verification delivers measurable quality gains. Together, these results point to a practical path toward scalable, auditable, and higher throughput proposal review for resource limited facilities. |
| title | AstroReview: An LLM-driven Multi-Agent Framework for Telescope Proposal Peer Review and Refinement |
| topic | Instrumentation and Methods for Astrophysics Artificial Intelligence |
| url | https://arxiv.org/abs/2512.24754 |