PaperOrchestra: A Multi-Agent Framework for Automated AI Research Paper Writing

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Song, Yiwen, Song, Yale, Pfister, Tomas, Yoon, Jinsung
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914450456444928
author Song, Yiwen
Song, Yale
Pfister, Tomas
Yoon, Jinsung
author_facet Song, Yiwen
Song, Yale
Pfister, Tomas
Yoon, Jinsung
contents Synthesizing unstructured research materials into manuscripts is an essential yet under-explored challenge in AI-driven scientific discovery. Existing autonomous writers are rigidly coupled to specific experimental pipelines, and produce superficial literature reviews. We introduce PaperOrchestra, a multi-agent framework for automated AI research paper writing. It flexibly transforms unconstrained pre-writing materials into submission-ready LaTeX manuscripts, including comprehensive literature synthesis and generated visuals, such as plots and conceptual diagrams. To evaluate performance, we present PaperWritingBench, the first standardized benchmark of reverse-engineered raw materials from 200 top-tier AI conference papers, alongside a comprehensive suite of automated evaluators. In side-by-side human evaluations, PaperOrchestra significantly outperforms autonomous baselines, achieving an absolute win rate margin of 50%-68% in literature review quality, and 14%-38% in overall manuscript quality.
format Preprint
id arxiv_https___arxiv_org_abs_2604_05018
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle PaperOrchestra: A Multi-Agent Framework for Automated AI Research Paper Writing
Song, Yiwen
Song, Yale
Pfister, Tomas
Yoon, Jinsung
Artificial Intelligence
Machine Learning
Multiagent Systems
Synthesizing unstructured research materials into manuscripts is an essential yet under-explored challenge in AI-driven scientific discovery. Existing autonomous writers are rigidly coupled to specific experimental pipelines, and produce superficial literature reviews. We introduce PaperOrchestra, a multi-agent framework for automated AI research paper writing. It flexibly transforms unconstrained pre-writing materials into submission-ready LaTeX manuscripts, including comprehensive literature synthesis and generated visuals, such as plots and conceptual diagrams. To evaluate performance, we present PaperWritingBench, the first standardized benchmark of reverse-engineered raw materials from 200 top-tier AI conference papers, alongside a comprehensive suite of automated evaluators. In side-by-side human evaluations, PaperOrchestra significantly outperforms autonomous baselines, achieving an absolute win rate margin of 50%-68% in literature review quality, and 14%-38% in overall manuscript quality.
title PaperOrchestra: A Multi-Agent Framework for Automated AI Research Paper Writing
topic Artificial Intelligence
Machine Learning
Multiagent Systems
url https://arxiv.org/abs/2604.05018