FMMD: A multimodal open peer review dataset based on F1000Research

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zhuang, Zhenzhen, Fu, Yuqing, Zhu, Jing, Zhou, Zhangping, Lin, Jialiang
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911449807323136
author Zhuang, Zhenzhen
Fu, Yuqing
Zhu, Jing
Zhou, Zhangping
Lin, Jialiang
author_facet Zhuang, Zhenzhen
Fu, Yuqing
Zhu, Jing
Zhou, Zhangping
Lin, Jialiang
contents Automated scholarly paper review (ASPR) has entered the coexistence phase with traditional peer review, where artificial intelligence (AI) systems are increasingly incorporated into real-world manuscript evaluation. In parallel, research on automated and AI-assisted peer review has proliferated. Despite this momentum, empirical progress remains constrained by several critical limitations in existing datasets. While reviewers routinely evaluate figures, tables, and complex layouts to assess scientific claims, most existing datasets remain overwhelmingly text-centric. This bias is reinforced by a narrow focus on data from computer science venues. Furthermore, these datasets lack precise alignment between reviewer comments and specific manuscript versions, obscuring the iterative relationship between peer review and manuscript evolution. In response, we introduce FMMD, a multimodal and multidisciplinary open peer review dataset curated from F1000Research. The dataset bridges the current gap by integrating manuscript-level visual and structural data with version-specific reviewer reports and editorial decisions. By providing explicit alignment between reviewer comments and the exact article iteration under review, FMMD enables fine-grained analysis of the peer review lifecycle across diverse scientific domains. FMMD supports tasks such as multimodal issue detection and multimodal review comment generation. It provides a comprehensive empirical resource for the development of peer review research.
format Preprint
id arxiv_https___arxiv_org_abs_2602_14285
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle FMMD: A multimodal open peer review dataset based on F1000Research
Zhuang, Zhenzhen
Fu, Yuqing
Zhu, Jing
Zhou, Zhangping
Lin, Jialiang
Digital Libraries
Artificial Intelligence
Computation and Language
Machine Learning
Automated scholarly paper review (ASPR) has entered the coexistence phase with traditional peer review, where artificial intelligence (AI) systems are increasingly incorporated into real-world manuscript evaluation. In parallel, research on automated and AI-assisted peer review has proliferated. Despite this momentum, empirical progress remains constrained by several critical limitations in existing datasets. While reviewers routinely evaluate figures, tables, and complex layouts to assess scientific claims, most existing datasets remain overwhelmingly text-centric. This bias is reinforced by a narrow focus on data from computer science venues. Furthermore, these datasets lack precise alignment between reviewer comments and specific manuscript versions, obscuring the iterative relationship between peer review and manuscript evolution. In response, we introduce FMMD, a multimodal and multidisciplinary open peer review dataset curated from F1000Research. The dataset bridges the current gap by integrating manuscript-level visual and structural data with version-specific reviewer reports and editorial decisions. By providing explicit alignment between reviewer comments and the exact article iteration under review, FMMD enables fine-grained analysis of the peer review lifecycle across diverse scientific domains. FMMD supports tasks such as multimodal issue detection and multimodal review comment generation. It provides a comprehensive empirical resource for the development of peer review research.
title FMMD: A multimodal open peer review dataset based on F1000Research
topic Digital Libraries
Artificial Intelligence
Computation and Language
Machine Learning
url https://arxiv.org/abs/2602.14285