GoodPoint: Learning Constructive Scientific Paper Feedback from Author Responses

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Mun, Jimin, Jung, Chani, Zhou, Xuhui, Kim, Hyunwoo, Sap, Maarten
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911589119033344
author Mun, Jimin
Jung, Chani
Zhou, Xuhui
Kim, Hyunwoo
Sap, Maarten
author_facet Mun, Jimin
Jung, Chani
Zhou, Xuhui
Kim, Hyunwoo
Sap, Maarten
contents While LLMs hold significant potential to transform scientific research, we advocate for their use to augment and empower researchers rather than to automate research without human oversight. To this end, we study constructive feedback generation, the task of producing targeted, actionable feedback that helps authors improve both their research and its presentation. In this work, we operationalize the effectiveness of feedback along two author-centric axes-validity and author action. We first curate GoodPoint-ICLR, a dataset of 19K ICLR papers with reviewer feedback annotated along both dimensions using author responses. Building on this, we introduce GoodPoint, a training recipe that leverages success signals from author responses through fine-tuning on valid and actionable feedback, together with preference optimization on both real and synthetic preference pairs. Our evaluation on a benchmark of 1.2K ICLR papers shows that a GoodPoint-trained Qwen3-8B improves the predicted success rate by 83.7% over the base model and sets a new state-of-the-art among LLMs of similar size in feedback matching on a golden human feedback set, even surpassing Gemini-3-flash in precision. We further validate these findings through an expert human study, demonstrating that GoodPoint consistently delivers higher practical value as perceived by authors.
format Preprint
id arxiv_https___arxiv_org_abs_2604_11924
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle GoodPoint: Learning Constructive Scientific Paper Feedback from Author Responses
Mun, Jimin
Jung, Chani
Zhou, Xuhui
Kim, Hyunwoo
Sap, Maarten
Artificial Intelligence
Computation and Language
While LLMs hold significant potential to transform scientific research, we advocate for their use to augment and empower researchers rather than to automate research without human oversight. To this end, we study constructive feedback generation, the task of producing targeted, actionable feedback that helps authors improve both their research and its presentation. In this work, we operationalize the effectiveness of feedback along two author-centric axes-validity and author action. We first curate GoodPoint-ICLR, a dataset of 19K ICLR papers with reviewer feedback annotated along both dimensions using author responses. Building on this, we introduce GoodPoint, a training recipe that leverages success signals from author responses through fine-tuning on valid and actionable feedback, together with preference optimization on both real and synthetic preference pairs. Our evaluation on a benchmark of 1.2K ICLR papers shows that a GoodPoint-trained Qwen3-8B improves the predicted success rate by 83.7% over the base model and sets a new state-of-the-art among LLMs of similar size in feedback matching on a golden human feedback set, even surpassing Gemini-3-flash in precision. We further validate these findings through an expert human study, demonstrating that GoodPoint consistently delivers higher practical value as perceived by authors.
title GoodPoint: Learning Constructive Scientific Paper Feedback from Author Responses
topic Artificial Intelligence
Computation and Language
url https://arxiv.org/abs/2604.11924