Understanding and Supporting Peer Review Using AI-reframed Positive Summary
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866917955739058176 |
|---|---|
| author | Yang, Chi-Lan Uhde, Alarith Yamashita, Naomi Kuzuoka, Hideaki |
| author_facet | Yang, Chi-Lan Uhde, Alarith Yamashita, Naomi Kuzuoka, Hideaki |
| contents | While peer review enhances writing and research quality, harsh feedback can frustrate and demotivate authors. Hence, it is essential to explore how critiques should be delivered to motivate authors and enable them to keep iterating their work. In this study, we explored the impact of appending an automatically generated positive summary to the peer reviews of a writing task, alongside varying levels of overall evaluations (high vs. low), on authors' feedback reception, revision outcomes, and motivation to revise. Through a 2x2 online experiment with 137 participants, we found that adding an AI-reframed positive summary to otherwise harsh feedback increased authors' critique acceptance, whereas low overall evaluations of their work led to increased revision efforts. We discuss the implications of using AI in peer feedback, focusing on how AI-driven critiques can influence critique acceptance and support research communities in fostering productive and friendly peer feedback practices. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_10264 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Understanding and Supporting Peer Review Using AI-reframed Positive Summary Yang, Chi-Lan Uhde, Alarith Yamashita, Naomi Kuzuoka, Hideaki Human-Computer Interaction Computers and Society While peer review enhances writing and research quality, harsh feedback can frustrate and demotivate authors. Hence, it is essential to explore how critiques should be delivered to motivate authors and enable them to keep iterating their work. In this study, we explored the impact of appending an automatically generated positive summary to the peer reviews of a writing task, alongside varying levels of overall evaluations (high vs. low), on authors' feedback reception, revision outcomes, and motivation to revise. Through a 2x2 online experiment with 137 participants, we found that adding an AI-reframed positive summary to otherwise harsh feedback increased authors' critique acceptance, whereas low overall evaluations of their work led to increased revision efforts. We discuss the implications of using AI in peer feedback, focusing on how AI-driven critiques can influence critique acceptance and support research communities in fostering productive and friendly peer feedback practices. |
| title | Understanding and Supporting Peer Review Using AI-reframed Positive Summary |
| topic | Human-Computer Interaction Computers and Society |
| url | https://arxiv.org/abs/2503.10264 |