From Verification Burden to Trusted Collaboration: Design Goals for LLM-Assisted Literature Reviews
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866917142492872704 |
|---|---|
| author | Nogueira, Brenda Geyer, Werner Anderson, Andrew Li, Toby Jia-Jun Kim, Dongwhi Moniz, Nuno Chawla, Nitesh V. |
| author_facet | Nogueira, Brenda Geyer, Werner Anderson, Andrew Li, Toby Jia-Jun Kim, Dongwhi Moniz, Nuno Chawla, Nitesh V. |
| contents | Large Language Models (LLMs) are increasingly embedded in academic writing practices. Although numerous studies have explored how researchers employ these tools for scientific writing, their concrete implementation, limitations, and design challenges within the literature review process remain underexplored. In this paper, we report a user study with researchers across multiple disciplines to characterize current practices, benefits, and \textit{pain points} in using LLMs to investigate related work. We identified three recurring gaps: (i) lack of trust in outputs, (ii) persistent verification burden, and (iii) requiring multiple tools. This motivates our proposal of six design goals and a high-level framework that operationalizes them through improved related papers visualization, verification at every step, and human-feedback alignment with generation-guided explanations. Overall, by grounding our work in the practical, day-to-day needs of researchers, we designed a framework that addresses these limitations and models real-world LLM-assisted writing, advancing trust through verifiable actions and fostering practical collaboration between researchers and AI systems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_11661 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | From Verification Burden to Trusted Collaboration: Design Goals for LLM-Assisted Literature Reviews Nogueira, Brenda Geyer, Werner Anderson, Andrew Li, Toby Jia-Jun Kim, Dongwhi Moniz, Nuno Chawla, Nitesh V. Human-Computer Interaction Artificial Intelligence Large Language Models (LLMs) are increasingly embedded in academic writing practices. Although numerous studies have explored how researchers employ these tools for scientific writing, their concrete implementation, limitations, and design challenges within the literature review process remain underexplored. In this paper, we report a user study with researchers across multiple disciplines to characterize current practices, benefits, and \textit{pain points} in using LLMs to investigate related work. We identified three recurring gaps: (i) lack of trust in outputs, (ii) persistent verification burden, and (iii) requiring multiple tools. This motivates our proposal of six design goals and a high-level framework that operationalizes them through improved related papers visualization, verification at every step, and human-feedback alignment with generation-guided explanations. Overall, by grounding our work in the practical, day-to-day needs of researchers, we designed a framework that addresses these limitations and models real-world LLM-assisted writing, advancing trust through verifiable actions and fostering practical collaboration between researchers and AI systems. |
| title | From Verification Burden to Trusted Collaboration: Design Goals for LLM-Assisted Literature Reviews |
| topic | Human-Computer Interaction Artificial Intelligence |
| url | https://arxiv.org/abs/2512.11661 |