LLMs as Research Tools: A Large Scale Survey of Researchers' Usage and Perceptions
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913574148898816 |
|---|---|
| author | Liao, Zhehui Antoniak, Maria Cheong, Inyoung Cheng, Evie Yu-Yen Lee, Ai-Heng Lo, Kyle Chang, Joseph Chee Zhang, Amy X. |
| author_facet | Liao, Zhehui Antoniak, Maria Cheong, Inyoung Cheng, Evie Yu-Yen Lee, Ai-Heng Lo, Kyle Chang, Joseph Chee Zhang, Amy X. |
| contents | The rise of large language models (LLMs) has led many researchers to consider their usage for scientific work. Some have found benefits using LLMs to augment or automate aspects of their research pipeline, while others have urged caution due to risks and ethical concerns. Yet little work has sought to quantify and characterize how researchers use LLMs and why. We present the first large-scale survey of 816 verified research article authors to understand how the research community leverages and perceives LLMs as research tools. We examine participants' self-reported LLM usage, finding that 81% of researchers have already incorporated LLMs into different aspects of their research workflow. We also find that traditionally disadvantaged groups in academia (non-White, junior, and non-native English speaking researchers) report higher LLM usage and perceived benefits, suggesting potential for improved research equity. However, women, non-binary, and senior researchers have greater ethical concerns, potentially hindering adoption. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_05025 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | LLMs as Research Tools: A Large Scale Survey of Researchers' Usage and Perceptions Liao, Zhehui Antoniak, Maria Cheong, Inyoung Cheng, Evie Yu-Yen Lee, Ai-Heng Lo, Kyle Chang, Joseph Chee Zhang, Amy X. Computation and Language Artificial Intelligence Computers and Society Digital Libraries Human-Computer Interaction The rise of large language models (LLMs) has led many researchers to consider their usage for scientific work. Some have found benefits using LLMs to augment or automate aspects of their research pipeline, while others have urged caution due to risks and ethical concerns. Yet little work has sought to quantify and characterize how researchers use LLMs and why. We present the first large-scale survey of 816 verified research article authors to understand how the research community leverages and perceives LLMs as research tools. We examine participants' self-reported LLM usage, finding that 81% of researchers have already incorporated LLMs into different aspects of their research workflow. We also find that traditionally disadvantaged groups in academia (non-White, junior, and non-native English speaking researchers) report higher LLM usage and perceived benefits, suggesting potential for improved research equity. However, women, non-binary, and senior researchers have greater ethical concerns, potentially hindering adoption. |
| title | LLMs as Research Tools: A Large Scale Survey of Researchers' Usage and Perceptions |
| topic | Computation and Language Artificial Intelligence Computers and Society Digital Libraries Human-Computer Interaction |
| url | https://arxiv.org/abs/2411.05025 |