Developing Story: Case Studies of Generative AI's Use in Journalism
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909412548935680 |
|---|---|
| author | Brigham, Natalie Grace Gao, Chongjiu Kohno, Tadayoshi Roesner, Franziska Mireshghallah, Niloofar |
| author_facet | Brigham, Natalie Grace Gao, Chongjiu Kohno, Tadayoshi Roesner, Franziska Mireshghallah, Niloofar |
| contents | Journalists are among the many users of large language models (LLMs). To better understand the journalist-AI interactions, we conduct a study of LLM usage by two news agencies through browsing the WildChat dataset, identifying candidate interactions, and verifying them by matching to online published articles. Our analysis uncovers instances where journalists provide sensitive material such as confidential correspondence with sources or articles from other agencies to the LLM as stimuli and prompt it to generate articles, and publish these machine-generated articles with limited intervention (median output-publication ROUGE-L of 0.62). Based on our findings, we call for further research into what constitutes responsible use of AI, and the establishment of clear guidelines and best practices on using LLMs in a journalistic context. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_13706 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Developing Story: Case Studies of Generative AI's Use in Journalism Brigham, Natalie Grace Gao, Chongjiu Kohno, Tadayoshi Roesner, Franziska Mireshghallah, Niloofar Computation and Language Artificial Intelligence Computers and Society Journalists are among the many users of large language models (LLMs). To better understand the journalist-AI interactions, we conduct a study of LLM usage by two news agencies through browsing the WildChat dataset, identifying candidate interactions, and verifying them by matching to online published articles. Our analysis uncovers instances where journalists provide sensitive material such as confidential correspondence with sources or articles from other agencies to the LLM as stimuli and prompt it to generate articles, and publish these machine-generated articles with limited intervention (median output-publication ROUGE-L of 0.62). Based on our findings, we call for further research into what constitutes responsible use of AI, and the establishment of clear guidelines and best practices on using LLMs in a journalistic context. |
| title | Developing Story: Case Studies of Generative AI's Use in Journalism |
| topic | Computation and Language Artificial Intelligence Computers and Society |
| url | https://arxiv.org/abs/2406.13706 |