LLMs as information warriors? Auditing how LLM-powered chatbots tackle disinformation about Russia's war in Ukraine
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866910609300258816 |
|---|---|
| author | Makhortykh, Mykola Baghumyan, Ani Vziatysheva, Victoria Sydorova, Maryna Kuznetsova, Elizaveta |
| author_facet | Makhortykh, Mykola Baghumyan, Ani Vziatysheva, Victoria Sydorova, Maryna Kuznetsova, Elizaveta |
| contents | The rise of large language models (LLMs) has a significant impact on information warfare. By facilitating the production of content related to disinformation and propaganda campaigns, LLMs can amplify different types of information operations and mislead online users. In our study, we empirically investigate how LLM-powered chatbots, developed by Google, Microsoft, and Perplexity, handle disinformation about Russia's war in Ukraine and whether the chatbots' ability to provide accurate information on the topic varies across languages and over time. Our findings indicate that while for some chatbots (Perplexity), there is a significant improvement in performance over time in several languages, for others (Gemini), the performance improves only in English but deteriorates in low-resource languages. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_10697 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | LLMs as information warriors? Auditing how LLM-powered chatbots tackle disinformation about Russia's war in Ukraine Makhortykh, Mykola Baghumyan, Ani Vziatysheva, Victoria Sydorova, Maryna Kuznetsova, Elizaveta Computers and Society The rise of large language models (LLMs) has a significant impact on information warfare. By facilitating the production of content related to disinformation and propaganda campaigns, LLMs can amplify different types of information operations and mislead online users. In our study, we empirically investigate how LLM-powered chatbots, developed by Google, Microsoft, and Perplexity, handle disinformation about Russia's war in Ukraine and whether the chatbots' ability to provide accurate information on the topic varies across languages and over time. Our findings indicate that while for some chatbots (Perplexity), there is a significant improvement in performance over time in several languages, for others (Gemini), the performance improves only in English but deteriorates in low-resource languages. |
| title | LLMs as information warriors? Auditing how LLM-powered chatbots tackle disinformation about Russia's war in Ukraine |
| topic | Computers and Society |
| url | https://arxiv.org/abs/2409.10697 |