Dialogues with AI Reduce Beliefs in Misinformation but Build No Lasting Discernment Skills
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866914392109481984 |
|---|---|
| author | Rani, Anku Danry, Valdemar Liang, Paul Pu Lippman, Andrew B. Maes, Pattie |
| author_facet | Rani, Anku Danry, Valdemar Liang, Paul Pu Lippman, Andrew B. Maes, Pattie |
| contents | Given the growing prevalence of fake information, including increasingly realistic AI-generated news, there is an urgent need to train people to better evaluate and detect misinformation. While interactions with AI have been shown to durably reduce people's beliefs in false information, it is unclear whether these interactions also teach people the skills to discern false information themselves. We conducted a month-long study where 67 participants classified news headline-image pairs as real or fake, discussed their assessments with an AI system, followed by an unassisted evaluation of unseen news items to measure accuracy before, during, and after AI assistance. While AI assistance produced immediate improvements during AI-assisted sessions (+21\% average), participants' unassisted performance on new items declined significantly by 15.3\% in week 4 compared to week 0. These results indicate that while AI may help immediately, it ultimately degrades long-term misinformation detection abilities |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_01537 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Dialogues with AI Reduce Beliefs in Misinformation but Build No Lasting Discernment Skills Rani, Anku Danry, Valdemar Liang, Paul Pu Lippman, Andrew B. Maes, Pattie Human-Computer Interaction Given the growing prevalence of fake information, including increasingly realistic AI-generated news, there is an urgent need to train people to better evaluate and detect misinformation. While interactions with AI have been shown to durably reduce people's beliefs in false information, it is unclear whether these interactions also teach people the skills to discern false information themselves. We conducted a month-long study where 67 participants classified news headline-image pairs as real or fake, discussed their assessments with an AI system, followed by an unassisted evaluation of unseen news items to measure accuracy before, during, and after AI assistance. While AI assistance produced immediate improvements during AI-assisted sessions (+21\% average), participants' unassisted performance on new items declined significantly by 15.3\% in week 4 compared to week 0. These results indicate that while AI may help immediately, it ultimately degrades long-term misinformation detection abilities |
| title | Dialogues with AI Reduce Beliefs in Misinformation but Build No Lasting Discernment Skills |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2510.01537 |