Can dialogues with AI systems help humans better discern visual misinformation?

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Rani, Anku, Danry, Valdemar, Lippman, Andy, Maes, Pattie
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908308624900096
author Rani, Anku
Danry, Valdemar
Lippman, Andy
Maes, Pattie
author_facet Rani, Anku
Danry, Valdemar
Lippman, Andy
Maes, Pattie
contents The widespread emergence of manipulated news media content poses significant challenges to online information integrity. This study investigates whether dialogues with AI about AI-generated images and associated news statements can increase human discernment abilities and foster short-term learning in detecting misinformation. We conducted a study with 80 participants who engaged in structured dialogues with an AI system about news headline-image pairs, generating 1,310 human-AI dialogue exchanges. Results show that AI interaction significantly boosts participants' accuracy in identifying real versus fake news content from approximately 60\% to 90\% (p$<$0.001). However, these improvements do not persist when participants are presented with new, unseen image-statement pairs without AI assistance, with accuracy returning to baseline levels (~60\%, p=0.88). These findings suggest that while AI systems can effectively change immediate beliefs about specific content through persuasive dialogue, they may not produce lasting improvements that transfer to novel examples, highlighting the need for developing more effective interventions that promote durable learning outcomes.
format Preprint
id arxiv_https___arxiv_org_abs_2504_06517
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Can dialogues with AI systems help humans better discern visual misinformation?
Rani, Anku
Danry, Valdemar
Lippman, Andy
Maes, Pattie
Human-Computer Interaction
The widespread emergence of manipulated news media content poses significant challenges to online information integrity. This study investigates whether dialogues with AI about AI-generated images and associated news statements can increase human discernment abilities and foster short-term learning in detecting misinformation. We conducted a study with 80 participants who engaged in structured dialogues with an AI system about news headline-image pairs, generating 1,310 human-AI dialogue exchanges. Results show that AI interaction significantly boosts participants' accuracy in identifying real versus fake news content from approximately 60\% to 90\% (p$<$0.001). However, these improvements do not persist when participants are presented with new, unseen image-statement pairs without AI assistance, with accuracy returning to baseline levels (~60\%, p=0.88). These findings suggest that while AI systems can effectively change immediate beliefs about specific content through persuasive dialogue, they may not produce lasting improvements that transfer to novel examples, highlighting the need for developing more effective interventions that promote durable learning outcomes.
title Can dialogues with AI systems help humans better discern visual misinformation?
topic Human-Computer Interaction
url https://arxiv.org/abs/2504.06517