Saved in:
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2504.05146 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915232103792640 |
|---|---|
| author | Elsweiler, David Ateia, Samy Bink, Markus Donabauer, Gregor Pichel, Marcos Fernández Frummet, Alexander Kruschwitz, Udo Losada, David Ludwig, Bernd Meyer, Selina Presa, Noel Pascual |
| author_facet | Elsweiler, David Ateia, Samy Bink, Markus Donabauer, Gregor Pichel, Marcos Fernández Frummet, Alexander Kruschwitz, Udo Losada, David Ludwig, Bernd Meyer, Selina Presa, Noel Pascual |
| contents | While it is often assumed that searching for information to evaluate misinformation will help identify false claims, recent work suggests that search behaviours can instead reinforce belief in misleading news, particularly when users generate queries using vocabulary from the source articles. Our research explores how different query generation strategies affect news verification and whether the way people search influences the accuracy of their information evaluation. A mixed-methods approach was used, consisting of three parts: (1) an analysis of existing data to understand how search behaviour influences trust in fake news, (2) a simulation of query generation strategies using a Large Language Model (LLM) to assess the impact of different query formulations on search result quality, and (3) a user study to examine how 'Boost' interventions in interface design can guide users to adopt more effective query strategies. The results show that search behaviour significantly affects trust in news, with successful searches involving multiple queries and yielding higher-quality results. Queries inspired by different parts of a news article produced search results of varying quality, and weak initial queries improved when reformulated using full SERP information. Although 'Boost' interventions had limited impact, the study suggests that interface design encouraging users to thoroughly review search results can enhance query formulation. This study highlights the importance of query strategies in evaluating news and proposes that interface design can play a key role in promoting more effective search practices, serving as one component of a broader set of interventions to combat misinformation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_05146 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Query Smarter, Trust Better? Exploring Search Behaviours for Verifying News Accuracy Elsweiler, David Ateia, Samy Bink, Markus Donabauer, Gregor Pichel, Marcos Fernández Frummet, Alexander Kruschwitz, Udo Losada, David Ludwig, Bernd Meyer, Selina Presa, Noel Pascual Information Retrieval While it is often assumed that searching for information to evaluate misinformation will help identify false claims, recent work suggests that search behaviours can instead reinforce belief in misleading news, particularly when users generate queries using vocabulary from the source articles. Our research explores how different query generation strategies affect news verification and whether the way people search influences the accuracy of their information evaluation. A mixed-methods approach was used, consisting of three parts: (1) an analysis of existing data to understand how search behaviour influences trust in fake news, (2) a simulation of query generation strategies using a Large Language Model (LLM) to assess the impact of different query formulations on search result quality, and (3) a user study to examine how 'Boost' interventions in interface design can guide users to adopt more effective query strategies. The results show that search behaviour significantly affects trust in news, with successful searches involving multiple queries and yielding higher-quality results. Queries inspired by different parts of a news article produced search results of varying quality, and weak initial queries improved when reformulated using full SERP information. Although 'Boost' interventions had limited impact, the study suggests that interface design encouraging users to thoroughly review search results can enhance query formulation. This study highlights the importance of query strategies in evaluating news and proposes that interface design can play a key role in promoting more effective search practices, serving as one component of a broader set of interventions to combat misinformation. |
| title | Query Smarter, Trust Better? Exploring Search Behaviours for Verifying News Accuracy |
| topic | Information Retrieval |
| url | https://arxiv.org/abs/2504.05146 |