Cover Image

WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Hou, Yufang, Pascale, Alessandra, Carnerero-Cano, Javier, Tchrakian, Tigran, Marinescu, Radu, Daly, Elizabeth, Padhi, Inkit, Sattigeri, Prasanna
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

FactReasoner: A Probabilistic Approach to Long-Form Factuality Assessment for Large Language Models
by: Marinescu, Radu, et al.
Published: (2025)

FactCorrector: A Graph-Inspired Approach to Long-Form Factuality Correction of Large Language Models
by: Carnerero-Cano, Javier, et al.
Published: (2026)

When in Doubt, Cascade: Towards Building Efficient and Capable Guardrails
by: Nagireddy, Manish, et al.
Published: (2024)

Answering the Wrong Question: Reasoning Trace Inversion for Abstention in LLMs
by: Gourabathina, Abinitha, et al.
Published: (2026)

Value Alignment from Unstructured Text
by: Padhi, Inkit, et al.
Published: (2024)

Comprehensiveness Metrics for Automatic Evaluation of Factual Recall in Text Generation
by: Dejl, Adam, et al.
Published: (2025)

WikiVQABench: A Knowledge-Grounded Visual Question Answering Benchmark from Wikipedia and Wikidata
by: Shbita, Basel, et al.
Published: (2026)

LLM-WikiRace Benchmark: How Far Can LLMs Plan over Real-World Knowledge Graphs?
by: Ziomek, Juliusz, et al.
Published: (2026)

Split, Unlearn, Merge: Leveraging Data Attributes for More Effective Unlearning in LLMs
by: Kadhe, Swanand Ravindra, et al.
Published: (2024)

Contextual Moral Value Alignment Through Context-Based Aggregation
by: Dognin, Pierre, et al.
Published: (2024)

Wikis und die Wikipedia verstehen
by: van Dijk, Ziko
Published: (2021)

Optimistic Exploration for Risk-Averse Constrained Reinforcement Learning
by: McCarthy, James, et al.
Published: (2025)

Wiki-Quantities and Wiki-Measurements: Datasets of Quantities and their Measurement Context from Wikipedia
by: Göpfert, Jan, et al.
Published: (2025)

WikiReaD (Wikipedia Readability Dataset)
by: Trokhymovych, Mykola, et al.
Published: (2024)

Where Knowledge Collides: A Mechanistic Study of Intra-Memory Knowledge Conflict in Language Models
by: Pham, Minh Vu, et al.
Published: (2026)

ViWikiFC: Fact-Checking for Vietnamese Wikipedia-Based Textual Knowledge Source
by: Le, Hung Tuan, et al.
Published: (2024)

HealthContradict: Evaluating Biomedical Knowledge Conflicts in Language Models
by: Zhang, Boya, et al.
Published: (2025)

The effect of Skyrme--Chern-Simons dynamics on gauged Skyrmions in $2+1$ dimensions
by: Navarro-Lerida, Francisco, et al.
Published: (2023)

Attractive and repulsive Yang-Mills--Higgs magnetic monopoles on $\mathbb{R}^3$
by: Navarro-Lérida, Francisco, et al.
Published: (2026)

WikiTexVC: MediaWiki's native LaTeX to MathML converter for Wikipedia
by: Stegmüller, Johannes, et al.
Published: (2024)

Web2Wiki: Characterizing Wikipedia Linking Across the Web
by: Veselovsky, Veniamin, et al.
Published: (2025)

Language Models in Dialogue: Conversational Maxims for Human-AI Interactions
by: Miehling, Erik, et al.
Published: (2024)

EvoWiki: Evaluating LLMs on Evolving Knowledge
by: Tang, Wei, et al.
Published: (2024)

Gauged Skyrme analogue of Chern-Pontryagin
by: Tchrakian, D. H.
Published: (2024)

DRIP-R: A Benchmark for Decision-Making and Reasoning Under Real-World Policy Ambiguity in the Retail Domain
by: Borkakoty, Hsuvas, et al.
Published: (2026)

Wiki-TabNER: Integrating Named Entity Recognition into Wikipedia Tables
by: Koleva, Aneta, et al.
Published: (2024)

Building a Foundational Guardrail for General Agentic Systems via Synthetic Data
by: Huang, Yue, et al.
Published: (2025)

Interpreting LLM-as-a-Judge Policies via Verifiable Global Explanations
by: Gajcin, Jasmina, et al.
Published: (2025)

WikiGap: Promoting Epistemic Equity by Surfacing Knowledge Gaps Between English Wikipedia and other Language Editions
by: Wang, Zining, et al.
Published: (2025)

WikiAutoGen: Towards Multi-Modal Wikipedia-Style Article Generation
by: Yang, Zhongyu, et al.
Published: (2025)

El proyecto Wiki Learning: Wikipedia como entorno de aprendizaje abierto
by: Paola Ricaurte-Quijano
Published: (2016)

WikiSQE: A Large-Scale Dataset for Sentence Quality Estimation in Wikipedia
by: Ando, Kenichiro, et al.
Published: (2023)

Final-Model-Only Data Attribution with a Unifying View of Gradient-Based Methods
by: Wei, Dennis, et al.
Published: (2024)

Wiki Live Challenge: Challenging Deep Research Agents with Expert-Level Wikipedia Articles
by: Wang, Shaohan, et al.
Published: (2026)

WikiTermBase: An AI-Augmented Term Base to Standardize Arabic Translation on Wikipedia
by: Bakni, Michel, et al.
Published: (2025)

LLMs in Wikipedia: Investigating How LLMs Impact Participation in Knowledge Communities
by: Zhou, Moyan, et al.
Published: (2025)

WikiBigEdit: Understanding the Limits of Lifelong Knowledge Editing in LLMs
by: Thede, Lukas, et al.
Published: (2025)

Foundation Model Sherpas: Guiding Foundation Models through Knowledge and Reasoning
by: Bhattacharjya, Debarun, et al.
Published: (2024)

Wikipedia is Not a Dictionary, Delete! Text Classification as a Proxy for Analysing Wiki Deletion Discussions
by: Borkakoty, Hsuvas, et al.
Published: (2025)

WikiChat: Stopping the Hallucination of Large Language Model Chatbots by Few-Shot Grounding on Wikipedia
by: Semnani, Sina J., et al.
Published: (2023)