Masked by Consensus: Disentangling Privileged Knowledge in LLM Correctness

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ashuach, Tomer, Gretz, Shai, Katz, Yoav, Belinkov, Yonatan, Ein-Dor, Liat
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911622386155520
author Ashuach, Tomer
Gretz, Shai
Katz, Yoav
Belinkov, Yonatan
Ein-Dor, Liat
author_facet Ashuach, Tomer
Gretz, Shai
Katz, Yoav
Belinkov, Yonatan
Ein-Dor, Liat
contents Humans use introspection to evaluate their understanding through private internal states inaccessible to external observers. We investigate whether large language models possess similar privileged knowledge about answer correctness, information unavailable through external observation. We train correctness classifiers on question representations from both a model's own hidden states and external models, testing whether self-representations provide a performance advantage. On standard evaluation, we find no advantage: self-probes perform comparably to peer-model probes. We hypothesize this is due to high inter-model agreement of answer correctness. To isolate genuine privileged knowledge, we evaluate on disagreement subsets, where models produce conflicting predictions. Here, we discover domain-specific privileged knowledge: self-representations consistently outperform peer representations in factual knowledge tasks, but show no advantage in math reasoning. We further localize this domain asymmetry across model layers, finding that the factual advantage emerges progressively from early-to-mid layers onward, consistent with model-specific memory retrieval, while math reasoning shows no consistent advantage at any depth.
format Preprint
id arxiv_https___arxiv_org_abs_2604_12373
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Masked by Consensus: Disentangling Privileged Knowledge in LLM Correctness
Ashuach, Tomer
Gretz, Shai
Katz, Yoav
Belinkov, Yonatan
Ein-Dor, Liat
Computation and Language
I.2.7
Humans use introspection to evaluate their understanding through private internal states inaccessible to external observers. We investigate whether large language models possess similar privileged knowledge about answer correctness, information unavailable through external observation. We train correctness classifiers on question representations from both a model's own hidden states and external models, testing whether self-representations provide a performance advantage. On standard evaluation, we find no advantage: self-probes perform comparably to peer-model probes. We hypothesize this is due to high inter-model agreement of answer correctness. To isolate genuine privileged knowledge, we evaluate on disagreement subsets, where models produce conflicting predictions. Here, we discover domain-specific privileged knowledge: self-representations consistently outperform peer representations in factual knowledge tasks, but show no advantage in math reasoning. We further localize this domain asymmetry across model layers, finding that the factual advantage emerges progressively from early-to-mid layers onward, consistent with model-specific memory retrieval, while math reasoning shows no consistent advantage at any depth.
title Masked by Consensus: Disentangling Privileged Knowledge in LLM Correctness
topic Computation and Language
I.2.7
url https://arxiv.org/abs/2604.12373