Peer Prediction with More Signals than Reports

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Frongillo, Rafael, Kash, Ian, Monroe, Mary
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914421863874560
author Frongillo, Rafael
Kash, Ian
Monroe, Mary
author_facet Frongillo, Rafael
Kash, Ian
Monroe, Mary
contents Peer prediction mechanisms are typically proposed and analyzed under the assumption that the report and signal spaces are identical. In practice, however, agents often observe richer information which they then map to a coarser report space. Motivated by this discrepancy between theory and practice, we initiate the study of peer prediction mechanisms with signal spaces that are richer than the report space. We begin by formalizing a model with real-valued signals and binary reports. In this setting, it is natural to study symmetric threshold strategies, where agents map their signals to binary reports according to a single real-valued threshold. For several well-known binary-report peer prediction mechanisms, we show that most equilibria under the original assumption of binary signals are no longer equilibria in our model. Furthermore, dynamic analysis proves that some of the remaining thresholds are unstable. These results extend beyond real-valued signals and binary reports to settings where the signal space is finer-grained than the report space. While the results above suggest important limitations for the deployment of existing peer prediction mechanisms in practice, we also use them to develop a new, more robust mechanism. This mechanism generates a larger number of stable threshold equilibria under our model, thus allowing the designer more flexibility in choosing how agents map their signals to reports.
format Preprint
id arxiv_https___arxiv_org_abs_2503_16280
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Peer Prediction with More Signals than Reports
Frongillo, Rafael
Kash, Ian
Monroe, Mary
Computer Science and Game Theory
Peer prediction mechanisms are typically proposed and analyzed under the assumption that the report and signal spaces are identical. In practice, however, agents often observe richer information which they then map to a coarser report space. Motivated by this discrepancy between theory and practice, we initiate the study of peer prediction mechanisms with signal spaces that are richer than the report space. We begin by formalizing a model with real-valued signals and binary reports. In this setting, it is natural to study symmetric threshold strategies, where agents map their signals to binary reports according to a single real-valued threshold. For several well-known binary-report peer prediction mechanisms, we show that most equilibria under the original assumption of binary signals are no longer equilibria in our model. Furthermore, dynamic analysis proves that some of the remaining thresholds are unstable. These results extend beyond real-valued signals and binary reports to settings where the signal space is finer-grained than the report space. While the results above suggest important limitations for the deployment of existing peer prediction mechanisms in practice, we also use them to develop a new, more robust mechanism. This mechanism generates a larger number of stable threshold equilibria under our model, thus allowing the designer more flexibility in choosing how agents map their signals to reports.
title Peer Prediction with More Signals than Reports
topic Computer Science and Game Theory
url https://arxiv.org/abs/2503.16280