Ideal Attribution and Faithful Watermarks for Language Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Song, Min Jae, Shahabi, Kameron
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908697654984704
author Song, Min Jae
Shahabi, Kameron
author_facet Song, Min Jae
Shahabi, Kameron
contents We introduce ideal attribution mechanisms, a formal abstraction for reasoning about attribution decisions over strings. At the core of this abstraction lies the ledger, an append-only log of the prompt-response interaction history between a model and its user. Each mechanism produces deterministic decisions based on the ledger and an explicit selection criterion, making it well-suited to serve as a ground truth for attribution. We frame the design goal of watermarking schemes as faithful representation of ideal attribution mechanisms. This novel perspective brings conceptual clarity, replacing piecemeal probabilistic statements with a unified language for stating the guarantees of each scheme. It also enables precise reasoning about desiderata for future watermarking schemes, even when no current construction achieves them, since the ideal functionalities are specified first. In this way, the framework provides a roadmap that clarifies which guarantees are attainable in an idealized setting and worth pursuing in practice.
format Preprint
id arxiv_https___arxiv_org_abs_2512_07038
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Ideal Attribution and Faithful Watermarks for Language Models
Song, Min Jae
Shahabi, Kameron
Cryptography and Security
Machine Learning
We introduce ideal attribution mechanisms, a formal abstraction for reasoning about attribution decisions over strings. At the core of this abstraction lies the ledger, an append-only log of the prompt-response interaction history between a model and its user. Each mechanism produces deterministic decisions based on the ledger and an explicit selection criterion, making it well-suited to serve as a ground truth for attribution. We frame the design goal of watermarking schemes as faithful representation of ideal attribution mechanisms. This novel perspective brings conceptual clarity, replacing piecemeal probabilistic statements with a unified language for stating the guarantees of each scheme. It also enables precise reasoning about desiderata for future watermarking schemes, even when no current construction achieves them, since the ideal functionalities are specified first. In this way, the framework provides a roadmap that clarifies which guarantees are attainable in an idealized setting and worth pursuing in practice.
title Ideal Attribution and Faithful Watermarks for Language Models
topic Cryptography and Security
Machine Learning
url https://arxiv.org/abs/2512.07038