Detecting RAG Advertisements Across Advertising Styles

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Heineking, Sebastian, Pertsch, Wilhelm, Zelch, Ines, Bevendorff, Janek, Stein, Benno, Hagen, Matthias, Potthast, Martin
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908948810956800
author Heineking, Sebastian
Pertsch, Wilhelm
Zelch, Ines
Bevendorff, Janek
Stein, Benno
Hagen, Matthias
Potthast, Martin
author_facet Heineking, Sebastian
Pertsch, Wilhelm
Zelch, Ines
Bevendorff, Janek
Stein, Benno
Hagen, Matthias
Potthast, Martin
contents Large language models (LLMs) enable a new form of advertising for retrieval-augmented generation (RAG) systems in which organic responses are blended with contextually relevant ads. The prospect of such "generated native ads" has sparked interest in whether they can be detected automatically. Existing datasets, however, do not reflect the diversity of advertising styles discussed in the marketing literature. In this paper, we (1) develop a taxonomy of advertising styles for LLMs, combining the style dimensions of explicitness and type of appeal, (2) simulate that advertisers may attempt to evade detection by changing their advertising style, and (3) evaluate a variety of ad-detection approaches with respect to their robustness under these changes. Expanding previous work on ad detection, we train models that use entity recognition to exactly locate an ad in an LLM response and find them to be both very effective at detecting responses with ads and largely robust to changes in the advertising style. Since ad blocking will be performed on low-resource end-user devices, we include lightweight models like random forests and SVMs in our evaluation. These models, however, are brittle under such changes, highlighting the need for further efficiency-oriented research for a practical approach to blocking of generated ads.
format Preprint
id arxiv_https___arxiv_org_abs_2603_04925
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Detecting RAG Advertisements Across Advertising Styles
Heineking, Sebastian
Pertsch, Wilhelm
Zelch, Ines
Bevendorff, Janek
Stein, Benno
Hagen, Matthias
Potthast, Martin
Information Retrieval
Large language models (LLMs) enable a new form of advertising for retrieval-augmented generation (RAG) systems in which organic responses are blended with contextually relevant ads. The prospect of such "generated native ads" has sparked interest in whether they can be detected automatically. Existing datasets, however, do not reflect the diversity of advertising styles discussed in the marketing literature. In this paper, we (1) develop a taxonomy of advertising styles for LLMs, combining the style dimensions of explicitness and type of appeal, (2) simulate that advertisers may attempt to evade detection by changing their advertising style, and (3) evaluate a variety of ad-detection approaches with respect to their robustness under these changes. Expanding previous work on ad detection, we train models that use entity recognition to exactly locate an ad in an LLM response and find them to be both very effective at detecting responses with ads and largely robust to changes in the advertising style. Since ad blocking will be performed on low-resource end-user devices, we include lightweight models like random forests and SVMs in our evaluation. These models, however, are brittle under such changes, highlighting the need for further efficiency-oriented research for a practical approach to blocking of generated ads.
title Detecting RAG Advertisements Across Advertising Styles
topic Information Retrieval
url https://arxiv.org/abs/2603.04925