Rewrite-to-Rank: Optimizing Ad Visibility via Retrieval-Aware Text Rewriting

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ho, Chloe, Singh, Ishneet Sukhvinder, Sharma, Diya, Anumandla, Tanvi Reddy, Lu, Michael, Sharma, Vasu, Zhu, Kevin
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915416300847104
author Ho, Chloe
Singh, Ishneet Sukhvinder
Sharma, Diya
Anumandla, Tanvi Reddy
Lu, Michael
Sharma, Vasu
Zhu, Kevin
author_facet Ho, Chloe
Singh, Ishneet Sukhvinder
Sharma, Diya
Anumandla, Tanvi Reddy
Lu, Michael
Sharma, Vasu
Zhu, Kevin
contents Search algorithms and user query relevance have given LLMs the ability to return relevant information, but the effect of content phrasing on ad visibility remains underexplored. We investigate how LLM-based rewriting of advertisements can improve their ranking in retrieval systems and inclusion in generated LLM responses, without modifying the retrieval model itself. We introduce a supervised fine-tuning framework with a custom loss balancing semantic relevance and content fidelity. To evaluate effectiveness, we propose two metrics: DeltaMRR@K (ranking improvement) and DeltaDIR@K (inclusion frequency improvement). Our approach presents a scalable method to optimize ad phrasing, enhancing visibility in retrieval-based LLM workflows. Experiments across both instruction-based and few-shot prompting demonstrate that PPO trained models outperform both prompt engineering and supervised fine-tuning in most cases, achieving up to a 2.79 DeltaDIR@5 and 0.0073 DeltaMRR@5 in instruction-based prompting. These results highlight the importance of how the ad is written before retrieval and prompt format and reinforcement learning in effective ad rewriting for LLM integrated retrieval systems.
format Preprint
id arxiv_https___arxiv_org_abs_2507_21099
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Rewrite-to-Rank: Optimizing Ad Visibility via Retrieval-Aware Text Rewriting
Ho, Chloe
Singh, Ishneet Sukhvinder
Sharma, Diya
Anumandla, Tanvi Reddy
Lu, Michael
Sharma, Vasu
Zhu, Kevin
Computation and Language
Search algorithms and user query relevance have given LLMs the ability to return relevant information, but the effect of content phrasing on ad visibility remains underexplored. We investigate how LLM-based rewriting of advertisements can improve their ranking in retrieval systems and inclusion in generated LLM responses, without modifying the retrieval model itself. We introduce a supervised fine-tuning framework with a custom loss balancing semantic relevance and content fidelity. To evaluate effectiveness, we propose two metrics: DeltaMRR@K (ranking improvement) and DeltaDIR@K (inclusion frequency improvement). Our approach presents a scalable method to optimize ad phrasing, enhancing visibility in retrieval-based LLM workflows. Experiments across both instruction-based and few-shot prompting demonstrate that PPO trained models outperform both prompt engineering and supervised fine-tuning in most cases, achieving up to a 2.79 DeltaDIR@5 and 0.0073 DeltaMRR@5 in instruction-based prompting. These results highlight the importance of how the ad is written before retrieval and prompt format and reinforcement learning in effective ad rewriting for LLM integrated retrieval systems.
title Rewrite-to-Rank: Optimizing Ad Visibility via Retrieval-Aware Text Rewriting
topic Computation and Language
url https://arxiv.org/abs/2507.21099