Scaling User Modeling: Large-scale Online User Representations for Ads Personalization in Meta
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2023
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866911884250185728 |
|---|---|
| author | Zhang, Wei Li, Dai Liang, Chen Zhou, Fang Zhang, Zhongke Wang, Xuewei Li, Ru Zhou, Yi Huang, Yaning Liang, Dong Wang, Kai Wang, Zhangyuan Chen, Zhengxing Wu, Fenggang Chen, Minghai Li, Huayu Wu, Yunnan Shu, Zhan Yuan, Mindi Reddy, Sri |
| author_facet | Zhang, Wei Li, Dai Liang, Chen Zhou, Fang Zhang, Zhongke Wang, Xuewei Li, Ru Zhou, Yi Huang, Yaning Liang, Dong Wang, Kai Wang, Zhangyuan Chen, Zhengxing Wu, Fenggang Chen, Minghai Li, Huayu Wu, Yunnan Shu, Zhan Yuan, Mindi Reddy, Sri |
| contents | Effective user representations are pivotal in personalized advertising. However, stringent constraints on training throughput, serving latency, and memory, often limit the complexity and input feature set of online ads ranking models. This challenge is magnified in extensive systems like Meta's, which encompass hundreds of models with diverse specifications, rendering the tailoring of user representation learning for each model impractical. To address these challenges, we present Scaling User Modeling (SUM), a framework widely deployed in Meta's ads ranking system, designed to facilitate efficient and scalable sharing of online user representation across hundreds of ads models. SUM leverages a few designated upstream user models to synthesize user embeddings from massive amounts of user features with advanced modeling techniques. These embeddings then serve as inputs to downstream online ads ranking models, promoting efficient representation sharing. To adapt to the dynamic nature of user features and ensure embedding freshness, we designed SUM Online Asynchronous Platform (SOAP), a latency free online serving system complemented with model freshness and embedding stabilization, which enables frequent user model updates and online inference of user embeddings upon each user request. We share our hands-on deployment experiences for the SUM framework and validate its superiority through comprehensive experiments. To date, SUM has been launched to hundreds of ads ranking models in Meta, processing hundreds of billions of user requests daily, yielding significant online metric gains and improved infrastructure efficiency. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2311_09544 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Scaling User Modeling: Large-scale Online User Representations for Ads Personalization in Meta Zhang, Wei Li, Dai Liang, Chen Zhou, Fang Zhang, Zhongke Wang, Xuewei Li, Ru Zhou, Yi Huang, Yaning Liang, Dong Wang, Kai Wang, Zhangyuan Chen, Zhengxing Wu, Fenggang Chen, Minghai Li, Huayu Wu, Yunnan Shu, Zhan Yuan, Mindi Reddy, Sri Information Retrieval Artificial Intelligence Machine Learning 68T05, 68T30 I.2.1; H.3.5; H.3.3 Effective user representations are pivotal in personalized advertising. However, stringent constraints on training throughput, serving latency, and memory, often limit the complexity and input feature set of online ads ranking models. This challenge is magnified in extensive systems like Meta's, which encompass hundreds of models with diverse specifications, rendering the tailoring of user representation learning for each model impractical. To address these challenges, we present Scaling User Modeling (SUM), a framework widely deployed in Meta's ads ranking system, designed to facilitate efficient and scalable sharing of online user representation across hundreds of ads models. SUM leverages a few designated upstream user models to synthesize user embeddings from massive amounts of user features with advanced modeling techniques. These embeddings then serve as inputs to downstream online ads ranking models, promoting efficient representation sharing. To adapt to the dynamic nature of user features and ensure embedding freshness, we designed SUM Online Asynchronous Platform (SOAP), a latency free online serving system complemented with model freshness and embedding stabilization, which enables frequent user model updates and online inference of user embeddings upon each user request. We share our hands-on deployment experiences for the SUM framework and validate its superiority through comprehensive experiments. To date, SUM has been launched to hundreds of ads ranking models in Meta, processing hundreds of billions of user requests daily, yielding significant online metric gains and improved infrastructure efficiency. |
| title | Scaling User Modeling: Large-scale Online User Representations for Ads Personalization in Meta |
| topic | Information Retrieval Artificial Intelligence Machine Learning 68T05, 68T30 I.2.1; H.3.5; H.3.3 |
| url | https://arxiv.org/abs/2311.09544 |