HyperZero: A Customized End-to-End Auto-Tuning System for Recommendation with Hourly Feedback

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Cai, Xufeng, Guan, Ziwei, Yuan, Lei, Aydin, Ali Selman, Xu, Tengyu, Liu, Boying, Ren, Wenbo, Xiang, Renkai, He, Songyi, Yang, Haichuan, Li, Serena, Gao, Mingze, Weng, Yue, Liu, Ji
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915129294061568
author Cai, Xufeng
Guan, Ziwei
Yuan, Lei
Aydin, Ali Selman
Xu, Tengyu
Liu, Boying
Ren, Wenbo
Xiang, Renkai
He, Songyi
Yang, Haichuan
Li, Serena
Gao, Mingze
Weng, Yue
Liu, Ji
author_facet Cai, Xufeng
Guan, Ziwei
Yuan, Lei
Aydin, Ali Selman
Xu, Tengyu
Liu, Boying
Ren, Wenbo
Xiang, Renkai
He, Songyi
Yang, Haichuan
Li, Serena
Gao, Mingze
Weng, Yue
Liu, Ji
contents Modern recommendation systems can be broadly divided into two key stages: the ranking stage, where the system predicts various user engagements (e.g., click-through rate, like rate, follow rate, watch time), and the value model stage, which aggregates these predictive scores through a function (e.g., a linear combination defined by a weight vector) to measure the value of each content by a single numerical score. Both stages play roughly equally important roles in real industrial systems; however, how to optimize the model weights for the second stage still lacks systematic study. This paper focuses on optimizing the second stage through auto-tuning technology. Although general auto-tuning systems and solutions - both from established production practices and open-source solutions - can address this problem, they typically require weeks or even months to identify a feasible solution. Such prolonged tuning processes are unacceptable in production environments for recommendation systems, as suboptimal value models can severely degrade user experience. An effective auto-tuning solution is required to identify a viable model within 2-3 days, rather than the extended timelines typically associated with existing approaches. In this paper, we introduce a practical auto-tuning system named HyperZero that addresses these time constraints while effectively solving the unique challenges inherent in modern recommendation systems. Moreover, this framework has the potential to be expanded to broader tuning tasks within recommendation systems.
format Preprint
id arxiv_https___arxiv_org_abs_2501_18126
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle HyperZero: A Customized End-to-End Auto-Tuning System for Recommendation with Hourly Feedback
Cai, Xufeng
Guan, Ziwei
Yuan, Lei
Aydin, Ali Selman
Xu, Tengyu
Liu, Boying
Ren, Wenbo
Xiang, Renkai
He, Songyi
Yang, Haichuan
Li, Serena
Gao, Mingze
Weng, Yue
Liu, Ji
Information Retrieval
Machine Learning
Modern recommendation systems can be broadly divided into two key stages: the ranking stage, where the system predicts various user engagements (e.g., click-through rate, like rate, follow rate, watch time), and the value model stage, which aggregates these predictive scores through a function (e.g., a linear combination defined by a weight vector) to measure the value of each content by a single numerical score. Both stages play roughly equally important roles in real industrial systems; however, how to optimize the model weights for the second stage still lacks systematic study. This paper focuses on optimizing the second stage through auto-tuning technology. Although general auto-tuning systems and solutions - both from established production practices and open-source solutions - can address this problem, they typically require weeks or even months to identify a feasible solution. Such prolonged tuning processes are unacceptable in production environments for recommendation systems, as suboptimal value models can severely degrade user experience. An effective auto-tuning solution is required to identify a viable model within 2-3 days, rather than the extended timelines typically associated with existing approaches. In this paper, we introduce a practical auto-tuning system named HyperZero that addresses these time constraints while effectively solving the unique challenges inherent in modern recommendation systems. Moreover, this framework has the potential to be expanded to broader tuning tasks within recommendation systems.
title HyperZero: A Customized End-to-End Auto-Tuning System for Recommendation with Hourly Feedback
topic Information Retrieval
Machine Learning
url https://arxiv.org/abs/2501.18126