UniSearch: Rethinking Search System with a Unified Generative Architecture
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916944169402368 |
|---|---|
| author | Chen, Jiahui Jiang, Xiaoze Wang, Zhibo Zhu, Quanzhi Zhao, Junyao Hu, Feng Pan, Kang Xie, Ao Pei, Maohua Qin, Zhiheng Zhang, Hongjing Zhai, Zhixin Guo, Xiaobo Zhou, Runbin Wang, Kefeng Geng, Mingyang Chen, Cheng Lv, Jingshan Huang, Yupeng Liang, Xiao Li, Han |
| author_facet | Chen, Jiahui Jiang, Xiaoze Wang, Zhibo Zhu, Quanzhi Zhao, Junyao Hu, Feng Pan, Kang Xie, Ao Pei, Maohua Qin, Zhiheng Zhang, Hongjing Zhai, Zhixin Guo, Xiaobo Zhou, Runbin Wang, Kefeng Geng, Mingyang Chen, Cheng Lv, Jingshan Huang, Yupeng Liang, Xiao Li, Han |
| contents | Modern search systems play a crucial role in facilitating information acquisition. Traditional search engines typically rely on a cascaded architecture, where results are retrieved through recall, pre-ranking, and ranking stages. The complexity of designing and maintaining multiple modules makes it difficult to achieve holistic performance gains. Recent advances in generative recommendation have motivated the exploration of unified generative search as an alternative. However, existing approaches are not genuinely end-to-end: they typically train an item encoder to tokenize candidates first and then optimize a generator separately, leading to objective inconsistency and limited generalization. To address these limitations, we propose UniSearch, a unified generative search framework for Kuaishou Search. UniSearch replaces the cascaded pipeline with an end-to-end architecture that integrates a Search Generator and a Video Encoder. The Generator produces semantic identifiers of relevant items given a user query, while the Video Encoder learns latent item embeddings and provides their tokenized representations. A unified training framework jointly optimizes both components, enabling mutual enhancement and improving representation quality and generation accuracy. Furthermore, we introduce Search Preference Optimization (SPO), which leverages a reward model and real user feedback to better align generation with user preferences. Extensive experiments on industrial-scale datasets, together with online A/B testing in both short-video and live search scenarios, demonstrate the strong effectiveness and deployment potential of UniSearch. Notably, its deployment in live search yields the largest single-experiment improvement in recent years of our product's history, highlighting its practical value for real-world applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_06887 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | UniSearch: Rethinking Search System with a Unified Generative Architecture Chen, Jiahui Jiang, Xiaoze Wang, Zhibo Zhu, Quanzhi Zhao, Junyao Hu, Feng Pan, Kang Xie, Ao Pei, Maohua Qin, Zhiheng Zhang, Hongjing Zhai, Zhixin Guo, Xiaobo Zhou, Runbin Wang, Kefeng Geng, Mingyang Chen, Cheng Lv, Jingshan Huang, Yupeng Liang, Xiao Li, Han Information Retrieval Modern search systems play a crucial role in facilitating information acquisition. Traditional search engines typically rely on a cascaded architecture, where results are retrieved through recall, pre-ranking, and ranking stages. The complexity of designing and maintaining multiple modules makes it difficult to achieve holistic performance gains. Recent advances in generative recommendation have motivated the exploration of unified generative search as an alternative. However, existing approaches are not genuinely end-to-end: they typically train an item encoder to tokenize candidates first and then optimize a generator separately, leading to objective inconsistency and limited generalization. To address these limitations, we propose UniSearch, a unified generative search framework for Kuaishou Search. UniSearch replaces the cascaded pipeline with an end-to-end architecture that integrates a Search Generator and a Video Encoder. The Generator produces semantic identifiers of relevant items given a user query, while the Video Encoder learns latent item embeddings and provides their tokenized representations. A unified training framework jointly optimizes both components, enabling mutual enhancement and improving representation quality and generation accuracy. Furthermore, we introduce Search Preference Optimization (SPO), which leverages a reward model and real user feedback to better align generation with user preferences. Extensive experiments on industrial-scale datasets, together with online A/B testing in both short-video and live search scenarios, demonstrate the strong effectiveness and deployment potential of UniSearch. Notably, its deployment in live search yields the largest single-experiment improvement in recent years of our product's history, highlighting its practical value for real-world applications. |
| title | UniSearch: Rethinking Search System with a Unified Generative Architecture |
| topic | Information Retrieval |
| url | https://arxiv.org/abs/2509.06887 |