RecGPT-Mobile: On-Device Large Language Models for User Intent Understanding in Taobao Feed Recommendation
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866914534422216704 |
|---|---|
| author | Zhang, Bin Huang, Weipeng Wang, Dimin Zhu, Jialin Jiang, Yuning Wang, Zhaode Lv, Chengfei Wang, Jian Ma, Qichao Chen, Li Wu, Junqing Yu, Yipeng |
| author_facet | Zhang, Bin Huang, Weipeng Wang, Dimin Zhu, Jialin Jiang, Yuning Wang, Zhaode Lv, Chengfei Wang, Jian Ma, Qichao Chen, Li Wu, Junqing Yu, Yipeng |
| contents | Predicting a user's next search query from recent interaction behaviors is a critical problem in modern e-commerce systems, particularly in scenarios where user intent evolves rapidly. Large Language Models (LLMs) offer strong semantic reasoning capabilities and have recently been adopted to enhance training data construction for next-query prediction. However, due to resource constraints on mobile devices, existing applications are deployed on cloud servers, resulting in high inference costs. In this paper, we propose RecGPT-Mobile, a framework that designs a lightweight LLM-based intent understanding agent to improve recommendation quality in mobile e-commerce scenarios. By deploying LLMs directly on mobile devices, our approach can capture evolving interests of users more quickly and adjust the recommendation results in real time. Extensive offline analyses and online experiments demonstrate that our method significantly improves the accuracy of recommendation results, laying a practical path for LLM deployment in production-scale recommendation systems on mobile devices, as well as a scalable solution for integrating LLMs into real-world next-query prediction systems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2605_04726 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | RecGPT-Mobile: On-Device Large Language Models for User Intent Understanding in Taobao Feed Recommendation Zhang, Bin Huang, Weipeng Wang, Dimin Zhu, Jialin Jiang, Yuning Wang, Zhaode Lv, Chengfei Wang, Jian Ma, Qichao Chen, Li Wu, Junqing Yu, Yipeng Information Retrieval Predicting a user's next search query from recent interaction behaviors is a critical problem in modern e-commerce systems, particularly in scenarios where user intent evolves rapidly. Large Language Models (LLMs) offer strong semantic reasoning capabilities and have recently been adopted to enhance training data construction for next-query prediction. However, due to resource constraints on mobile devices, existing applications are deployed on cloud servers, resulting in high inference costs. In this paper, we propose RecGPT-Mobile, a framework that designs a lightweight LLM-based intent understanding agent to improve recommendation quality in mobile e-commerce scenarios. By deploying LLMs directly on mobile devices, our approach can capture evolving interests of users more quickly and adjust the recommendation results in real time. Extensive offline analyses and online experiments demonstrate that our method significantly improves the accuracy of recommendation results, laying a practical path for LLM deployment in production-scale recommendation systems on mobile devices, as well as a scalable solution for integrating LLMs into real-world next-query prediction systems. |
| title | RecGPT-Mobile: On-Device Large Language Models for User Intent Understanding in Taobao Feed Recommendation |
| topic | Information Retrieval |
| url | https://arxiv.org/abs/2605.04726 |