Towards Practical Large-scale Dynamical Heterogeneous Graph Embedding: Cold-start Resilient Recommendation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Long, Mabiao, Liu, Jiaxi, Li, Yufeng, Xiong, Hao, Yan, Junchi, Wang, Kefan, Cao, Yi, Ding, Jiandong
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866918248964947968
author Long, Mabiao
Liu, Jiaxi
Li, Yufeng
Xiong, Hao
Yan, Junchi
Wang, Kefan
Cao, Yi
Ding, Jiandong
author_facet Long, Mabiao
Liu, Jiaxi
Li, Yufeng
Xiong, Hao
Yan, Junchi
Wang, Kefan
Cao, Yi
Ding, Jiandong
contents Deploying dynamic heterogeneous graph embeddings in production faces key challenges of scalability, data freshness, and cold-start. This paper introduces a practical, two-stage solution that balances deep graph representation with low-latency incremental updates. Our framework combines HetSGFormer, a scalable graph transformer for static learning, with Incremental Locally Linear Embedding (ILLE), a lightweight, CPU-based algorithm for real-time updates. HetSGFormer captures global structure with linear scalability, while ILLE provides rapid, targeted updates to incorporate new data, thus avoiding costly full retraining. This dual approach is cold-start resilient, leveraging the graph to create meaningful embeddings from sparse data. On billion-scale graphs, A/B tests show HetSGFormer achieved up to a 6.11% lift in Advertiser Value over previous methods, while the ILLE module added another 3.22% lift and improved embedding refresh timeliness by 83.2%. Our work provides a validated framework for deploying dynamic graph learning in production environments.
format Preprint
id arxiv_https___arxiv_org_abs_2512_13120
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Towards Practical Large-scale Dynamical Heterogeneous Graph Embedding: Cold-start Resilient Recommendation
Long, Mabiao
Liu, Jiaxi
Li, Yufeng
Xiong, Hao
Yan, Junchi
Wang, Kefan
Cao, Yi
Ding, Jiandong
Information Retrieval
Machine Learning
Deploying dynamic heterogeneous graph embeddings in production faces key challenges of scalability, data freshness, and cold-start. This paper introduces a practical, two-stage solution that balances deep graph representation with low-latency incremental updates. Our framework combines HetSGFormer, a scalable graph transformer for static learning, with Incremental Locally Linear Embedding (ILLE), a lightweight, CPU-based algorithm for real-time updates. HetSGFormer captures global structure with linear scalability, while ILLE provides rapid, targeted updates to incorporate new data, thus avoiding costly full retraining. This dual approach is cold-start resilient, leveraging the graph to create meaningful embeddings from sparse data. On billion-scale graphs, A/B tests show HetSGFormer achieved up to a 6.11% lift in Advertiser Value over previous methods, while the ILLE module added another 3.22% lift and improved embedding refresh timeliness by 83.2%. Our work provides a validated framework for deploying dynamic graph learning in production environments.
title Towards Practical Large-scale Dynamical Heterogeneous Graph Embedding: Cold-start Resilient Recommendation
topic Information Retrieval
Machine Learning
url https://arxiv.org/abs/2512.13120