ESANS: Effective and Semantic-Aware Negative Sampling for Large-Scale Retrieval Systems
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866917933995786240 |
|---|---|
| author | Xing, Haibo Matsuyama, Kanefumi Deng, Hao Hu, Jinxin Zhang, Yu Zeng, Xiaoyi |
| author_facet | Xing, Haibo Matsuyama, Kanefumi Deng, Hao Hu, Jinxin Zhang, Yu Zeng, Xiaoyi |
| contents | Industrial recommendation systems typically involve a two-stage process: retrieval and ranking, which aims to match users with millions of items. In the retrieval stage, classic embedding-based retrieval (EBR) methods depend on effective negative sampling techniques to enhance both performance and efficiency. However, existing techniques often suffer from false negatives, high cost for ensuring sampling quality and semantic information deficiency. To address these limitations, we propose Effective and Semantic-Aware Negative Sampling (ESANS), which integrates two key components: Effective Dense Interpolation Strategy (EDIS) and Multimodal Semantic-Aware Clustering (MSAC). EDIS generates virtual samples within the low-dimensional embedding space to improve the diversity and density of the sampling distribution while minimizing computational costs. MSAC refines the negative sampling distribution by hierarchically clustering item representations based on multimodal information (visual, textual, behavioral), ensuring semantic consistency and reducing false negatives. Extensive offline and online experiments demonstrate the superior efficiency and performance of ESANS. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_16077 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | ESANS: Effective and Semantic-Aware Negative Sampling for Large-Scale Retrieval Systems Xing, Haibo Matsuyama, Kanefumi Deng, Hao Hu, Jinxin Zhang, Yu Zeng, Xiaoyi Information Retrieval H.3.3 Industrial recommendation systems typically involve a two-stage process: retrieval and ranking, which aims to match users with millions of items. In the retrieval stage, classic embedding-based retrieval (EBR) methods depend on effective negative sampling techniques to enhance both performance and efficiency. However, existing techniques often suffer from false negatives, high cost for ensuring sampling quality and semantic information deficiency. To address these limitations, we propose Effective and Semantic-Aware Negative Sampling (ESANS), which integrates two key components: Effective Dense Interpolation Strategy (EDIS) and Multimodal Semantic-Aware Clustering (MSAC). EDIS generates virtual samples within the low-dimensional embedding space to improve the diversity and density of the sampling distribution while minimizing computational costs. MSAC refines the negative sampling distribution by hierarchically clustering item representations based on multimodal information (visual, textual, behavioral), ensuring semantic consistency and reducing false negatives. Extensive offline and online experiments demonstrate the superior efficiency and performance of ESANS. |
| title | ESANS: Effective and Semantic-Aware Negative Sampling for Large-Scale Retrieval Systems |
| topic | Information Retrieval H.3.3 |
| url | https://arxiv.org/abs/2502.16077 |