Embedding Compression in Recommender Systems: A Survey
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866909280400048128 |
|---|---|
| author | Li, Shiwei Guo, Huifeng Tang, Xing Tang, Ruiming Hou, Lu Li, Ruixuan Zhang, Rui |
| author_facet | Li, Shiwei Guo, Huifeng Tang, Xing Tang, Ruiming Hou, Lu Li, Ruixuan Zhang, Rui |
| contents | To alleviate the problem of information explosion, recommender systems are widely deployed to provide personalized information filtering services. Usually, embedding tables are employed in recommender systems to transform high-dimensional sparse one-hot vectors into dense real-valued embeddings. However, the embedding tables are huge and account for most of the parameters in industrial-scale recommender systems. In order to reduce memory costs and improve efficiency, various approaches are proposed to compress the embedding tables. In this survey, we provide a comprehensive review of embedding compression approaches in recommender systems. We first introduce deep learning recommendation models and the basic concept of embedding compression in recommender systems. Subsequently, we systematically organize existing approaches into three categories, namely low-precision, mixed-dimension, and weight-sharing, respectively. Lastly, we summarize the survey with some general suggestions and provide future prospects for this field. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_02304 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Embedding Compression in Recommender Systems: A Survey Li, Shiwei Guo, Huifeng Tang, Xing Tang, Ruiming Hou, Lu Li, Ruixuan Zhang, Rui Information Retrieval To alleviate the problem of information explosion, recommender systems are widely deployed to provide personalized information filtering services. Usually, embedding tables are employed in recommender systems to transform high-dimensional sparse one-hot vectors into dense real-valued embeddings. However, the embedding tables are huge and account for most of the parameters in industrial-scale recommender systems. In order to reduce memory costs and improve efficiency, various approaches are proposed to compress the embedding tables. In this survey, we provide a comprehensive review of embedding compression approaches in recommender systems. We first introduce deep learning recommendation models and the basic concept of embedding compression in recommender systems. Subsequently, we systematically organize existing approaches into three categories, namely low-precision, mixed-dimension, and weight-sharing, respectively. Lastly, we summarize the survey with some general suggestions and provide future prospects for this field. |
| title | Embedding Compression in Recommender Systems: A Survey |
| topic | Information Retrieval |
| url | https://arxiv.org/abs/2408.02304 |