SELF: Surrogate-light Feature Selection with Large Language Models in Deep Recommender Systems
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866911125572943872 |
|---|---|
| author | Jia, Pengyue Du, Zhaocheng Wang, Yichao Zhao, Xiangyu Li, Xiaopeng Wang, Yuhao Liu, Qidong Guo, Huifeng Tang, Ruiming |
| author_facet | Jia, Pengyue Du, Zhaocheng Wang, Yichao Zhao, Xiangyu Li, Xiaopeng Wang, Yuhao Liu, Qidong Guo, Huifeng Tang, Ruiming |
| contents | Feature selection is crucial in recommender systems for improving model efficiency and predictive performance. Conventional approaches typically employ surrogate models-such as decision trees or neural networks-to estimate feature importance. However, their effectiveness is inherently constrained, as these models may struggle under suboptimal training conditions, including feature collinearity, high-dimensional sparsity, and insufficient data. In this paper, we propose SELF, an SurrogatE-Light Feature selection method for deep recommender systems. SELF integrates semantic reasoning from Large Language Models (LLMs) with task-specific learning from surrogate models. Specifically, LLMs first produce a semantically informed ranking of feature importance, which is subsequently refined by a surrogate model, effectively integrating general world knowledge with task-specific learning. Comprehensive experiments on three public datasets from real-world recommender platforms validate the effectiveness of SELF. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_08516 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | SELF: Surrogate-light Feature Selection with Large Language Models in Deep Recommender Systems Jia, Pengyue Du, Zhaocheng Wang, Yichao Zhao, Xiangyu Li, Xiaopeng Wang, Yuhao Liu, Qidong Guo, Huifeng Tang, Ruiming Information Retrieval Feature selection is crucial in recommender systems for improving model efficiency and predictive performance. Conventional approaches typically employ surrogate models-such as decision trees or neural networks-to estimate feature importance. However, their effectiveness is inherently constrained, as these models may struggle under suboptimal training conditions, including feature collinearity, high-dimensional sparsity, and insufficient data. In this paper, we propose SELF, an SurrogatE-Light Feature selection method for deep recommender systems. SELF integrates semantic reasoning from Large Language Models (LLMs) with task-specific learning from surrogate models. Specifically, LLMs first produce a semantically informed ranking of feature importance, which is subsequently refined by a surrogate model, effectively integrating general world knowledge with task-specific learning. Comprehensive experiments on three public datasets from real-world recommender platforms validate the effectiveness of SELF. |
| title | SELF: Surrogate-light Feature Selection with Large Language Models in Deep Recommender Systems |
| topic | Information Retrieval |
| url | https://arxiv.org/abs/2412.08516 |