Field Matters: A Lightweight LLM-enhanced Method for CTR Prediction
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914284305383424 |
|---|---|
| author | Cui, Yu Liu, Feng Chen, Jiawei Lou, Xingyu Zhang, Changwang Wang, Jun Sun, Yuegang Yang, Xiaohu Wang, Can |
| author_facet | Cui, Yu Liu, Feng Chen, Jiawei Lou, Xingyu Zhang, Changwang Wang, Jun Sun, Yuegang Yang, Xiaohu Wang, Can |
| contents | Click-through rate (CTR) prediction is a fundamental task in modern recommender systems. In recent years, the integration of large language models (LLMs) has been shown to effectively enhance the performance of traditional CTR methods. However, existing LLM-enhanced methods often require extensive processing of detailed textual descriptions for large-scale instances or user/item entities, leading to substantial computational overhead. To address this challenge, this work introduces LLaCTR, a novel and lightweight LLM-enhanced CTR method that employs a field-level enhancement paradigm. Specifically, LLaCTR first utilizes LLMs to distill crucial and lightweight semantic knowledge from small-scale feature fields through self-supervised field-feature fine-tuning. Subsequently, it leverages this field-level semantic knowledge to enhance both feature representation and feature interactions. In our experiments, we integrate LLaCTR with six representative CTR models across four datasets, demonstrating its superior performance in terms of both effectiveness and efficiency compared to existing LLM-enhanced methods. Our code is available at https://github.com/istarryn/LLaCTR. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_14057 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Field Matters: A Lightweight LLM-enhanced Method for CTR Prediction Cui, Yu Liu, Feng Chen, Jiawei Lou, Xingyu Zhang, Changwang Wang, Jun Sun, Yuegang Yang, Xiaohu Wang, Can Information Retrieval Artificial Intelligence Click-through rate (CTR) prediction is a fundamental task in modern recommender systems. In recent years, the integration of large language models (LLMs) has been shown to effectively enhance the performance of traditional CTR methods. However, existing LLM-enhanced methods often require extensive processing of detailed textual descriptions for large-scale instances or user/item entities, leading to substantial computational overhead. To address this challenge, this work introduces LLaCTR, a novel and lightweight LLM-enhanced CTR method that employs a field-level enhancement paradigm. Specifically, LLaCTR first utilizes LLMs to distill crucial and lightweight semantic knowledge from small-scale feature fields through self-supervised field-feature fine-tuning. Subsequently, it leverages this field-level semantic knowledge to enhance both feature representation and feature interactions. In our experiments, we integrate LLaCTR with six representative CTR models across four datasets, demonstrating its superior performance in terms of both effectiveness and efficiency compared to existing LLM-enhanced methods. Our code is available at https://github.com/istarryn/LLaCTR. |
| title | Field Matters: A Lightweight LLM-enhanced Method for CTR Prediction |
| topic | Information Retrieval Artificial Intelligence |
| url | https://arxiv.org/abs/2505.14057 |