LLM-KT: A Versatile Framework for Knowledge Transfer from Large Language Models to Collaborative Filtering
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910680673681408 |
|---|---|
| author | Severin, Nikita Ziablitsev, Aleksei Savelyeva, Yulia Tashchilin, Valeriy Bulychev, Ivan Yushkov, Mikhail Kushneruk, Artem Zaryvnykh, Amaliya Kiselev, Dmitrii Savchenko, Andrey Makarov, Ilya |
| author_facet | Severin, Nikita Ziablitsev, Aleksei Savelyeva, Yulia Tashchilin, Valeriy Bulychev, Ivan Yushkov, Mikhail Kushneruk, Artem Zaryvnykh, Amaliya Kiselev, Dmitrii Savchenko, Andrey Makarov, Ilya |
| contents | We present LLM-KT, a flexible framework designed to enhance collaborative filtering (CF) models by seamlessly integrating LLM (Large Language Model)-generated features. Unlike existing methods that rely on passing LLM-generated features as direct inputs, our framework injects these features into an intermediate layer of any CF model, allowing the model to reconstruct and leverage the embeddings internally. This model-agnostic approach works with a wide range of CF models without requiring architectural changes, making it adaptable to various recommendation scenarios. Our framework is built for easy integration and modification, providing researchers and developers with a powerful tool for extending CF model capabilities through efficient knowledge transfer. We demonstrate its effectiveness through experiments on the MovieLens and Amazon datasets, where it consistently improves baseline CF models. Experimental studies showed that LLM-KT is competitive with the state-of-the-art methods in context-aware settings but can be applied to a broader range of CF models than current approaches. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_00556 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | LLM-KT: A Versatile Framework for Knowledge Transfer from Large Language Models to Collaborative Filtering Severin, Nikita Ziablitsev, Aleksei Savelyeva, Yulia Tashchilin, Valeriy Bulychev, Ivan Yushkov, Mikhail Kushneruk, Artem Zaryvnykh, Amaliya Kiselev, Dmitrii Savchenko, Andrey Makarov, Ilya Information Retrieval Artificial Intelligence We present LLM-KT, a flexible framework designed to enhance collaborative filtering (CF) models by seamlessly integrating LLM (Large Language Model)-generated features. Unlike existing methods that rely on passing LLM-generated features as direct inputs, our framework injects these features into an intermediate layer of any CF model, allowing the model to reconstruct and leverage the embeddings internally. This model-agnostic approach works with a wide range of CF models without requiring architectural changes, making it adaptable to various recommendation scenarios. Our framework is built for easy integration and modification, providing researchers and developers with a powerful tool for extending CF model capabilities through efficient knowledge transfer. We demonstrate its effectiveness through experiments on the MovieLens and Amazon datasets, where it consistently improves baseline CF models. Experimental studies showed that LLM-KT is competitive with the state-of-the-art methods in context-aware settings but can be applied to a broader range of CF models than current approaches. |
| title | LLM-KT: A Versatile Framework for Knowledge Transfer from Large Language Models to Collaborative Filtering |
| topic | Information Retrieval Artificial Intelligence |
| url | https://arxiv.org/abs/2411.00556 |