Token-Efficient Item Representation via Images for LLM Recommender Systems

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kim, Kibum, Kim, Sein, Kang, Hongseok, Kim, Jiwan, Noh, Heewoong, In, Yeonjun, Yoon, Kanghoon, Oh, Jinoh, McAuley, Julian, Park, Chanyoung
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914358058024960
author Kim, Kibum
Kim, Sein
Kang, Hongseok
Kim, Jiwan
Noh, Heewoong
In, Yeonjun
Yoon, Kanghoon
Oh, Jinoh
McAuley, Julian
Park, Chanyoung
author_facet Kim, Kibum
Kim, Sein
Kang, Hongseok
Kim, Jiwan
Noh, Heewoong
In, Yeonjun
Yoon, Kanghoon
Oh, Jinoh
McAuley, Julian
Park, Chanyoung
contents Large Language Models (LLMs) have recently emerged as a powerful backbone for recommender systems. Existing LLM-based recommender systems take two different approaches for representing items in natural language, i.e., Attribute-based Representation and Description-based Representation. In this work, we aim to address the trade-off between efficiency and effectiveness that these two approaches encounter, when representing items consumed by users. Based on our interesting observation that there is a significant information overlap between images and descriptions associated with items, we propose a novel method, Item representation for LLM-based Recommender system (I-LLMRec). Our main idea is to leverage images as an alternative to lengthy textual descriptions for representing items, aiming at reducing token usage while preserving the rich semantic information of item descriptions. Through extensive experiments, we demonstrate that I-LLMRec outperforms existing methods in both efficiency and effectiveness by leveraging images. Moreover, a further appeal of I-LLMRec is its ability to reduce sensitivity to noise in descriptions, leading to more robust recommendations.
format Preprint
id arxiv_https___arxiv_org_abs_2503_06238
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Token-Efficient Item Representation via Images for LLM Recommender Systems
Kim, Kibum
Kim, Sein
Kang, Hongseok
Kim, Jiwan
Noh, Heewoong
In, Yeonjun
Yoon, Kanghoon
Oh, Jinoh
McAuley, Julian
Park, Chanyoung
Information Retrieval
Artificial Intelligence
Large Language Models (LLMs) have recently emerged as a powerful backbone for recommender systems. Existing LLM-based recommender systems take two different approaches for representing items in natural language, i.e., Attribute-based Representation and Description-based Representation. In this work, we aim to address the trade-off between efficiency and effectiveness that these two approaches encounter, when representing items consumed by users. Based on our interesting observation that there is a significant information overlap between images and descriptions associated with items, we propose a novel method, Item representation for LLM-based Recommender system (I-LLMRec). Our main idea is to leverage images as an alternative to lengthy textual descriptions for representing items, aiming at reducing token usage while preserving the rich semantic information of item descriptions. Through extensive experiments, we demonstrate that I-LLMRec outperforms existing methods in both efficiency and effectiveness by leveraging images. Moreover, a further appeal of I-LLMRec is its ability to reduce sensitivity to noise in descriptions, leading to more robust recommendations.
title Token-Efficient Item Representation via Images for LLM Recommender Systems
topic Information Retrieval
Artificial Intelligence
url https://arxiv.org/abs/2503.06238