BeFA: A General Behavior-driven Feature Adapter for Multimedia Recommendation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Fan, Qile, Yu, Penghang, Tan, Zhiyi, Bao, Bing-Kun, Lu, Guanming
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866916563291996160
author Fan, Qile
Yu, Penghang
Tan, Zhiyi
Bao, Bing-Kun
Lu, Guanming
author_facet Fan, Qile
Yu, Penghang
Tan, Zhiyi
Bao, Bing-Kun
Lu, Guanming
contents Multimedia recommender systems focus on utilizing behavioral information and content information to model user preferences. Typically, it employs pre-trained feature encoders to extract content features, then fuses them with behavioral features. However, pre-trained feature encoders often extract features from the entire content simultaneously, including excessive preference-irrelevant details. We speculate that it may result in the extracted features not containing sufficient features to accurately reflect user preferences. To verify our hypothesis, we introduce an attribution analysis method for visually and intuitively analyzing the content features. The results indicate that certain products' content features exhibit the issues of information drift}and information omission,reducing the expressive ability of features. Building upon this finding, we propose an effective and efficient general Behavior-driven Feature Adapter (BeFA) to tackle these issues. This adapter reconstructs the content feature with the guidance of behavioral information, enabling content features accurately reflecting user preferences. Extensive experiments demonstrate the effectiveness of the adapter across all multimedia recommendation methods. Our code is made publicly available on https://github.com/fqldom/BeFA.
format Preprint
id arxiv_https___arxiv_org_abs_2406_00323
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle BeFA: A General Behavior-driven Feature Adapter for Multimedia Recommendation
Fan, Qile
Yu, Penghang
Tan, Zhiyi
Bao, Bing-Kun
Lu, Guanming
Information Retrieval
Multimedia
Multimedia recommender systems focus on utilizing behavioral information and content information to model user preferences. Typically, it employs pre-trained feature encoders to extract content features, then fuses them with behavioral features. However, pre-trained feature encoders often extract features from the entire content simultaneously, including excessive preference-irrelevant details. We speculate that it may result in the extracted features not containing sufficient features to accurately reflect user preferences. To verify our hypothesis, we introduce an attribution analysis method for visually and intuitively analyzing the content features. The results indicate that certain products' content features exhibit the issues of information drift}and information omission,reducing the expressive ability of features. Building upon this finding, we propose an effective and efficient general Behavior-driven Feature Adapter (BeFA) to tackle these issues. This adapter reconstructs the content feature with the guidance of behavioral information, enabling content features accurately reflecting user preferences. Extensive experiments demonstrate the effectiveness of the adapter across all multimedia recommendation methods. Our code is made publicly available on https://github.com/fqldom/BeFA.
title BeFA: A General Behavior-driven Feature Adapter for Multimedia Recommendation
topic Information Retrieval
Multimedia
url https://arxiv.org/abs/2406.00323