CAMMSR: Category-Guided Attentive Mixture of Experts for Multimodal Sequential Recommendation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Xu, Jinfeng, Chen, Zheyu, Yang, Shuo, Li, Jinze, Wang, Hewei, Li, Yijie, Tang, Jianheng, Liu, Yunhuai, Ngai, Edith C. H.
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914368726237184
author Xu, Jinfeng
Chen, Zheyu
Yang, Shuo
Li, Jinze
Wang, Hewei
Li, Yijie
Tang, Jianheng
Liu, Yunhuai
Ngai, Edith C. H.
author_facet Xu, Jinfeng
Chen, Zheyu
Yang, Shuo
Li, Jinze
Wang, Hewei
Li, Yijie
Tang, Jianheng
Liu, Yunhuai
Ngai, Edith C. H.
contents The explosion of multimedia data in information-rich environments has intensified the challenges of personalized content discovery, positioning recommendation systems as an essential form of passive data management. Multimodal sequential recommendation, which leverages diverse item information such as text and images, has shown great promise in enriching item representations and deepening the understanding of user interests. However, most existing models rely on heuristic fusion strategies that fail to capture the dynamic and context-sensitive nature of user-modal interactions. In real-world scenarios, user preferences for modalities vary not only across individuals but also within the same user across different items or categories. Moreover, the synergistic effects between modalities-where combined signals trigger user interest in ways isolated modalities cannot-remain largely underexplored. To this end, we propose CAMMSR, a Category-guided Attentive Mixture of Experts model for Multimodal Sequential Recommendation. At its core, CAMMSR introduces a category-guided attentive mixture of experts (CAMoE) module, which learns specialized item representations from multiple perspectives and explicitly models inter-modal synergies. This component dynamically allocates modality weights guided by an auxiliary category prediction task, enabling adaptive fusion of multimodal signals. Additionally, we design a modality swap contrastive learning task to enhance cross-modal representation alignment through sequence-level augmentation. Extensive experiments on four public datasets demonstrate that CAMMSR consistently outperforms state-of-the-art baselines, validating its effectiveness in achieving adaptive, synergistic, and user-centric multimodal sequential recommendation.
format Preprint
id arxiv_https___arxiv_org_abs_2603_04320
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle CAMMSR: Category-Guided Attentive Mixture of Experts for Multimodal Sequential Recommendation
Xu, Jinfeng
Chen, Zheyu
Yang, Shuo
Li, Jinze
Wang, Hewei
Li, Yijie
Tang, Jianheng
Liu, Yunhuai
Ngai, Edith C. H.
Information Retrieval
Multimedia
The explosion of multimedia data in information-rich environments has intensified the challenges of personalized content discovery, positioning recommendation systems as an essential form of passive data management. Multimodal sequential recommendation, which leverages diverse item information such as text and images, has shown great promise in enriching item representations and deepening the understanding of user interests. However, most existing models rely on heuristic fusion strategies that fail to capture the dynamic and context-sensitive nature of user-modal interactions. In real-world scenarios, user preferences for modalities vary not only across individuals but also within the same user across different items or categories. Moreover, the synergistic effects between modalities-where combined signals trigger user interest in ways isolated modalities cannot-remain largely underexplored. To this end, we propose CAMMSR, a Category-guided Attentive Mixture of Experts model for Multimodal Sequential Recommendation. At its core, CAMMSR introduces a category-guided attentive mixture of experts (CAMoE) module, which learns specialized item representations from multiple perspectives and explicitly models inter-modal synergies. This component dynamically allocates modality weights guided by an auxiliary category prediction task, enabling adaptive fusion of multimodal signals. Additionally, we design a modality swap contrastive learning task to enhance cross-modal representation alignment through sequence-level augmentation. Extensive experiments on four public datasets demonstrate that CAMMSR consistently outperforms state-of-the-art baselines, validating its effectiveness in achieving adaptive, synergistic, and user-centric multimodal sequential recommendation.
title CAMMSR: Category-Guided Attentive Mixture of Experts for Multimodal Sequential Recommendation
topic Information Retrieval
Multimedia
url https://arxiv.org/abs/2603.04320