A Hybrid Multimodal Deep Learning Framework for Intelligent Fashion Recommendation
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866917089998012416 |
|---|---|
| author | Kalashi, Kamand Teimourpour, Babak |
| author_facet | Kalashi, Kamand Teimourpour, Babak |
| contents | The rapid expansion of online fashion platforms has created an increasing demand for intelligent recommender systems capable of understanding both visual and textual cues. This paper proposes a hybrid multimodal deep learning framework for fashion recommendation that jointly addresses two key tasks: outfit compatibility prediction and complementary item retrieval. The model leverages the visual and textual encoders of the CLIP architecture to obtain joint latent representations of fashion items, which are then integrated into a unified feature vector and processed by a transformer encoder. For compatibility prediction, an "outfit token" is introduced to model the holistic relationships among items, achieving an AUC of 0.95 on the Polyvore dataset. For complementary item retrieval, a "target item token" representing the desired item description is used to retrieve compatible items, reaching an accuracy of 69.24% under the Fill-in-the-Blank (FITB) metric. The proposed approach demonstrates strong performance across both tasks, highlighting the effectiveness of multimodal learning for fashion recommendation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_07573 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | A Hybrid Multimodal Deep Learning Framework for Intelligent Fashion Recommendation Kalashi, Kamand Teimourpour, Babak Information Retrieval Computer Vision and Pattern Recognition 68T05 (Primary), 68T45, 68U35 (Secondary) I.2.10; H.3.3; I.5.4; I.2.6 The rapid expansion of online fashion platforms has created an increasing demand for intelligent recommender systems capable of understanding both visual and textual cues. This paper proposes a hybrid multimodal deep learning framework for fashion recommendation that jointly addresses two key tasks: outfit compatibility prediction and complementary item retrieval. The model leverages the visual and textual encoders of the CLIP architecture to obtain joint latent representations of fashion items, which are then integrated into a unified feature vector and processed by a transformer encoder. For compatibility prediction, an "outfit token" is introduced to model the holistic relationships among items, achieving an AUC of 0.95 on the Polyvore dataset. For complementary item retrieval, a "target item token" representing the desired item description is used to retrieve compatible items, reaching an accuracy of 69.24% under the Fill-in-the-Blank (FITB) metric. The proposed approach demonstrates strong performance across both tasks, highlighting the effectiveness of multimodal learning for fashion recommendation. |
| title | A Hybrid Multimodal Deep Learning Framework for Intelligent Fashion Recommendation |
| topic | Information Retrieval Computer Vision and Pattern Recognition 68T05 (Primary), 68T45, 68U35 (Secondary) I.2.10; H.3.3; I.5.4; I.2.6 |
| url | https://arxiv.org/abs/2511.07573 |