Leveraging OpenFlamingo for Multimodal Embedding Analysis of C2C Car Parts Data
Fuente:
arXiv
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916659418103808 |
|---|---|
| author | Rashid, Maisha Binte Rivas, Pablo |
| author_facet | Rashid, Maisha Binte Rivas, Pablo |
| contents | In this paper, we aim to investigate the capabilities of multimodal machine learning models, particularly the OpenFlamingo model, in processing a large-scale dataset of consumer-to-consumer (C2C) online posts related to car parts. We have collected data from two platforms, OfferUp and Craigslist, resulting in a dataset of over 1.2 million posts with their corresponding images. The OpenFlamingo model was used to extract embeddings for the text and image of each post. We used $k$-means clustering on the joint embeddings to identify underlying patterns and commonalities among the posts. We have found that most clusters contain a pattern, but some clusters showed no internal patterns. The results provide insight into the fact that OpenFlamingo can be used for finding patterns in large datasets but needs some modification in the architecture according to the dataset. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_17408 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Leveraging OpenFlamingo for Multimodal Embedding Analysis of C2C Car Parts Data Rashid, Maisha Binte Rivas, Pablo Machine Learning Artificial Intelligence I.2.10; I.2.7; I.5; H.3.3; H.3.1 In this paper, we aim to investigate the capabilities of multimodal machine learning models, particularly the OpenFlamingo model, in processing a large-scale dataset of consumer-to-consumer (C2C) online posts related to car parts. We have collected data from two platforms, OfferUp and Craigslist, resulting in a dataset of over 1.2 million posts with their corresponding images. The OpenFlamingo model was used to extract embeddings for the text and image of each post. We used $k$-means clustering on the joint embeddings to identify underlying patterns and commonalities among the posts. We have found that most clusters contain a pattern, but some clusters showed no internal patterns. The results provide insight into the fact that OpenFlamingo can be used for finding patterns in large datasets but needs some modification in the architecture according to the dataset. |
| title | Leveraging OpenFlamingo for Multimodal Embedding Analysis of C2C Car Parts Data |
| topic | Machine Learning Artificial Intelligence I.2.10; I.2.7; I.5; H.3.3; H.3.1 |
| url | https://arxiv.org/abs/2503.17408 |