Ducho 2.0: Towards a More Up-to-Date Unified Framework for the Extraction of Multimodal Features in Recommendation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Attimonelli, Matteo, Danese, Danilo, Malitesta, Daniele, Pomo, Claudio, Gassi, Giuseppe, Di Noia, Tommaso
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916163051585536
author Attimonelli, Matteo
Danese, Danilo
Malitesta, Daniele
Pomo, Claudio
Gassi, Giuseppe
Di Noia, Tommaso
author_facet Attimonelli, Matteo
Danese, Danilo
Malitesta, Daniele
Pomo, Claudio
Gassi, Giuseppe
Di Noia, Tommaso
contents In this work, we introduce Ducho 2.0, the latest stable version of our framework. Differently from Ducho, Ducho 2.0 offers a more personalized user experience with the definition and import of custom extraction models fine-tuned on specific tasks and datasets. Moreover, the new version is capable of extracting and processing features through multimodal-by-design large models. Notably, all these new features are supported by optimized data loading and storing to the local memory. To showcase the capabilities of Ducho 2.0, we demonstrate a complete multimodal recommendation pipeline, from the extraction/processing to the final recommendation. The idea is to provide practitioners and experienced scholars with a ready-to-use tool that, put on top of any multimodal recommendation framework, may permit them to run extensive benchmarking analyses. All materials are accessible at: \url{https://github.com/sisinflab/Ducho}.
format Preprint
id arxiv_https___arxiv_org_abs_2403_04503
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Ducho 2.0: Towards a More Up-to-Date Unified Framework for the Extraction of Multimodal Features in Recommendation
Attimonelli, Matteo
Danese, Danilo
Malitesta, Daniele
Pomo, Claudio
Gassi, Giuseppe
Di Noia, Tommaso
Information Retrieval
In this work, we introduce Ducho 2.0, the latest stable version of our framework. Differently from Ducho, Ducho 2.0 offers a more personalized user experience with the definition and import of custom extraction models fine-tuned on specific tasks and datasets. Moreover, the new version is capable of extracting and processing features through multimodal-by-design large models. Notably, all these new features are supported by optimized data loading and storing to the local memory. To showcase the capabilities of Ducho 2.0, we demonstrate a complete multimodal recommendation pipeline, from the extraction/processing to the final recommendation. The idea is to provide practitioners and experienced scholars with a ready-to-use tool that, put on top of any multimodal recommendation framework, may permit them to run extensive benchmarking analyses. All materials are accessible at: \url{https://github.com/sisinflab/Ducho}.
title Ducho 2.0: Towards a More Up-to-Date Unified Framework for the Extraction of Multimodal Features in Recommendation
topic Information Retrieval
url https://arxiv.org/abs/2403.04503