Model Lakes

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Pal, Koyena, Bau, David, Miller, Renée J.
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910838435086336
author Pal, Koyena
Bau, David
Miller, Renée J.
author_facet Pal, Koyena
Bau, David
Miller, Renée J.
contents Given a set of deep learning models, it can be hard to find models appropriate to a task, understand the models, and characterize how models are different one from another. Currently, practitioners rely on manually-written documentation to understand and choose models. However, not all models have complete and reliable documentation. As the number of models increases, the challenges of finding, differentiating, and understanding models become increasingly crucial. Inspired from research on data lakes, we introduce the concept of model lakes. We formalize key model lake tasks, including model attribution, versioning, search, and benchmarking, and discuss fundamental research challenges in the management of large models. We also explore what data management techniques can be brought to bear on the study of large model management.
format Preprint
id arxiv_https___arxiv_org_abs_2403_02327
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Model Lakes
Pal, Koyena
Bau, David
Miller, Renée J.
Databases
Artificial Intelligence
Given a set of deep learning models, it can be hard to find models appropriate to a task, understand the models, and characterize how models are different one from another. Currently, practitioners rely on manually-written documentation to understand and choose models. However, not all models have complete and reliable documentation. As the number of models increases, the challenges of finding, differentiating, and understanding models become increasingly crucial. Inspired from research on data lakes, we introduce the concept of model lakes. We formalize key model lake tasks, including model attribution, versioning, search, and benchmarking, and discuss fundamental research challenges in the management of large models. We also explore what data management techniques can be brought to bear on the study of large model management.
title Model Lakes
topic Databases
Artificial Intelligence
url https://arxiv.org/abs/2403.02327