EUFCC-340K: A Faceted Hierarchical Dataset for Metadata Annotation in GLAM Collections
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916273900748800 |
|---|---|
| author | Net, Francesc Folia, Marc Casals, Pep Bagdanov, Andrew D. Gomez, Lluis |
| author_facet | Net, Francesc Folia, Marc Casals, Pep Bagdanov, Andrew D. Gomez, Lluis |
| contents | In this paper, we address the challenges of automatic metadata annotation in the domain of Galleries, Libraries, Archives, and Museums (GLAMs) by introducing a novel dataset, EUFCC340K, collected from the Europeana portal. Comprising over 340,000 images, the EUFCC340K dataset is organized across multiple facets: Materials, Object Types, Disciplines, and Subjects, following a hierarchical structure based on the Art & Architecture Thesaurus (AAT). We developed several baseline models, incorporating multiple heads on a ConvNeXT backbone for multi-label image tagging on these facets, and fine-tuning a CLIP model with our image text pairs. Our experiments to evaluate model robustness and generalization capabilities in two different test scenarios demonstrate the utility of the dataset in improving multi-label classification tools that have the potential to alleviate cataloging tasks in the cultural heritage sector. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_02380 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | EUFCC-340K: A Faceted Hierarchical Dataset for Metadata Annotation in GLAM Collections Net, Francesc Folia, Marc Casals, Pep Bagdanov, Andrew D. Gomez, Lluis Computer Vision and Pattern Recognition I.4.9 In this paper, we address the challenges of automatic metadata annotation in the domain of Galleries, Libraries, Archives, and Museums (GLAMs) by introducing a novel dataset, EUFCC340K, collected from the Europeana portal. Comprising over 340,000 images, the EUFCC340K dataset is organized across multiple facets: Materials, Object Types, Disciplines, and Subjects, following a hierarchical structure based on the Art & Architecture Thesaurus (AAT). We developed several baseline models, incorporating multiple heads on a ConvNeXT backbone for multi-label image tagging on these facets, and fine-tuning a CLIP model with our image text pairs. Our experiments to evaluate model robustness and generalization capabilities in two different test scenarios demonstrate the utility of the dataset in improving multi-label classification tools that have the potential to alleviate cataloging tasks in the cultural heritage sector. |
| title | EUFCC-340K: A Faceted Hierarchical Dataset for Metadata Annotation in GLAM Collections |
| topic | Computer Vision and Pattern Recognition I.4.9 |
| url | https://arxiv.org/abs/2406.02380 |