Guardado en:
Detalles Bibliográficos
Autores principales: Yuan, Jicheng, Le-Tuan, Anh, Nguyen-Duc, Manh, Tran, Trung-Kien, Hauswirth, Manfred, Le-Phuoc, Danh
Formato: Preprint
Publicado: 2023
Materias:
Acceso en línea:https://arxiv.org/abs/2309.13610
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866929293014073344
author Yuan, Jicheng
Le-Tuan, Anh
Nguyen-Duc, Manh
Tran, Trung-Kien
Hauswirth, Manfred
Le-Phuoc, Danh
author_facet Yuan, Jicheng
Le-Tuan, Anh
Nguyen-Duc, Manh
Tran, Trung-Kien
Hauswirth, Manfred
Le-Phuoc, Danh
contents The availability of vast amounts of visual data with heterogeneous features is a key factor for developing, testing, and benchmarking of new computer vision (CV) algorithms and architectures. Most visual datasets are created and curated for specific tasks or with limited image data distribution for very specific situations, and there is no unified approach to manage and access them across diverse sources, tasks, and taxonomies. This not only creates unnecessary overheads when building robust visual recognition systems, but also introduces biases into learning systems and limits the capabilities of data-centric AI. To address these problems, we propose the Vision Knowledge Graph (VisionKG), a novel resource that interlinks, organizes and manages visual datasets via knowledge graphs and Semantic Web technologies. It can serve as a unified framework facilitating simple access and querying of state-of-the-art visual datasets, regardless of their heterogeneous formats and taxonomies. One of the key differences between our approach and existing methods is that ours is knowledge-based rather than metadatabased. It enhances the enrichment of the semantics at both image and instance levels and offers various data retrieval and exploratory services via SPARQL. VisionKG currently contains 519 million RDF triples that describe approximately 40 million entities, and are accessible at https://vision.semkg.org and through APIs. With the integration of 30 datasets and four popular CV tasks, we demonstrate its usefulness across various scenarios when working with CV pipelines.
format Preprint
id arxiv_https___arxiv_org_abs_2309_13610
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle VisionKG: Unleashing the Power of Visual Datasets via Knowledge Graph
Yuan, Jicheng
Le-Tuan, Anh
Nguyen-Duc, Manh
Tran, Trung-Kien
Hauswirth, Manfred
Le-Phuoc, Danh
Computer Vision and Pattern Recognition
The availability of vast amounts of visual data with heterogeneous features is a key factor for developing, testing, and benchmarking of new computer vision (CV) algorithms and architectures. Most visual datasets are created and curated for specific tasks or with limited image data distribution for very specific situations, and there is no unified approach to manage and access them across diverse sources, tasks, and taxonomies. This not only creates unnecessary overheads when building robust visual recognition systems, but also introduces biases into learning systems and limits the capabilities of data-centric AI. To address these problems, we propose the Vision Knowledge Graph (VisionKG), a novel resource that interlinks, organizes and manages visual datasets via knowledge graphs and Semantic Web technologies. It can serve as a unified framework facilitating simple access and querying of state-of-the-art visual datasets, regardless of their heterogeneous formats and taxonomies. One of the key differences between our approach and existing methods is that ours is knowledge-based rather than metadatabased. It enhances the enrichment of the semantics at both image and instance levels and offers various data retrieval and exploratory services via SPARQL. VisionKG currently contains 519 million RDF triples that describe approximately 40 million entities, and are accessible at https://vision.semkg.org and through APIs. With the integration of 30 datasets and four popular CV tasks, we demonstrate its usefulness across various scenarios when working with CV pipelines.
title VisionKG: Unleashing the Power of Visual Datasets via Knowledge Graph
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2309.13610