Single-image driven 3d viewpoint training data augmentation for effective wine label recognition

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Huang, Yueh-Cheng, Chen, Hsin-Yi, Hung, Cheng-Jui, Chuang, Jen-Hui, Hwang, Jenq-Neng
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913314108342272
author Huang, Yueh-Cheng
Chen, Hsin-Yi
Hung, Cheng-Jui
Chuang, Jen-Hui
Hwang, Jenq-Neng
author_facet Huang, Yueh-Cheng
Chen, Hsin-Yi
Hung, Cheng-Jui
Chuang, Jen-Hui
Hwang, Jenq-Neng
contents Confronting the critical challenge of insufficient training data in the field of complex image recognition, this paper introduces a novel 3D viewpoint augmentation technique specifically tailored for wine label recognition. This method enhances deep learning model performance by generating visually realistic training samples from a single real-world wine label image, overcoming the challenges posed by the intricate combinations of text and logos. Classical Generative Adversarial Network (GAN) methods fall short in synthesizing such intricate content combination. Our proposed solution leverages time-tested computer vision and image processing strategies to expand our training dataset, thereby broadening the range of training samples for deep learning applications. This innovative approach to data augmentation circumvents the constraints of limited training resources. Using the augmented training images through batch-all triplet metric learning on a Vision Transformer (ViT) architecture, we can get the most discriminative embedding features for every wine label, enabling us to perform one-shot recognition of existing wine labels in the training classes or future newly collected wine labels unavailable in the training. Experimental results show a significant increase in recognition accuracy over conventional 2D data augmentation techniques.
format Preprint
id arxiv_https___arxiv_org_abs_2404_08820
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Single-image driven 3d viewpoint training data augmentation for effective wine label recognition
Huang, Yueh-Cheng
Chen, Hsin-Yi
Hung, Cheng-Jui
Chuang, Jen-Hui
Hwang, Jenq-Neng
Computer Vision and Pattern Recognition
Machine Learning
Confronting the critical challenge of insufficient training data in the field of complex image recognition, this paper introduces a novel 3D viewpoint augmentation technique specifically tailored for wine label recognition. This method enhances deep learning model performance by generating visually realistic training samples from a single real-world wine label image, overcoming the challenges posed by the intricate combinations of text and logos. Classical Generative Adversarial Network (GAN) methods fall short in synthesizing such intricate content combination. Our proposed solution leverages time-tested computer vision and image processing strategies to expand our training dataset, thereby broadening the range of training samples for deep learning applications. This innovative approach to data augmentation circumvents the constraints of limited training resources. Using the augmented training images through batch-all triplet metric learning on a Vision Transformer (ViT) architecture, we can get the most discriminative embedding features for every wine label, enabling us to perform one-shot recognition of existing wine labels in the training classes or future newly collected wine labels unavailable in the training. Experimental results show a significant increase in recognition accuracy over conventional 2D data augmentation techniques.
title Single-image driven 3d viewpoint training data augmentation for effective wine label recognition
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2404.08820