HydraMix: Multi-Image Feature Mixing for Small Data Image Classification

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Reinders, Christoph, Schubert, Frederik, Rosenhahn, Bodo
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917893855248384
author Reinders, Christoph
Schubert, Frederik
Rosenhahn, Bodo
author_facet Reinders, Christoph
Schubert, Frederik
Rosenhahn, Bodo
contents Training deep neural networks requires datasets with a large number of annotated examples. The collection and annotation of these datasets is not only extremely expensive but also faces legal and privacy problems. These factors are a significant limitation for many real-world applications. To address this, we introduce HydraMix, a novel architecture that generates new image compositions by mixing multiple different images from the same class. HydraMix learns the fusion of the content of various images guided by a segmentation-based mixing mask in feature space and is optimized via a combination of unsupervised and adversarial training. Our data augmentation scheme allows the creation of models trained from scratch on very small datasets. We conduct extensive experiments on ciFAIR-10, STL-10, and ciFAIR-100. Additionally, we introduce a novel text-image metric to assess the generality of the augmented datasets. Our results show that HydraMix outperforms existing state-of-the-art methods for image classification on small datasets.
format Preprint
id arxiv_https___arxiv_org_abs_2501_09504
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle HydraMix: Multi-Image Feature Mixing for Small Data Image Classification
Reinders, Christoph
Schubert, Frederik
Rosenhahn, Bodo
Computer Vision and Pattern Recognition
Training deep neural networks requires datasets with a large number of annotated examples. The collection and annotation of these datasets is not only extremely expensive but also faces legal and privacy problems. These factors are a significant limitation for many real-world applications. To address this, we introduce HydraMix, a novel architecture that generates new image compositions by mixing multiple different images from the same class. HydraMix learns the fusion of the content of various images guided by a segmentation-based mixing mask in feature space and is optimized via a combination of unsupervised and adversarial training. Our data augmentation scheme allows the creation of models trained from scratch on very small datasets. We conduct extensive experiments on ciFAIR-10, STL-10, and ciFAIR-100. Additionally, we introduce a novel text-image metric to assess the generality of the augmented datasets. Our results show that HydraMix outperforms existing state-of-the-art methods for image classification on small datasets.
title HydraMix: Multi-Image Feature Mixing for Small Data Image Classification
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2501.09504