GALOT: Generative Active Learning via Optimizable Zero-shot Text-to-image Generation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Hong, Hanbin, Yan, Shenao, Feng, Shuya, Yan, Yan, Hong, Yuan
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910758627966976
author Hong, Hanbin
Yan, Shenao
Feng, Shuya
Yan, Yan
Hong, Yuan
author_facet Hong, Hanbin
Yan, Shenao
Feng, Shuya
Yan, Yan
Hong, Yuan
contents Active Learning (AL) represents a crucial methodology within machine learning, emphasizing the identification and utilization of the most informative samples for efficient model training. However, a significant challenge of AL is its dependence on the limited labeled data samples and data distribution, resulting in limited performance. To address this limitation, this paper integrates the zero-shot text-to-image (T2I) synthesis and active learning by designing a novel framework that can efficiently train a machine learning (ML) model sorely using the text description. Specifically, we leverage the AL criteria to optimize the text inputs for generating more informative and diverse data samples, annotated by the pseudo-label crafted from text, then served as a synthetic dataset for active learning. This approach reduces the cost of data collection and annotation while increasing the efficiency of model training by providing informative training samples, enabling a novel end-to-end ML task from text description to vision models. Through comprehensive evaluations, our framework demonstrates consistent and significant improvements over traditional AL methods.
format Preprint
id arxiv_https___arxiv_org_abs_2412_16227
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle GALOT: Generative Active Learning via Optimizable Zero-shot Text-to-image Generation
Hong, Hanbin
Yan, Shenao
Feng, Shuya
Yan, Yan
Hong, Yuan
Computer Vision and Pattern Recognition
Machine Learning
Active Learning (AL) represents a crucial methodology within machine learning, emphasizing the identification and utilization of the most informative samples for efficient model training. However, a significant challenge of AL is its dependence on the limited labeled data samples and data distribution, resulting in limited performance. To address this limitation, this paper integrates the zero-shot text-to-image (T2I) synthesis and active learning by designing a novel framework that can efficiently train a machine learning (ML) model sorely using the text description. Specifically, we leverage the AL criteria to optimize the text inputs for generating more informative and diverse data samples, annotated by the pseudo-label crafted from text, then served as a synthetic dataset for active learning. This approach reduces the cost of data collection and annotation while increasing the efficiency of model training by providing informative training samples, enabling a novel end-to-end ML task from text description to vision models. Through comprehensive evaluations, our framework demonstrates consistent and significant improvements over traditional AL methods.
title GALOT: Generative Active Learning via Optimizable Zero-shot Text-to-image Generation
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2412.16227