Masked Language Prompting for Generative Data Augmentation in Few-shot Fashion Style Recognition

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Hirakawa, Yuki, Shimizu, Ryotaro
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917465390317568
author Hirakawa, Yuki
Shimizu, Ryotaro
author_facet Hirakawa, Yuki
Shimizu, Ryotaro
contents Constructing dataset for fashion style recognition is challenging due to the inherent subjectivity and ambiguity of style concepts. Recent advances in text-to-image models have facilitated generative data augmentation by synthesizing images from labeled data, yet existing methods based solely on class names or reference captions often fail to balance visual diversity and style consistency. In this work, we propose \textbf{Masked Language Prompting (MLP)}, a novel prompting strategy that masks selected words in a reference caption and leverages large language models to generate diverse yet semantically coherent completions. This approach preserves the structural semantics of the original caption while introducing attribute-level variations aligned with the intended style, enabling style-consistent and diverse image generation without fine-tuning. Experimental results on the FashionStyle14 dataset demonstrate that our MLP-based augmentation consistently outperforms class-name and caption-based baselines, validating its effectiveness for fashion style recognition under limited supervision.
format Preprint
id arxiv_https___arxiv_org_abs_2504_19455
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Masked Language Prompting for Generative Data Augmentation in Few-shot Fashion Style Recognition
Hirakawa, Yuki
Shimizu, Ryotaro
Computer Vision and Pattern Recognition
Constructing dataset for fashion style recognition is challenging due to the inherent subjectivity and ambiguity of style concepts. Recent advances in text-to-image models have facilitated generative data augmentation by synthesizing images from labeled data, yet existing methods based solely on class names or reference captions often fail to balance visual diversity and style consistency. In this work, we propose \textbf{Masked Language Prompting (MLP)}, a novel prompting strategy that masks selected words in a reference caption and leverages large language models to generate diverse yet semantically coherent completions. This approach preserves the structural semantics of the original caption while introducing attribute-level variations aligned with the intended style, enabling style-consistent and diverse image generation without fine-tuning. Experimental results on the FashionStyle14 dataset demonstrate that our MLP-based augmentation consistently outperforms class-name and caption-based baselines, validating its effectiveness for fashion style recognition under limited supervision.
title Masked Language Prompting for Generative Data Augmentation in Few-shot Fashion Style Recognition
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2504.19455