Saved in:
Bibliographic Details
Main Authors: Takezaki, Shumpei, Bise, Ryoma, Matsuo, Shinnosuke
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2509.00378
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916926040571904
author Takezaki, Shumpei
Bise, Ryoma
Matsuo, Shinnosuke
author_facet Takezaki, Shumpei
Bise, Ryoma
Matsuo, Shinnosuke
contents In this study, we propose a novel data augmentation method that introduces the concept of CutMix into the generation process of diffusion models, thereby exploiting both the ability of diffusion models to generate natural and high-resolution images and the characteristic of CutMix, which combines features from two classes to create diverse augmented data. Representative data augmentation methods for combining images from multiple classes include CutMix and MixUp. However, techniques like CutMix often result in unnatural boundaries between the two images due to contextual differences. Therefore, in this study, we propose a method, called NoiseCutMix, to achieve natural, high-resolution image generation featuring the fused characteristics of two classes by partially combining the estimated noise corresponding to two different classes in a diffusion model. In the classification experiments, we verified the effectiveness of the proposed method by comparing it with conventional data augmentation techniques that combine multiple classes, random image generation using Stable Diffusion, and combinations of these methods. Our codes are available at: https://github.com/shumpei-takezaki/NoiseCutMix
format Preprint
id arxiv_https___arxiv_org_abs_2509_00378
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle NoiseCutMix: A Novel Data Augmentation Approach by Mixing Estimated Noise in Diffusion Models
Takezaki, Shumpei
Bise, Ryoma
Matsuo, Shinnosuke
Computer Vision and Pattern Recognition
In this study, we propose a novel data augmentation method that introduces the concept of CutMix into the generation process of diffusion models, thereby exploiting both the ability of diffusion models to generate natural and high-resolution images and the characteristic of CutMix, which combines features from two classes to create diverse augmented data. Representative data augmentation methods for combining images from multiple classes include CutMix and MixUp. However, techniques like CutMix often result in unnatural boundaries between the two images due to contextual differences. Therefore, in this study, we propose a method, called NoiseCutMix, to achieve natural, high-resolution image generation featuring the fused characteristics of two classes by partially combining the estimated noise corresponding to two different classes in a diffusion model. In the classification experiments, we verified the effectiveness of the proposed method by comparing it with conventional data augmentation techniques that combine multiple classes, random image generation using Stable Diffusion, and combinations of these methods. Our codes are available at: https://github.com/shumpei-takezaki/NoiseCutMix
title NoiseCutMix: A Novel Data Augmentation Approach by Mixing Estimated Noise in Diffusion Models
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2509.00378