Generating Risky Samples with Conformity Constraints via Diffusion Models

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Yu, Han, Zou, Hao, Zhang, Xingxuan, Wang, Zhengyi, He, Yue, Li, Kehan, Cui, Peng
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908726011625472
author Yu, Han
Zou, Hao
Zhang, Xingxuan
Wang, Zhengyi
He, Yue
Li, Kehan
Cui, Peng
author_facet Yu, Han
Zou, Hao
Zhang, Xingxuan
Wang, Zhengyi
He, Yue
Li, Kehan
Cui, Peng
contents Although neural networks achieve promising performance in many tasks, they may still fail when encountering some examples and bring about risks to applications. To discover risky samples, previous literature attempts to search for patterns of risky samples within existing datasets or inject perturbation into them. Yet in this way the diversity of risky samples is limited by the coverage of existing datasets. To overcome this limitation, recent works adopt diffusion models to produce new risky samples beyond the coverage of existing datasets. However, these methods struggle in the conformity between generated samples and expected categories, which could introduce label noise and severely limit their effectiveness in applications. To address this issue, we propose RiskyDiff that incorporates the embeddings of both texts and images as implicit constraints of category conformity. We also design a conformity score to further explicitly strengthen the category conformity, as well as introduce the mechanisms of embedding screening and risky gradient guidance to boost the risk of generated samples. Extensive experiments reveal that RiskyDiff greatly outperforms existing methods in terms of the degree of risk, generation quality, and conformity with conditioned categories. We also empirically show the generalization ability of the models can be enhanced by augmenting training data with generated samples of high conformity.
format Preprint
id arxiv_https___arxiv_org_abs_2512_18722
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Generating Risky Samples with Conformity Constraints via Diffusion Models
Yu, Han
Zou, Hao
Zhang, Xingxuan
Wang, Zhengyi
He, Yue
Li, Kehan
Cui, Peng
Machine Learning
Although neural networks achieve promising performance in many tasks, they may still fail when encountering some examples and bring about risks to applications. To discover risky samples, previous literature attempts to search for patterns of risky samples within existing datasets or inject perturbation into them. Yet in this way the diversity of risky samples is limited by the coverage of existing datasets. To overcome this limitation, recent works adopt diffusion models to produce new risky samples beyond the coverage of existing datasets. However, these methods struggle in the conformity between generated samples and expected categories, which could introduce label noise and severely limit their effectiveness in applications. To address this issue, we propose RiskyDiff that incorporates the embeddings of both texts and images as implicit constraints of category conformity. We also design a conformity score to further explicitly strengthen the category conformity, as well as introduce the mechanisms of embedding screening and risky gradient guidance to boost the risk of generated samples. Extensive experiments reveal that RiskyDiff greatly outperforms existing methods in terms of the degree of risk, generation quality, and conformity with conditioned categories. We also empirically show the generalization ability of the models can be enhanced by augmenting training data with generated samples of high conformity.
title Generating Risky Samples with Conformity Constraints via Diffusion Models
topic Machine Learning
url https://arxiv.org/abs/2512.18722