Efficient Fine-Tuning and Concept Suppression for Pruned Diffusion Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Shirkavand, Reza, Yu, Peiran, Gao, Shangqian, Somepalli, Gowthami, Goldstein, Tom, Huang, Heng
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915192109006848
author Shirkavand, Reza
Yu, Peiran
Gao, Shangqian
Somepalli, Gowthami
Goldstein, Tom
Huang, Heng
author_facet Shirkavand, Reza
Yu, Peiran
Gao, Shangqian
Somepalli, Gowthami
Goldstein, Tom
Huang, Heng
contents Recent advances in diffusion generative models have yielded remarkable progress. While the quality of generated content continues to improve, these models have grown considerably in size and complexity. This increasing computational burden poses significant challenges, particularly in resource-constrained deployment scenarios such as mobile devices. The combination of model pruning and knowledge distillation has emerged as a promising solution to reduce computational demands while preserving generation quality. However, this technique inadvertently propagates undesirable behaviors, including the generation of copyrighted content and unsafe concepts, even when such instances are absent from the fine-tuning dataset. In this paper, we propose a novel bilevel optimization framework for pruned diffusion models that consolidates the fine-tuning and unlearning processes into a unified phase. Our approach maintains the principal advantages of distillation-namely, efficient convergence and style transfer capabilities-while selectively suppressing the generation of unwanted content. This plug-in framework is compatible with various pruning and concept unlearning methods, facilitating efficient, safe deployment of diffusion models in controlled environments.
format Preprint
id arxiv_https___arxiv_org_abs_2412_15341
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Efficient Fine-Tuning and Concept Suppression for Pruned Diffusion Models
Shirkavand, Reza
Yu, Peiran
Gao, Shangqian
Somepalli, Gowthami
Goldstein, Tom
Huang, Heng
Machine Learning
Computer Vision and Pattern Recognition
Recent advances in diffusion generative models have yielded remarkable progress. While the quality of generated content continues to improve, these models have grown considerably in size and complexity. This increasing computational burden poses significant challenges, particularly in resource-constrained deployment scenarios such as mobile devices. The combination of model pruning and knowledge distillation has emerged as a promising solution to reduce computational demands while preserving generation quality. However, this technique inadvertently propagates undesirable behaviors, including the generation of copyrighted content and unsafe concepts, even when such instances are absent from the fine-tuning dataset. In this paper, we propose a novel bilevel optimization framework for pruned diffusion models that consolidates the fine-tuning and unlearning processes into a unified phase. Our approach maintains the principal advantages of distillation-namely, efficient convergence and style transfer capabilities-while selectively suppressing the generation of unwanted content. This plug-in framework is compatible with various pruning and concept unlearning methods, facilitating efficient, safe deployment of diffusion models in controlled environments.
title Efficient Fine-Tuning and Concept Suppression for Pruned Diffusion Models
topic Machine Learning
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2412.15341