Source-Free Domain Adaptation with Diffusion-Guided Source Data Generation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Chopra, Shivang, Kothawade, Suraj, Aynaou, Houda, Chadha, Aman
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914849619968000
author Chopra, Shivang
Kothawade, Suraj
Aynaou, Houda
Chadha, Aman
author_facet Chopra, Shivang
Kothawade, Suraj
Aynaou, Houda
Chadha, Aman
contents This paper introduces a novel approach to leverage the generalizability of Diffusion Models for Source-Free Domain Adaptation (DM-SFDA). Our proposed DMSFDA method involves fine-tuning a pre-trained text-to-image diffusion model to generate source domain images using features from the target images to guide the diffusion process. Specifically, the pre-trained diffusion model is fine-tuned to generate source samples that minimize entropy and maximize confidence for the pre-trained source model. We then use a diffusion model-based image mixup strategy to bridge the domain gap between the source and target domains. We validate our approach through comprehensive experiments across a range of datasets, including Office-31, Office-Home, and VisDA. The results demonstrate significant improvements in SFDA performance, highlighting the potential of diffusion models in generating contextually relevant, domain-specific images.
format Preprint
id arxiv_https___arxiv_org_abs_2402_04929
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Source-Free Domain Adaptation with Diffusion-Guided Source Data Generation
Chopra, Shivang
Kothawade, Suraj
Aynaou, Houda
Chadha, Aman
Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
This paper introduces a novel approach to leverage the generalizability of Diffusion Models for Source-Free Domain Adaptation (DM-SFDA). Our proposed DMSFDA method involves fine-tuning a pre-trained text-to-image diffusion model to generate source domain images using features from the target images to guide the diffusion process. Specifically, the pre-trained diffusion model is fine-tuned to generate source samples that minimize entropy and maximize confidence for the pre-trained source model. We then use a diffusion model-based image mixup strategy to bridge the domain gap between the source and target domains. We validate our approach through comprehensive experiments across a range of datasets, including Office-31, Office-Home, and VisDA. The results demonstrate significant improvements in SFDA performance, highlighting the potential of diffusion models in generating contextually relevant, domain-specific images.
title Source-Free Domain Adaptation with Diffusion-Guided Source Data Generation
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2402.04929