Adaptive Domain Shift in Diffusion Models for Cross-Modality Image Translation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Zihao, Chen, Yuzhou, Ren, Shaogang
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910008291098624
author Wang, Zihao
Chen, Yuzhou
Ren, Shaogang
author_facet Wang, Zihao
Chen, Yuzhou
Ren, Shaogang
contents Cross-modal image translation remains brittle and inefficient. Standard diffusion approaches often rely on a single, global linear transfer between domains. We find that this shortcut forces the sampler to traverse off-manifold, high-cost regions, inflating the correction burden and inviting semantic drift. We refer to this shared failure mode as fixed-schedule domain transfer. In this paper, we embed domain-shift dynamics directly into the generative process. Our model predicts a spatially varying mixing field at every reverse step and injects an explicit, target-consistent restoration term into the drift. This in-step guidance keeps large updates on-manifold and shifts the model's role from global alignment to local residual correction. We provide a continuous-time formulation with an exact solution form and derive a practical first-order sampler that preserves marginal consistency. Empirically, across translation tasks in medical imaging, remote sensing, and electroluminescence semantic mapping, our framework improves structural fidelity and semantic consistency while converging in fewer denoising steps.
format Preprint
id arxiv_https___arxiv_org_abs_2601_18623
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Adaptive Domain Shift in Diffusion Models for Cross-Modality Image Translation
Wang, Zihao
Chen, Yuzhou
Ren, Shaogang
Computer Vision and Pattern Recognition
Cross-modal image translation remains brittle and inefficient. Standard diffusion approaches often rely on a single, global linear transfer between domains. We find that this shortcut forces the sampler to traverse off-manifold, high-cost regions, inflating the correction burden and inviting semantic drift. We refer to this shared failure mode as fixed-schedule domain transfer. In this paper, we embed domain-shift dynamics directly into the generative process. Our model predicts a spatially varying mixing field at every reverse step and injects an explicit, target-consistent restoration term into the drift. This in-step guidance keeps large updates on-manifold and shifts the model's role from global alignment to local residual correction. We provide a continuous-time formulation with an exact solution form and derive a practical first-order sampler that preserves marginal consistency. Empirically, across translation tasks in medical imaging, remote sensing, and electroluminescence semantic mapping, our framework improves structural fidelity and semantic consistency while converging in fewer denoising steps.
title Adaptive Domain Shift in Diffusion Models for Cross-Modality Image Translation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2601.18623