One-Step Diffusion Transformer for Controllable Real-World Image Super-Resolution

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Fang, Yushun, Chen, Yuxiang, Yin, Shibo, Hu, Qiang, Yao, Jiangchao, Zhang, Ya, Zhang, Xiaoyun, Wang, Yanfeng
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914172262940672
author Fang, Yushun
Chen, Yuxiang
Yin, Shibo
Hu, Qiang
Yao, Jiangchao
Zhang, Ya
Zhang, Xiaoyun
Wang, Yanfeng
author_facet Fang, Yushun
Chen, Yuxiang
Yin, Shibo
Hu, Qiang
Yao, Jiangchao
Zhang, Ya
Zhang, Xiaoyun
Wang, Yanfeng
contents Recent advances in diffusion-based real-world image super-resolution (Real-ISR) have demonstrated remarkable perceptual quality, yet the balance between fidelity and controllability remains a problem: multi-step diffusion-based methods suffer from generative diversity and randomness, resulting in low fidelity, while one-step methods lose control flexibility due to fidelity-specific finetuning. In this paper, we present ODTSR, a one-step diffusion transformer based on Qwen-Image that performs Real-ISR considering fidelity and controllability simultaneously: a newly introduced visual stream receives low-quality images (LQ) with adjustable noise (Control Noise), and the original visual stream receives LQs with consistent noise (Prior Noise), forming the Noise-hybrid Visual Stream (NVS) design. ODTSR further employs Fidelity-aware Adversarial Training (FAA) to enhance controllability and achieve one-step inference. Extensive experiments demonstrate that ODTSR not only achieves state-of-the-art (SOTA) performance on generic Real-ISR, but also enables prompt controllability on challenging scenarios such as real-world scene text image super-resolution (STISR) of Chinese characters without training on specific datasets. Codes are available at https://github.com/RedMediaTech/ODTSR.
format Preprint
id arxiv_https___arxiv_org_abs_2511_17138
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle One-Step Diffusion Transformer for Controllable Real-World Image Super-Resolution
Fang, Yushun
Chen, Yuxiang
Yin, Shibo
Hu, Qiang
Yao, Jiangchao
Zhang, Ya
Zhang, Xiaoyun
Wang, Yanfeng
Computer Vision and Pattern Recognition
Recent advances in diffusion-based real-world image super-resolution (Real-ISR) have demonstrated remarkable perceptual quality, yet the balance between fidelity and controllability remains a problem: multi-step diffusion-based methods suffer from generative diversity and randomness, resulting in low fidelity, while one-step methods lose control flexibility due to fidelity-specific finetuning. In this paper, we present ODTSR, a one-step diffusion transformer based on Qwen-Image that performs Real-ISR considering fidelity and controllability simultaneously: a newly introduced visual stream receives low-quality images (LQ) with adjustable noise (Control Noise), and the original visual stream receives LQs with consistent noise (Prior Noise), forming the Noise-hybrid Visual Stream (NVS) design. ODTSR further employs Fidelity-aware Adversarial Training (FAA) to enhance controllability and achieve one-step inference. Extensive experiments demonstrate that ODTSR not only achieves state-of-the-art (SOTA) performance on generic Real-ISR, but also enables prompt controllability on challenging scenarios such as real-world scene text image super-resolution (STISR) of Chinese characters without training on specific datasets. Codes are available at https://github.com/RedMediaTech/ODTSR.
title One-Step Diffusion Transformer for Controllable Real-World Image Super-Resolution
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2511.17138