From Sketch to Fresco: Efficient Diffusion Transformer with Progressive Resolution

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zheng, Shikang, Chen, Guantao, He, Lixuan, Liu, Jiacheng, Lin, Yuqi, Zou, Chang, Zhang, Linfeng
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917196088737792
author Zheng, Shikang
Chen, Guantao
He, Lixuan
Liu, Jiacheng
Lin, Yuqi
Zou, Chang
Zhang, Linfeng
author_facet Zheng, Shikang
Chen, Guantao
He, Lixuan
Liu, Jiacheng
Lin, Yuqi
Zou, Chang
Zhang, Linfeng
contents Diffusion Transformers achieve impressive generative quality but remain computationally expensive due to iterative sampling. Recently, dynamic resolution sampling has emerged as a promising acceleration technique by reducing the resolution of early sampling steps. However, existing methods rely on heuristic re-noising at every resolution transition, injecting noise that breaks cross-stage consistency and forces the model to relearn global structure. In addition, these methods indiscriminately upsample the entire latent space at once without checking which regions have actually converged, causing accumulated errors, and visible artifacts. Therefore, we propose \textbf{Fresco}, a dynamic resolution framework that unifies re-noise and global structure across stages with progressive upsampling, preserving both the efficiency of low-resolution drafting and the fidelity of high-resolution refinement, with all stages aligned toward the same final target. Fresco achieves near-lossless acceleration across diverse domains and models, including 10$\times$ speedup on FLUX, and 5$\times$ on HunyuanVideo, while remaining orthogonal to distillation, quantization and feature caching, reaching 22$\times$ speedup when combined with distilled models. Our code is in supplementary material and will be released on Github.
format Preprint
id arxiv_https___arxiv_org_abs_2601_07462
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle From Sketch to Fresco: Efficient Diffusion Transformer with Progressive Resolution
Zheng, Shikang
Chen, Guantao
He, Lixuan
Liu, Jiacheng
Lin, Yuqi
Zou, Chang
Zhang, Linfeng
Computer Vision and Pattern Recognition
Diffusion Transformers achieve impressive generative quality but remain computationally expensive due to iterative sampling. Recently, dynamic resolution sampling has emerged as a promising acceleration technique by reducing the resolution of early sampling steps. However, existing methods rely on heuristic re-noising at every resolution transition, injecting noise that breaks cross-stage consistency and forces the model to relearn global structure. In addition, these methods indiscriminately upsample the entire latent space at once without checking which regions have actually converged, causing accumulated errors, and visible artifacts. Therefore, we propose \textbf{Fresco}, a dynamic resolution framework that unifies re-noise and global structure across stages with progressive upsampling, preserving both the efficiency of low-resolution drafting and the fidelity of high-resolution refinement, with all stages aligned toward the same final target. Fresco achieves near-lossless acceleration across diverse domains and models, including 10$\times$ speedup on FLUX, and 5$\times$ on HunyuanVideo, while remaining orthogonal to distillation, quantization and feature caching, reaching 22$\times$ speedup when combined with distilled models. Our code is in supplementary material and will be released on Github.
title From Sketch to Fresco: Efficient Diffusion Transformer with Progressive Resolution
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2601.07462