TC-Padé: Trajectory-Consistent Padé Approximation for Diffusion Acceleration

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Cui, Benlei, He, Shaoxuan, Huang, Bukun, Ye, Zhizeng, Sun, Yunyun, Huang, Longtao, Xue, Hui, Yang, Yang, Tang, Jingqun, Zhao, Zhou, Hong, Haiwen
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866918367546310656
author Cui, Benlei
He, Shaoxuan
Huang, Bukun
Ye, Zhizeng
Sun, Yunyun
Huang, Longtao
Xue, Hui
Yang, Yang
Tang, Jingqun
Zhao, Zhou
Hong, Haiwen
author_facet Cui, Benlei
He, Shaoxuan
Huang, Bukun
Ye, Zhizeng
Sun, Yunyun
Huang, Longtao
Xue, Hui
Yang, Yang
Tang, Jingqun
Zhao, Zhou
Hong, Haiwen
contents Despite achieving state-of-the-art generation quality, diffusion models are hindered by the substantial computational burden of their iterative sampling process. While feature caching techniques achieve effective acceleration at higher step counts (e.g., 50 steps), they exhibit critical limitations in the practical low-step regime of 20-30 steps. As the interval between steps increases, polynomial-based extrapolators like TaylorSeer suffer from error accumulation and trajectory drift. Meanwhile, conventional caching strategies often overlook the distinct dynamical properties of different denoising phases. To address these challenges, we propose Trajectory-Consistent Padé approximation, a feature prediction framework grounded in Padé approximation. By modeling feature evolution through rational functions, our approach captures asymptotic and transitional behaviors more accurately than Taylor-based methods. To enable stable and trajectory-consistent sampling under reduced step counts, TC-Padé incorporates (1) adaptive coefficient modulation that leverages historical cached residuals to detect subtle trajectory transitions, and (2) step-aware prediction strategies tailored to the distinct dynamics of early, mid, and late sampling stages. Extensive experiments on DiT-XL/2, FLUX.1-dev, and Wan2.1 across both image and video generation demonstrate the effectiveness of TC-Padé. For instance, TC-Padé achieves 2.88x acceleration on FLUX.1-dev and 1.72x on Wan2.1 while maintaining high quality across FID, CLIP, Aesthetic, and VBench-2.0 metrics, substantially outperforming existing feature caching methods.
format Preprint
id arxiv_https___arxiv_org_abs_2603_02943
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle TC-Padé: Trajectory-Consistent Padé Approximation for Diffusion Acceleration
Cui, Benlei
He, Shaoxuan
Huang, Bukun
Ye, Zhizeng
Sun, Yunyun
Huang, Longtao
Xue, Hui
Yang, Yang
Tang, Jingqun
Zhao, Zhou
Hong, Haiwen
Computer Vision and Pattern Recognition
Despite achieving state-of-the-art generation quality, diffusion models are hindered by the substantial computational burden of their iterative sampling process. While feature caching techniques achieve effective acceleration at higher step counts (e.g., 50 steps), they exhibit critical limitations in the practical low-step regime of 20-30 steps. As the interval between steps increases, polynomial-based extrapolators like TaylorSeer suffer from error accumulation and trajectory drift. Meanwhile, conventional caching strategies often overlook the distinct dynamical properties of different denoising phases. To address these challenges, we propose Trajectory-Consistent Padé approximation, a feature prediction framework grounded in Padé approximation. By modeling feature evolution through rational functions, our approach captures asymptotic and transitional behaviors more accurately than Taylor-based methods. To enable stable and trajectory-consistent sampling under reduced step counts, TC-Padé incorporates (1) adaptive coefficient modulation that leverages historical cached residuals to detect subtle trajectory transitions, and (2) step-aware prediction strategies tailored to the distinct dynamics of early, mid, and late sampling stages. Extensive experiments on DiT-XL/2, FLUX.1-dev, and Wan2.1 across both image and video generation demonstrate the effectiveness of TC-Padé. For instance, TC-Padé achieves 2.88x acceleration on FLUX.1-dev and 1.72x on Wan2.1 while maintaining high quality across FID, CLIP, Aesthetic, and VBench-2.0 metrics, substantially outperforming existing feature caching methods.
title TC-Padé: Trajectory-Consistent Padé Approximation for Diffusion Acceleration
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2603.02943