CHORDS: Diffusion Sampling Accelerator with Multi-core Hierarchical ODE Solvers

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Han, Jiaqi, Ye, Haotian, Li, Puheng, Xu, Minkai, Zou, James, Ermon, Stefano
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866918099102466048
author Han, Jiaqi
Ye, Haotian
Li, Puheng
Xu, Minkai
Zou, James
Ermon, Stefano
author_facet Han, Jiaqi
Ye, Haotian
Li, Puheng
Xu, Minkai
Zou, James
Ermon, Stefano
contents Diffusion-based generative models have become dominant generators of high-fidelity images and videos but remain limited by their computationally expensive inference procedures. Existing acceleration techniques either require extensive model retraining or compromise significantly on sample quality. This paper explores a general, training-free, and model-agnostic acceleration strategy via multi-core parallelism. Our framework views multi-core diffusion sampling as an ODE solver pipeline, where slower yet accurate solvers progressively rectify faster solvers through a theoretically justified inter-core communication mechanism. This motivates our multi-core training-free diffusion sampling accelerator, CHORDS, which is compatible with various diffusion samplers, model architectures, and modalities. Through extensive experiments, CHORDS significantly accelerates sampling across diverse large-scale image and video diffusion models, yielding up to 2.1x speedup with four cores, improving by 50% over baselines, and 2.9x speedup with eight cores, all without quality degradation. This advancement enables CHORDS to establish a solid foundation for real-time, high-fidelity diffusion generation.
format Preprint
id arxiv_https___arxiv_org_abs_2507_15260
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle CHORDS: Diffusion Sampling Accelerator with Multi-core Hierarchical ODE Solvers
Han, Jiaqi
Ye, Haotian
Li, Puheng
Xu, Minkai
Zou, James
Ermon, Stefano
Machine Learning
Diffusion-based generative models have become dominant generators of high-fidelity images and videos but remain limited by their computationally expensive inference procedures. Existing acceleration techniques either require extensive model retraining or compromise significantly on sample quality. This paper explores a general, training-free, and model-agnostic acceleration strategy via multi-core parallelism. Our framework views multi-core diffusion sampling as an ODE solver pipeline, where slower yet accurate solvers progressively rectify faster solvers through a theoretically justified inter-core communication mechanism. This motivates our multi-core training-free diffusion sampling accelerator, CHORDS, which is compatible with various diffusion samplers, model architectures, and modalities. Through extensive experiments, CHORDS significantly accelerates sampling across diverse large-scale image and video diffusion models, yielding up to 2.1x speedup with four cores, improving by 50% over baselines, and 2.9x speedup with eight cores, all without quality degradation. This advancement enables CHORDS to establish a solid foundation for real-time, high-fidelity diffusion generation.
title CHORDS: Diffusion Sampling Accelerator with Multi-core Hierarchical ODE Solvers
topic Machine Learning
url https://arxiv.org/abs/2507.15260