DiffServe: Efficiently Serving Text-to-Image Diffusion Models with Query-Aware Model Scaling
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866916729298354176 |
|---|---|
| author | Ahmad, Sohaib Yang, Qizheng Wang, Haoliang Sitaraman, Ramesh K. Guan, Hui |
| author_facet | Ahmad, Sohaib Yang, Qizheng Wang, Haoliang Sitaraman, Ramesh K. Guan, Hui |
| contents | Text-to-image generation using diffusion models has gained increasing popularity due to their ability to produce high-quality, realistic images based on text prompts. However, efficiently serving these models is challenging due to their computation-intensive nature and the variation in query demands. In this paper, we aim to address both problems simultaneously through query-aware model scaling. The core idea is to construct model cascades so that easy queries can be processed by more lightweight diffusion models without compromising image generation quality. Based on this concept, we develop an end-to-end text-to-image diffusion model serving system, DiffServe, which automatically constructs model cascades from available diffusion model variants and allocates resources dynamically in response to demand fluctuations. Our empirical evaluations demonstrate that DiffServe achieves up to 24% improvement in response quality while maintaining 19-70% lower latency violation rates compared to state-of-the-art model serving systems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_15381 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | DiffServe: Efficiently Serving Text-to-Image Diffusion Models with Query-Aware Model Scaling Ahmad, Sohaib Yang, Qizheng Wang, Haoliang Sitaraman, Ramesh K. Guan, Hui Distributed, Parallel, and Cluster Computing Text-to-image generation using diffusion models has gained increasing popularity due to their ability to produce high-quality, realistic images based on text prompts. However, efficiently serving these models is challenging due to their computation-intensive nature and the variation in query demands. In this paper, we aim to address both problems simultaneously through query-aware model scaling. The core idea is to construct model cascades so that easy queries can be processed by more lightweight diffusion models without compromising image generation quality. Based on this concept, we develop an end-to-end text-to-image diffusion model serving system, DiffServe, which automatically constructs model cascades from available diffusion model variants and allocates resources dynamically in response to demand fluctuations. Our empirical evaluations demonstrate that DiffServe achieves up to 24% improvement in response quality while maintaining 19-70% lower latency violation rates compared to state-of-the-art model serving systems. |
| title | DiffServe: Efficiently Serving Text-to-Image Diffusion Models with Query-Aware Model Scaling |
| topic | Distributed, Parallel, and Cluster Computing |
| url | https://arxiv.org/abs/2411.15381 |