Pinterest Canvas: Large-Scale Image Generation at Pinterest

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Wang, Yu, Tzeng, Eric, Shiau, Raymond, Yang, Jie, Kislyuk, Dmitry, Rosenberg, Charles
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910278343458816
author Wang, Yu
Tzeng, Eric
Shiau, Raymond
Yang, Jie
Kislyuk, Dmitry
Rosenberg, Charles
author_facet Wang, Yu
Tzeng, Eric
Shiau, Raymond
Yang, Jie
Kislyuk, Dmitry
Rosenberg, Charles
contents While recent image generation models demonstrate a remarkable ability to handle a wide variety of image generation tasks, this flexibility makes them hard to control via prompting or simple inference adaptation alone, rendering them unsuitable for use cases with strict product requirements. In this paper, we introduce Pinterest Canvas, our large-scale image generation system built to support image editing and enhancement use cases at Pinterest. Canvas is first trained on a diverse, multimodal dataset to produce a foundational diffusion model with broad image-editing capabilities. However, rather than relying on one generic model to handle every downstream task, we instead rapidly fine-tune variants of this base model on task-specific datasets, producing specialized models for individual use cases. We describe key components of Canvas and summarize our best practices for dataset curation, training, and inference. We also showcase task-specific variants through case studies on background enhancement and aspect-ratio outpainting, highlighting how we tackle their specific product requirements. Online A/B experiments demonstrate that our enhanced images receive a significant 18.0% and 12.5% engagement lift, respectively, and comparisons with human raters further validate that our models outperform third-party models on these tasks. Finally, we showcase other Canvas variants, including multi-image scene synthesis and image-to-video generation, demonstrating that our approach can generalize to a wide variety of potential downstream tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2603_06453
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Pinterest Canvas: Large-Scale Image Generation at Pinterest
Wang, Yu
Tzeng, Eric
Shiau, Raymond
Yang, Jie
Kislyuk, Dmitry
Rosenberg, Charles
Computer Vision and Pattern Recognition
While recent image generation models demonstrate a remarkable ability to handle a wide variety of image generation tasks, this flexibility makes them hard to control via prompting or simple inference adaptation alone, rendering them unsuitable for use cases with strict product requirements. In this paper, we introduce Pinterest Canvas, our large-scale image generation system built to support image editing and enhancement use cases at Pinterest. Canvas is first trained on a diverse, multimodal dataset to produce a foundational diffusion model with broad image-editing capabilities. However, rather than relying on one generic model to handle every downstream task, we instead rapidly fine-tune variants of this base model on task-specific datasets, producing specialized models for individual use cases. We describe key components of Canvas and summarize our best practices for dataset curation, training, and inference. We also showcase task-specific variants through case studies on background enhancement and aspect-ratio outpainting, highlighting how we tackle their specific product requirements. Online A/B experiments demonstrate that our enhanced images receive a significant 18.0% and 12.5% engagement lift, respectively, and comparisons with human raters further validate that our models outperform third-party models on these tasks. Finally, we showcase other Canvas variants, including multi-image scene synthesis and image-to-video generation, demonstrating that our approach can generalize to a wide variety of potential downstream tasks.
title Pinterest Canvas: Large-Scale Image Generation at Pinterest
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2603.06453