Saved in:
Bibliographic Details
Main Author: Yang, Jiajie
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2403.12915
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929282322792448
author Yang, Jiajie
author_facet Yang, Jiajie
contents We introduce the Pyramid Diffusion Model (PDM), a novel architecture designed for ultra-high-resolution image synthesis. PDM utilizes a pyramid latent representation, providing a broader design space that enables more flexible, structured, and efficient perceptual compression which enable AutoEncoder and Network of Diffusion to equip branches and deeper layers. To enhance PDM's capabilities for generative tasks, we propose the integration of Spatial-Channel Attention and Res-Skip Connection, along with the utilization of Spectral Norm and Decreasing Dropout Strategy for the Diffusion Network and AutoEncoder. In summary, PDM achieves the synthesis of images with a 2K resolution for the first time, demonstrated on two new datasets comprising images of sizes 2048x2048 pixels and 2048x1024 pixels respectively. We believe that this work offers an alternative approach to designing scalable image generative models, while also providing incremental reinforcement for existing frameworks.
format Preprint
id arxiv_https___arxiv_org_abs_2403_12915
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Ultra-High-Resolution Image Synthesis with Pyramid Diffusion Model
Yang, Jiajie
Computer Vision and Pattern Recognition
We introduce the Pyramid Diffusion Model (PDM), a novel architecture designed for ultra-high-resolution image synthesis. PDM utilizes a pyramid latent representation, providing a broader design space that enables more flexible, structured, and efficient perceptual compression which enable AutoEncoder and Network of Diffusion to equip branches and deeper layers. To enhance PDM's capabilities for generative tasks, we propose the integration of Spatial-Channel Attention and Res-Skip Connection, along with the utilization of Spectral Norm and Decreasing Dropout Strategy for the Diffusion Network and AutoEncoder. In summary, PDM achieves the synthesis of images with a 2K resolution for the first time, demonstrated on two new datasets comprising images of sizes 2048x2048 pixels and 2048x1024 pixels respectively. We believe that this work offers an alternative approach to designing scalable image generative models, while also providing incremental reinforcement for existing frameworks.
title Ultra-High-Resolution Image Synthesis with Pyramid Diffusion Model
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2403.12915