Retrieval-Augmented Layout Transformer for Content-Aware Layout Generation
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913316375363584 |
|---|---|
| author | Horita, Daichi Inoue, Naoto Kikuchi, Kotaro Yamaguchi, Kota Aizawa, Kiyoharu |
| author_facet | Horita, Daichi Inoue, Naoto Kikuchi, Kotaro Yamaguchi, Kota Aizawa, Kiyoharu |
| contents | Content-aware graphic layout generation aims to automatically arrange visual elements along with a given content, such as an e-commerce product image. In this paper, we argue that the current layout generation approaches suffer from the limited training data for the high-dimensional layout structure. We show that a simple retrieval augmentation can significantly improve the generation quality. Our model, which is named Retrieval-Augmented Layout Transformer (RALF), retrieves nearest neighbor layout examples based on an input image and feeds these results into an autoregressive generator. Our model can apply retrieval augmentation to various controllable generation tasks and yield high-quality layouts within a unified architecture. Our extensive experiments show that RALF successfully generates content-aware layouts in both constrained and unconstrained settings and significantly outperforms the baselines. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2311_13602 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Retrieval-Augmented Layout Transformer for Content-Aware Layout Generation Horita, Daichi Inoue, Naoto Kikuchi, Kotaro Yamaguchi, Kota Aizawa, Kiyoharu Computer Vision and Pattern Recognition Content-aware graphic layout generation aims to automatically arrange visual elements along with a given content, such as an e-commerce product image. In this paper, we argue that the current layout generation approaches suffer from the limited training data for the high-dimensional layout structure. We show that a simple retrieval augmentation can significantly improve the generation quality. Our model, which is named Retrieval-Augmented Layout Transformer (RALF), retrieves nearest neighbor layout examples based on an input image and feeds these results into an autoregressive generator. Our model can apply retrieval augmentation to various controllable generation tasks and yield high-quality layouts within a unified architecture. Our extensive experiments show that RALF successfully generates content-aware layouts in both constrained and unconstrained settings and significantly outperforms the baselines. |
| title | Retrieval-Augmented Layout Transformer for Content-Aware Layout Generation |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2311.13602 |