ReLayout: Integrating Relation Reasoning for Content-aware Layout Generation with Multi-modal Large Language Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Tian, Jiaxu, Yu, Xuehui, Wang, Yaoxing, Wang, Pan, Guo, Guangqian, Gao, Shan
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913932122259456
author Tian, Jiaxu
Yu, Xuehui
Wang, Yaoxing
Wang, Pan
Guo, Guangqian
Gao, Shan
author_facet Tian, Jiaxu
Yu, Xuehui
Wang, Yaoxing
Wang, Pan
Guo, Guangqian
Gao, Shan
contents Content-aware layout aims to arrange design elements appropriately on a given canvas to convey information effectively. Recently, the trend for this task has been to leverage large language models (LLMs) to generate layouts automatically, achieving remarkable performance. However, existing LLM-based methods fail to adequately interpret spatial relationships among visual themes and design elements, leading to structural and diverse problems in layout generation. To address this issue, we introduce ReLayout, a novel method that leverages relation-CoT to generate more reasonable and aesthetically coherent layouts by fundamentally originating from design concepts. Specifically, we enhance layout annotations by introducing explicit relation definitions, such as region, salient, and margin between elements, with the goal of decomposing the layout into smaller, structured, and recursive layouts, thereby enabling the generation of more structured layouts. Furthermore, based on these defined relationships, we introduce a layout prototype rebalance sampler, which defines layout prototype features across three dimensions and quantifies distinct layout styles. This sampler addresses uniformity issues in generation that arise from data bias in the prototype distribution balance process. Extensive experimental results verify that ReLayout outperforms baselines and can generate structural and diverse layouts that are more aligned with human aesthetics and more explainable.
format Preprint
id arxiv_https___arxiv_org_abs_2507_05568
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle ReLayout: Integrating Relation Reasoning for Content-aware Layout Generation with Multi-modal Large Language Models
Tian, Jiaxu
Yu, Xuehui
Wang, Yaoxing
Wang, Pan
Guo, Guangqian
Gao, Shan
Computer Vision and Pattern Recognition
Machine Learning
Content-aware layout aims to arrange design elements appropriately on a given canvas to convey information effectively. Recently, the trend for this task has been to leverage large language models (LLMs) to generate layouts automatically, achieving remarkable performance. However, existing LLM-based methods fail to adequately interpret spatial relationships among visual themes and design elements, leading to structural and diverse problems in layout generation. To address this issue, we introduce ReLayout, a novel method that leverages relation-CoT to generate more reasonable and aesthetically coherent layouts by fundamentally originating from design concepts. Specifically, we enhance layout annotations by introducing explicit relation definitions, such as region, salient, and margin between elements, with the goal of decomposing the layout into smaller, structured, and recursive layouts, thereby enabling the generation of more structured layouts. Furthermore, based on these defined relationships, we introduce a layout prototype rebalance sampler, which defines layout prototype features across three dimensions and quantifies distinct layout styles. This sampler addresses uniformity issues in generation that arise from data bias in the prototype distribution balance process. Extensive experimental results verify that ReLayout outperforms baselines and can generate structural and diverse layouts that are more aligned with human aesthetics and more explainable.
title ReLayout: Integrating Relation Reasoning for Content-aware Layout Generation with Multi-modal Large Language Models
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2507.05568