GLDesigner: Leveraging Multi-Modal LLMs as Designer for Enhanced Aesthetic Text Glyph Layouts

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: He, Junwen, Wang, Yifan, Wang, Lijun, Lu, Huchuan, He, Jun-Yan, Li, Chenyang, Chen, Hanyuan, Lan, Jin-Peng, Luo, Bin, Geng, Yifeng
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913970484412416
author He, Junwen
Wang, Yifan
Wang, Lijun
Lu, Huchuan
He, Jun-Yan
Li, Chenyang
Chen, Hanyuan
Lan, Jin-Peng
Luo, Bin
Geng, Yifeng
author_facet He, Junwen
Wang, Yifan
Wang, Lijun
Lu, Huchuan
He, Jun-Yan
Li, Chenyang
Chen, Hanyuan
Lan, Jin-Peng
Luo, Bin
Geng, Yifeng
contents Text logo design heavily relies on the creativity and expertise of professional designers, in which arranging element layouts is one of the most important procedures. However, this specific task has received limited attention, often overshadowed by broader layout generation tasks such as document or poster design. In this paper, we propose a Vision-Language Model (VLM)-based framework that generates content-aware text logo layouts by integrating multi-modal inputs with user-defined constraints, enabling more flexible and robust layout generation for real-world applications. We introduce two model techniques that reduce the computational cost for processing multiple glyph images simultaneously, without compromising performance. To support instruction tuning of our model, we construct two extensive text logo datasets that are five times larger than existing public datasets. In addition to geometric annotations (\textit{e.g.}, text masks and character recognition), our datasets include detailed layout descriptions in natural language, enabling the model to reason more effectively in handling complex designs and custom user inputs. Experimental results demonstrate the effectiveness of our proposed framework and datasets, outperforming existing methods on various benchmarks that assess geometric aesthetics and human preferences.
format Preprint
id arxiv_https___arxiv_org_abs_2411_11435
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle GLDesigner: Leveraging Multi-Modal LLMs as Designer for Enhanced Aesthetic Text Glyph Layouts
He, Junwen
Wang, Yifan
Wang, Lijun
Lu, Huchuan
He, Jun-Yan
Li, Chenyang
Chen, Hanyuan
Lan, Jin-Peng
Luo, Bin
Geng, Yifeng
Computer Vision and Pattern Recognition
Text logo design heavily relies on the creativity and expertise of professional designers, in which arranging element layouts is one of the most important procedures. However, this specific task has received limited attention, often overshadowed by broader layout generation tasks such as document or poster design. In this paper, we propose a Vision-Language Model (VLM)-based framework that generates content-aware text logo layouts by integrating multi-modal inputs with user-defined constraints, enabling more flexible and robust layout generation for real-world applications. We introduce two model techniques that reduce the computational cost for processing multiple glyph images simultaneously, without compromising performance. To support instruction tuning of our model, we construct two extensive text logo datasets that are five times larger than existing public datasets. In addition to geometric annotations (\textit{e.g.}, text masks and character recognition), our datasets include detailed layout descriptions in natural language, enabling the model to reason more effectively in handling complex designs and custom user inputs. Experimental results demonstrate the effectiveness of our proposed framework and datasets, outperforming existing methods on various benchmarks that assess geometric aesthetics and human preferences.
title GLDesigner: Leveraging Multi-Modal LLMs as Designer for Enhanced Aesthetic Text Glyph Layouts
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2411.11435