Beyond Patches: Global-aware Autoregressive Model for Multimodal Few-Shot Font Generation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Cai, Haonan, Luo, Yuxuan, Lian, Zhouhui
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909050908704768
author Cai, Haonan
Luo, Yuxuan
Lian, Zhouhui
author_facet Cai, Haonan
Luo, Yuxuan
Lian, Zhouhui
contents Manual font design is an intricate process that transforms a stylistic visual concept into a coherent glyph set. This challenge persists in automated Few-shot Font Generation (FFG), where models often struggle to preserve both the structural integrity and stylistic fidelity from limited references. While autoregressive (AR) models have demonstrated impressive generative capabilities, their application to FFG is constrained by conventional patch-level tokenization, which neglects global dependencies crucial for coherent font synthesis. Moreover, existing FFG methods remain within the image-to-image paradigm, relying solely on visual references and overlooking the role of language in conveying stylistic intent during font design. To address these limitations, we propose GAR-Font, a novel AR framework for multimodal few-shot font generation. GAR-Font introduces a global-aware tokenizer that effectively captures both local structures and global stylistic patterns, a multimodal style encoder offering flexible style control through a lightweight language-style adapter without requiring intensive multimodal pretraining, and a post-refinement pipeline that further enhances structural fidelity and style coherence. Extensive experiments show that GAR-Font outperforms existing FFG methods, excelling in maintaining global style faithfulness and achieving higher-quality results with textual stylistic guidance.
format Preprint
id arxiv_https___arxiv_org_abs_2601_01593
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Beyond Patches: Global-aware Autoregressive Model for Multimodal Few-Shot Font Generation
Cai, Haonan
Luo, Yuxuan
Lian, Zhouhui
Computer Vision and Pattern Recognition
Multimedia
Manual font design is an intricate process that transforms a stylistic visual concept into a coherent glyph set. This challenge persists in automated Few-shot Font Generation (FFG), where models often struggle to preserve both the structural integrity and stylistic fidelity from limited references. While autoregressive (AR) models have demonstrated impressive generative capabilities, their application to FFG is constrained by conventional patch-level tokenization, which neglects global dependencies crucial for coherent font synthesis. Moreover, existing FFG methods remain within the image-to-image paradigm, relying solely on visual references and overlooking the role of language in conveying stylistic intent during font design. To address these limitations, we propose GAR-Font, a novel AR framework for multimodal few-shot font generation. GAR-Font introduces a global-aware tokenizer that effectively captures both local structures and global stylistic patterns, a multimodal style encoder offering flexible style control through a lightweight language-style adapter without requiring intensive multimodal pretraining, and a post-refinement pipeline that further enhances structural fidelity and style coherence. Extensive experiments show that GAR-Font outperforms existing FFG methods, excelling in maintaining global style faithfulness and achieving higher-quality results with textual stylistic guidance.
title Beyond Patches: Global-aware Autoregressive Model for Multimodal Few-Shot Font Generation
topic Computer Vision and Pattern Recognition
Multimedia
url https://arxiv.org/abs/2601.01593