Hierarchical SVG Tokenization: Learning Compact Visual Programs for Scalable Vector Graphics Modeling

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Xing, Ximing, Xue, Ziteng, Li, Zhenxi, Liang, Weicong, Wang, Linqing, Yang, Zhantao, Hang, Tiankai, Yin, Zijin, Lu, Qinglin, Wang, Chunyu, Yu, Qian
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866915929340772352
author Xing, Ximing
Xue, Ziteng
Li, Zhenxi
Liang, Weicong
Wang, Linqing
Yang, Zhantao
Hang, Tiankai
Yin, Zijin
Lu, Qinglin
Wang, Chunyu
Yu, Qian
author_facet Xing, Ximing
Xue, Ziteng
Li, Zhenxi
Liang, Weicong
Wang, Linqing
Yang, Zhantao
Hang, Tiankai
Yin, Zijin
Lu, Qinglin
Wang, Chunyu
Yu, Qian
contents Recent large language models have shifted SVG generation from differentiable rendering optimization to autoregressive program synthesis. However, existing approaches still rely on generic byte-level tokenization inherited from natural language processing, which poorly reflects the geometric structure of vector graphics. Numerical coordinates are fragmented into discrete symbols, destroying spatial relationships and introducing severe token redundancy, often leading to coordinate hallucination and inefficient long-sequence generation. To address these challenges, we propose HiVG, a hierarchical SVG tokenization framework tailored for autoregressive vector graphics generation. HiVG decomposes raw SVG strings into structured \textit{atomic tokens} and further compresses executable command--parameter groups into geometry-constrained \textit{segment tokens}, substantially improving sequence efficiency while preserving syntactic validity. To further mitigate spatial mismatch, we introduce a Hierarchical Mean--Noise (HMN) initialization strategy that injects numerical ordering signals and semantic priors into new token embeddings. Combined with a curriculum training paradigm that progressively increases program complexity, HiVG enables more stable learning of executable SVG programs. Extensive experiments on both text-to-SVG and image-to-SVG tasks demonstrate improved generation fidelity, spatial consistency, and sequence efficiency compared with conventional tokenization schemes. Our code is publicly available at https://github.com/ximinng/HiVG
format Preprint
id arxiv_https___arxiv_org_abs_2604_05072
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Hierarchical SVG Tokenization: Learning Compact Visual Programs for Scalable Vector Graphics Modeling
Xing, Ximing
Xue, Ziteng
Li, Zhenxi
Liang, Weicong
Wang, Linqing
Yang, Zhantao
Hang, Tiankai
Yin, Zijin
Lu, Qinglin
Wang, Chunyu
Yu, Qian
Machine Learning
Recent large language models have shifted SVG generation from differentiable rendering optimization to autoregressive program synthesis. However, existing approaches still rely on generic byte-level tokenization inherited from natural language processing, which poorly reflects the geometric structure of vector graphics. Numerical coordinates are fragmented into discrete symbols, destroying spatial relationships and introducing severe token redundancy, often leading to coordinate hallucination and inefficient long-sequence generation. To address these challenges, we propose HiVG, a hierarchical SVG tokenization framework tailored for autoregressive vector graphics generation. HiVG decomposes raw SVG strings into structured \textit{atomic tokens} and further compresses executable command--parameter groups into geometry-constrained \textit{segment tokens}, substantially improving sequence efficiency while preserving syntactic validity. To further mitigate spatial mismatch, we introduce a Hierarchical Mean--Noise (HMN) initialization strategy that injects numerical ordering signals and semantic priors into new token embeddings. Combined with a curriculum training paradigm that progressively increases program complexity, HiVG enables more stable learning of executable SVG programs. Extensive experiments on both text-to-SVG and image-to-SVG tasks demonstrate improved generation fidelity, spatial consistency, and sequence efficiency compared with conventional tokenization schemes. Our code is publicly available at https://github.com/ximinng/HiVG
title Hierarchical SVG Tokenization: Learning Compact Visual Programs for Scalable Vector Graphics Modeling
topic Machine Learning
url https://arxiv.org/abs/2604.05072