Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2404.13710 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909177335513088 |
|---|---|
| author | Nishina, Kunato Matsui, Yusuke |
| author_facet | Nishina, Kunato Matsui, Yusuke |
| contents | Text-to-image models have shown progress in recent years. Along with this progress, generating vector graphics from text has also advanced. SVG is a popular format for vector graphics, and SVG represents a scene with XML text. Therefore, Large Language Models can directly process SVG code. Taking this into account, we focused on editing SVG with LLMs. For quantitative evaluation of LLMs' ability to edit SVG, we propose SVGEditBench. SVGEditBench is a benchmark for assessing the LLMs' ability to edit SVG code. We also show the GPT-4 and GPT-3.5 results when evaluated on the proposed benchmark. In the experiments, GPT-4 showed superior performance to GPT-3.5 both quantitatively and qualitatively. The dataset is available at https://github.com/mti-lab/SVGEditBench. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_13710 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | SVGEditBench: A Benchmark Dataset for Quantitative Assessment of LLM's SVG Editing Capabilities Nishina, Kunato Matsui, Yusuke Computer Vision and Pattern Recognition Text-to-image models have shown progress in recent years. Along with this progress, generating vector graphics from text has also advanced. SVG is a popular format for vector graphics, and SVG represents a scene with XML text. Therefore, Large Language Models can directly process SVG code. Taking this into account, we focused on editing SVG with LLMs. For quantitative evaluation of LLMs' ability to edit SVG, we propose SVGEditBench. SVGEditBench is a benchmark for assessing the LLMs' ability to edit SVG code. We also show the GPT-4 and GPT-3.5 results when evaluated on the proposed benchmark. In the experiments, GPT-4 showed superior performance to GPT-3.5 both quantitatively and qualitatively. The dataset is available at https://github.com/mti-lab/SVGEditBench. |
| title | SVGEditBench: A Benchmark Dataset for Quantitative Assessment of LLM's SVG Editing Capabilities |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2404.13710 |