Jagle: Building a Large-Scale Japanese Multimodal Post-Training Dataset for Vision-Language Models
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910097512333312 |
|---|---|
| author | Sugiura, Issa Sasagawa, Keito Nakao, Keisuke Maeda, Koki Yin, Ziqi Yang, Zhishen Kurita, Shuhei Oda, Yusuke Tokuhisa, Ryoko Kawahara, Daisuke Okazaki, Naoaki |
| author_facet | Sugiura, Issa Sasagawa, Keito Nakao, Keisuke Maeda, Koki Yin, Ziqi Yang, Zhishen Kurita, Shuhei Oda, Yusuke Tokuhisa, Ryoko Kawahara, Daisuke Okazaki, Naoaki |
| contents | Developing vision-language models (VLMs) that generalize across diverse tasks requires large-scale training datasets with diverse content. In English, such datasets are typically constructed by aggregating and curating numerous existing visual question answering (VQA) resources. However, this strategy does not readily extend to other languages, where VQA datasets remain limited in both scale and domain coverage, posing a major obstacle to building high-quality multilingual and non-English VLMs. In this work, we introduce Jagle, the largest Japanese multimodal post-training dataset to date, comprising approximately 9.2 million instances across diverse tasks. Rather than relying on existing VQA datasets, we collect heterogeneous source data, including images, image-text pairs, and PDF documents, and generate VQA pairs through multiple strategies such as VLM-based QA generation, translation, and text rendering. Experiments demonstrate that a 2.2B model trained with Jagle achieves strong performance on Japanese tasks, surpassing InternVL3.5-2B in average score across ten Japanese evaluation tasks and approaching within five points of Qwen3-VL-2B-Instruct. Furthermore, combining Jagle with FineVision does not degrade English performance; instead, it improves English performance compared to training with FineVision alone. To facilitate reproducibility and future research, we release the dataset, trained models, and code. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_02048 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Jagle: Building a Large-Scale Japanese Multimodal Post-Training Dataset for Vision-Language Models Sugiura, Issa Sasagawa, Keito Nakao, Keisuke Maeda, Koki Yin, Ziqi Yang, Zhishen Kurita, Shuhei Oda, Yusuke Tokuhisa, Ryoko Kawahara, Daisuke Okazaki, Naoaki Computer Vision and Pattern Recognition Developing vision-language models (VLMs) that generalize across diverse tasks requires large-scale training datasets with diverse content. In English, such datasets are typically constructed by aggregating and curating numerous existing visual question answering (VQA) resources. However, this strategy does not readily extend to other languages, where VQA datasets remain limited in both scale and domain coverage, posing a major obstacle to building high-quality multilingual and non-English VLMs. In this work, we introduce Jagle, the largest Japanese multimodal post-training dataset to date, comprising approximately 9.2 million instances across diverse tasks. Rather than relying on existing VQA datasets, we collect heterogeneous source data, including images, image-text pairs, and PDF documents, and generate VQA pairs through multiple strategies such as VLM-based QA generation, translation, and text rendering. Experiments demonstrate that a 2.2B model trained with Jagle achieves strong performance on Japanese tasks, surpassing InternVL3.5-2B in average score across ten Japanese evaluation tasks and approaching within five points of Qwen3-VL-2B-Instruct. Furthermore, combining Jagle with FineVision does not degrade English performance; instead, it improves English performance compared to training with FineVision alone. To facilitate reproducibility and future research, we release the dataset, trained models, and code. |
| title | Jagle: Building a Large-Scale Japanese Multimodal Post-Training Dataset for Vision-Language Models |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2604.02048 |