Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scaling

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Chen, Xiaokang, Wu, Zhiyu, Liu, Xingchao, Pan, Zizheng, Liu, Wen, Xie, Zhenda, Yu, Xingkai, Ruan, Chong
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909469580984320
author Chen, Xiaokang
Wu, Zhiyu
Liu, Xingchao
Pan, Zizheng
Liu, Wen
Xie, Zhenda
Yu, Xingkai
Ruan, Chong
author_facet Chen, Xiaokang
Wu, Zhiyu
Liu, Xingchao
Pan, Zizheng
Liu, Wen
Xie, Zhenda
Yu, Xingkai
Ruan, Chong
contents In this work, we introduce Janus-Pro, an advanced version of the previous work Janus. Specifically, Janus-Pro incorporates (1) an optimized training strategy, (2) expanded training data, and (3) scaling to larger model size. With these improvements, Janus-Pro achieves significant advancements in both multimodal understanding and text-to-image instruction-following capabilities, while also enhancing the stability of text-to-image generation. We hope this work will inspire further exploration in the field. Code and models are publicly available.
format Preprint
id arxiv_https___arxiv_org_abs_2501_17811
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scaling
Chen, Xiaokang
Wu, Zhiyu
Liu, Xingchao
Pan, Zizheng
Liu, Wen
Xie, Zhenda
Yu, Xingkai
Ruan, Chong
Artificial Intelligence
Computation and Language
Computer Vision and Pattern Recognition
In this work, we introduce Janus-Pro, an advanced version of the previous work Janus. Specifically, Janus-Pro incorporates (1) an optimized training strategy, (2) expanded training data, and (3) scaling to larger model size. With these improvements, Janus-Pro achieves significant advancements in both multimodal understanding and text-to-image instruction-following capabilities, while also enhancing the stability of text-to-image generation. We hope this work will inspire further exploration in the field. Code and models are publicly available.
title Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scaling
topic Artificial Intelligence
Computation and Language
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2501.17811