Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2601.09668 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912826264649728 |
|---|---|
| author | Huang, Ailin Yao, Chengyuan Han, Chunrui Wan, Fanqi Guo, Hangyu Lv, Haoran Zhou, Hongyu Wang, Jia Zhou, Jian Sun, Jianjian Hu, Jingcheng Lin, Kangheng Zhao, Liang Huang, Mitt Yuan, Song Qu, Wenwen Wang, Xiangfeng Lai, Yanlin Zhao, Yingxiu Zhang, Yinmin Shi, Yukang Chen, Yuyang Weng, Zejia Meng, Ziyang Li, Ang Kong, Aobo Dong, Bo Wan, Changyi Wang, David Qi, Di Li, Dingming Yu, En Li, Guopeng Yin, Haiquan Zhou, Han Zhang, Hanshan Yan, Haolong Zhou, Hebin Peng, Hongbo Zhang, Jiaran Lv, Jiashu Fu, Jiayi Cheng, Jie Zhou, Jie Yin, Jisheng Xie, Jingjing Wu, Jingwei Zhang, Jun Liu, Junfeng Tan, Kaijun Yan, Kaiwen Chen, Liangyu Chen, Lina Li, Mingliang Zhao, Qian Sun, Quan Pang, Shaoliang Fan, Shengjie Shang, Shijie Zhang, Siyuan You, Tianhao Ji, Wei Xie, Wuxun Yang, Xiaobo Hou, Xiaojie Jiao, Xiaoran Ren, Xiaoxiao Kong, Xiangwen Huang, Xin Wu, Xin Chen, Xing Wang, Xinran Zhang, Xuelin Wei, Yana Li, Yang Xu, Yanming Shen, Yeqing Peng, Yuang Peng, Yue Zhou, Yu Li, Yusheng Yang, Yuxiang Zhang, Yuyang Xie, Zhe Huang, Zhewei Lu, Zhenyi Fan, Zhimin Cheng, Zihui Jiang, Daxin Han, Qi Zhang, Xiangyu Zhu, Yibo Ge, Zheng |
| author_facet | Huang, Ailin Yao, Chengyuan Han, Chunrui Wan, Fanqi Guo, Hangyu Lv, Haoran Zhou, Hongyu Wang, Jia Zhou, Jian Sun, Jianjian Hu, Jingcheng Lin, Kangheng Zhao, Liang Huang, Mitt Yuan, Song Qu, Wenwen Wang, Xiangfeng Lai, Yanlin Zhao, Yingxiu Zhang, Yinmin Shi, Yukang Chen, Yuyang Weng, Zejia Meng, Ziyang Li, Ang Kong, Aobo Dong, Bo Wan, Changyi Wang, David Qi, Di Li, Dingming Yu, En Li, Guopeng Yin, Haiquan Zhou, Han Zhang, Hanshan Yan, Haolong Zhou, Hebin Peng, Hongbo Zhang, Jiaran Lv, Jiashu Fu, Jiayi Cheng, Jie Zhou, Jie Yin, Jisheng Xie, Jingjing Wu, Jingwei Zhang, Jun Liu, Junfeng Tan, Kaijun Yan, Kaiwen Chen, Liangyu Chen, Lina Li, Mingliang Zhao, Qian Sun, Quan Pang, Shaoliang Fan, Shengjie Shang, Shijie Zhang, Siyuan You, Tianhao Ji, Wei Xie, Wuxun Yang, Xiaobo Hou, Xiaojie Jiao, Xiaoran Ren, Xiaoxiao Kong, Xiangwen Huang, Xin Wu, Xin Chen, Xing Wang, Xinran Zhang, Xuelin Wei, Yana Li, Yang Xu, Yanming Shen, Yeqing Peng, Yuang Peng, Yue Zhou, Yu Li, Yusheng Yang, Yuxiang Zhang, Yuyang Xie, Zhe Huang, Zhewei Lu, Zhenyi Fan, Zhimin Cheng, Zihui Jiang, Daxin Han, Qi Zhang, Xiangyu Zhu, Yibo Ge, Zheng |
| contents | We present STEP3-VL-10B, a lightweight open-source foundation model designed to redefine the trade-off between compact efficiency and frontier-level multimodal intelligence. STEP3-VL-10B is realized through two strategic shifts: first, a unified, fully unfrozen pre-training strategy on 1.2T multimodal tokens that integrates a language-aligned Perception Encoder with a Qwen3-8B decoder to establish intrinsic vision-language synergy; and second, a scaled post-training pipeline featuring over 1k iterations of reinforcement learning. Crucially, we implement Parallel Coordinated Reasoning (PaCoRe) to scale test-time compute, allocating resources to scalable perceptual reasoning that explores and synthesizes diverse visual hypotheses. Consequently, despite its compact 10B footprint, STEP3-VL-10B rivals or surpasses models 10$\times$-20$\times$ larger (e.g., GLM-4.6V-106B, Qwen3-VL-235B) and top-tier proprietary flagships like Gemini 2.5 Pro and Seed-1.5-VL. Delivering best-in-class performance, it records 92.2% on MMBench and 80.11% on MMMU, while excelling in complex reasoning with 94.43% on AIME2025 and 75.95% on MathVision. We release the full model suite to provide the community with a powerful, efficient, and reproducible baseline. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_09668 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | STEP3-VL-10B Technical Report Huang, Ailin Yao, Chengyuan Han, Chunrui Wan, Fanqi Guo, Hangyu Lv, Haoran Zhou, Hongyu Wang, Jia Zhou, Jian Sun, Jianjian Hu, Jingcheng Lin, Kangheng Zhao, Liang Huang, Mitt Yuan, Song Qu, Wenwen Wang, Xiangfeng Lai, Yanlin Zhao, Yingxiu Zhang, Yinmin Shi, Yukang Chen, Yuyang Weng, Zejia Meng, Ziyang Li, Ang Kong, Aobo Dong, Bo Wan, Changyi Wang, David Qi, Di Li, Dingming Yu, En Li, Guopeng Yin, Haiquan Zhou, Han Zhang, Hanshan Yan, Haolong Zhou, Hebin Peng, Hongbo Zhang, Jiaran Lv, Jiashu Fu, Jiayi Cheng, Jie Zhou, Jie Yin, Jisheng Xie, Jingjing Wu, Jingwei Zhang, Jun Liu, Junfeng Tan, Kaijun Yan, Kaiwen Chen, Liangyu Chen, Lina Li, Mingliang Zhao, Qian Sun, Quan Pang, Shaoliang Fan, Shengjie Shang, Shijie Zhang, Siyuan You, Tianhao Ji, Wei Xie, Wuxun Yang, Xiaobo Hou, Xiaojie Jiao, Xiaoran Ren, Xiaoxiao Kong, Xiangwen Huang, Xin Wu, Xin Chen, Xing Wang, Xinran Zhang, Xuelin Wei, Yana Li, Yang Xu, Yanming Shen, Yeqing Peng, Yuang Peng, Yue Zhou, Yu Li, Yusheng Yang, Yuxiang Zhang, Yuyang Xie, Zhe Huang, Zhewei Lu, Zhenyi Fan, Zhimin Cheng, Zihui Jiang, Daxin Han, Qi Zhang, Xiangyu Zhu, Yibo Ge, Zheng Computer Vision and Pattern Recognition We present STEP3-VL-10B, a lightweight open-source foundation model designed to redefine the trade-off between compact efficiency and frontier-level multimodal intelligence. STEP3-VL-10B is realized through two strategic shifts: first, a unified, fully unfrozen pre-training strategy on 1.2T multimodal tokens that integrates a language-aligned Perception Encoder with a Qwen3-8B decoder to establish intrinsic vision-language synergy; and second, a scaled post-training pipeline featuring over 1k iterations of reinforcement learning. Crucially, we implement Parallel Coordinated Reasoning (PaCoRe) to scale test-time compute, allocating resources to scalable perceptual reasoning that explores and synthesizes diverse visual hypotheses. Consequently, despite its compact 10B footprint, STEP3-VL-10B rivals or surpasses models 10$\times$-20$\times$ larger (e.g., GLM-4.6V-106B, Qwen3-VL-235B) and top-tier proprietary flagships like Gemini 2.5 Pro and Seed-1.5-VL. Delivering best-in-class performance, it records 92.2% on MMBench and 80.11% on MMMU, while excelling in complex reasoning with 94.43% on AIME2025 and 75.95% on MathVision. We release the full model suite to provide the community with a powerful, efficient, and reproducible baseline. |
| title | STEP3-VL-10B Technical Report |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2601.09668 |