Saved in:
| Main Authors: | , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2507.22607 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908473240846336 |
|---|---|
| author | Yuan, Ruifeng Xiao, Chenghao Leng, Sicong Wang, Jianyu Li, Long Xu, Weiwen Chan, Hou Pong Zhao, Deli Xu, Tingyang Wei, Zhongyu Zhang, Hao Rong, Yu |
| author_facet | Yuan, Ruifeng Xiao, Chenghao Leng, Sicong Wang, Jianyu Li, Long Xu, Weiwen Chan, Hou Pong Zhao, Deli Xu, Tingyang Wei, Zhongyu Zhang, Hao Rong, Yu |
| contents | Reinforcement learning has proven its effectiveness in enhancing the reasoning capabilities of large language models. Recent research efforts have progressively extended this paradigm to multimodal reasoning tasks. Due to the inherent complexity and diversity of multimodal tasks, especially in semantic content and problem formulations, existing models often exhibit unstable performance across various domains and difficulty levels. To address these limitations, we propose VL-Cogito, an advanced multimodal reasoning model trained via a novel multi-stage Progressive Curriculum Reinforcement Learning (PCuRL) framework. PCuRL systematically guides the model through tasks of gradually increasing difficulty, substantially improving its reasoning abilities across diverse multimodal contexts. The framework introduces two key innovations: (1) an online difficulty soft weighting mechanism, dynamically adjusting training difficulty across successive RL training stages; and (2) a dynamic length reward mechanism, which encourages the model to adaptively regulate its reasoning path length according to task complexity, thus balancing reasoning efficiency with correctness. Experimental evaluations demonstrate that VL-Cogito consistently matches or surpasses existing reasoning-oriented models across mainstream multimodal benchmarks spanning mathematics, science, logic, and general understanding, validating the effectiveness of our approach. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_22607 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | VL-Cogito: Progressive Curriculum Reinforcement Learning for Advanced Multimodal Reasoning Yuan, Ruifeng Xiao, Chenghao Leng, Sicong Wang, Jianyu Li, Long Xu, Weiwen Chan, Hou Pong Zhao, Deli Xu, Tingyang Wei, Zhongyu Zhang, Hao Rong, Yu Computer Vision and Pattern Recognition Artificial Intelligence Computation and Language Reinforcement learning has proven its effectiveness in enhancing the reasoning capabilities of large language models. Recent research efforts have progressively extended this paradigm to multimodal reasoning tasks. Due to the inherent complexity and diversity of multimodal tasks, especially in semantic content and problem formulations, existing models often exhibit unstable performance across various domains and difficulty levels. To address these limitations, we propose VL-Cogito, an advanced multimodal reasoning model trained via a novel multi-stage Progressive Curriculum Reinforcement Learning (PCuRL) framework. PCuRL systematically guides the model through tasks of gradually increasing difficulty, substantially improving its reasoning abilities across diverse multimodal contexts. The framework introduces two key innovations: (1) an online difficulty soft weighting mechanism, dynamically adjusting training difficulty across successive RL training stages; and (2) a dynamic length reward mechanism, which encourages the model to adaptively regulate its reasoning path length according to task complexity, thus balancing reasoning efficiency with correctness. Experimental evaluations demonstrate that VL-Cogito consistently matches or surpasses existing reasoning-oriented models across mainstream multimodal benchmarks spanning mathematics, science, logic, and general understanding, validating the effectiveness of our approach. |
| title | VL-Cogito: Progressive Curriculum Reinforcement Learning for Advanced Multimodal Reasoning |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence Computation and Language |
| url | https://arxiv.org/abs/2507.22607 |