Salvato in:
| Autori principali: | , , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | https://arxiv.org/abs/2602.21628 |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866918367141560320 |
|---|---|
| author | Chen, Yukun Li, Jiaming Chen, Longze Gong, Ze Li, Jingpeng Qin, Zhen Chang, Hengyu Xu, Ancheng Yang, Zhihao Alinejad-Rokny, Hamid Qu, Qiang Zheng, Bo Yang, Min |
| author_facet | Chen, Yukun Li, Jiaming Chen, Longze Gong, Ze Li, Jingpeng Qin, Zhen Chang, Hengyu Xu, Ancheng Yang, Zhihao Alinejad-Rokny, Hamid Qu, Qiang Zheng, Bo Yang, Min |
| contents | Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a prevailing paradigm for enhancing reasoning in Multimodal Large Language Models (MLLMs). However, relying solely on outcome supervision risks reward hacking, where models learn spurious reasoning patterns to satisfy final answer checks. While recent rubric-based approaches offer fine-grained supervision signals, they suffer from high computational costs of instance-level generation and inefficient training dynamics caused by treating all rubrics as equally learnable. In this paper, we propose Stratified Rubric-based Curriculum Learning (RuCL), a novel framework that reformulates curriculum learning by shifting the focus from data selection to reward design. RuCL generates generalized rubrics for broad applicability and stratifies them based on the model's competence. By dynamically adjusting rubric weights during training, RuCL guides the model from mastering foundational perception to tackling advanced logical reasoning. Extensive experiments on various visual reasoning benchmarks show that RuCL yields a remarkable +7.83% average improvement over the Qwen2.5-VL-7B model, achieving a state-of-the-art accuracy of 60.06%. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_21628 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | RuCL: Stratified Rubric-Based Curriculum Learning for Multimodal Large Language Model Reasoning Chen, Yukun Li, Jiaming Chen, Longze Gong, Ze Li, Jingpeng Qin, Zhen Chang, Hengyu Xu, Ancheng Yang, Zhihao Alinejad-Rokny, Hamid Qu, Qiang Zheng, Bo Yang, Min Computation and Language Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a prevailing paradigm for enhancing reasoning in Multimodal Large Language Models (MLLMs). However, relying solely on outcome supervision risks reward hacking, where models learn spurious reasoning patterns to satisfy final answer checks. While recent rubric-based approaches offer fine-grained supervision signals, they suffer from high computational costs of instance-level generation and inefficient training dynamics caused by treating all rubrics as equally learnable. In this paper, we propose Stratified Rubric-based Curriculum Learning (RuCL), a novel framework that reformulates curriculum learning by shifting the focus from data selection to reward design. RuCL generates generalized rubrics for broad applicability and stratifies them based on the model's competence. By dynamically adjusting rubric weights during training, RuCL guides the model from mastering foundational perception to tackling advanced logical reasoning. Extensive experiments on various visual reasoning benchmarks show that RuCL yields a remarkable +7.83% average improvement over the Qwen2.5-VL-7B model, achieving a state-of-the-art accuracy of 60.06%. |
| title | RuCL: Stratified Rubric-Based Curriculum Learning for Multimodal Large Language Model Reasoning |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2602.21628 |